2023-11-19 10:53:15,417 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor timeout: 13 mins 2023-11-19 10:53:15,666 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/404937f1-f8cc-7c23-e42f-3dd0b22b5057 2023-11-19 10:53:15,680 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=1, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-11-19 10:53:15,680 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/404937f1-f8cc-7c23-e42f-3dd0b22b5057/cluster_0d30b9ac-b1ea-f838-523d-c3632a7c9c3a, deleteOnExit=true 2023-11-19 10:53:15,680 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-11-19 10:53:15,681 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/404937f1-f8cc-7c23-e42f-3dd0b22b5057/test.cache.data in system properties and HBase conf 2023-11-19 10:53:15,681 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/404937f1-f8cc-7c23-e42f-3dd0b22b5057/hadoop.tmp.dir in system properties and HBase conf 2023-11-19 10:53:15,681 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/404937f1-f8cc-7c23-e42f-3dd0b22b5057/hadoop.log.dir in system properties and HBase conf 2023-11-19 10:53:15,682 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/404937f1-f8cc-7c23-e42f-3dd0b22b5057/mapreduce.cluster.local.dir in system properties and HBase conf 2023-11-19 10:53:15,682 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/404937f1-f8cc-7c23-e42f-3dd0b22b5057/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-11-19 10:53:15,683 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-11-19 10:53:15,811 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-11-19 10:53:16,212 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-11-19 10:53:16,216 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/404937f1-f8cc-7c23-e42f-3dd0b22b5057/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-11-19 10:53:16,217 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/404937f1-f8cc-7c23-e42f-3dd0b22b5057/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-11-19 10:53:16,217 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/404937f1-f8cc-7c23-e42f-3dd0b22b5057/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-11-19 10:53:16,217 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/404937f1-f8cc-7c23-e42f-3dd0b22b5057/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-11-19 10:53:16,218 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/404937f1-f8cc-7c23-e42f-3dd0b22b5057/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-11-19 10:53:16,218 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/404937f1-f8cc-7c23-e42f-3dd0b22b5057/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-11-19 10:53:16,219 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/404937f1-f8cc-7c23-e42f-3dd0b22b5057/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-11-19 10:53:16,219 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/404937f1-f8cc-7c23-e42f-3dd0b22b5057/dfs.journalnode.edits.dir in system properties and HBase conf 2023-11-19 10:53:16,220 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/404937f1-f8cc-7c23-e42f-3dd0b22b5057/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-11-19 10:53:16,220 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/404937f1-f8cc-7c23-e42f-3dd0b22b5057/nfs.dump.dir in system properties and HBase conf 2023-11-19 10:53:16,221 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/404937f1-f8cc-7c23-e42f-3dd0b22b5057/java.io.tmpdir in system properties and HBase conf 2023-11-19 10:53:16,221 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/404937f1-f8cc-7c23-e42f-3dd0b22b5057/dfs.journalnode.edits.dir in system properties and HBase conf 2023-11-19 10:53:16,222 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/404937f1-f8cc-7c23-e42f-3dd0b22b5057/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-11-19 10:53:16,222 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/404937f1-f8cc-7c23-e42f-3dd0b22b5057/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-11-19 10:53:16,850 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-11-19 10:53:16,855 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-11-19 10:53:17,148 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-11-19 10:53:17,331 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-11-19 10:53:17,354 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-11-19 10:53:17,402 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-11-19 10:53:17,434 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/404937f1-f8cc-7c23-e42f-3dd0b22b5057/java.io.tmpdir/Jetty_localhost_42841_hdfs____.ipz4rj/webapp 2023-11-19 10:53:17,585 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42841 2023-11-19 10:53:17,596 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-11-19 10:53:17,596 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-11-19 10:53:18,122 WARN [Listener at localhost/36407] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-11-19 10:53:18,206 WARN [Listener at localhost/36407] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-11-19 10:53:18,227 WARN [Listener at localhost/36407] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-11-19 10:53:18,233 INFO [Listener at localhost/36407] log.Slf4jLog(67): jetty-6.1.26 2023-11-19 10:53:18,243 INFO [Listener at localhost/36407] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/404937f1-f8cc-7c23-e42f-3dd0b22b5057/java.io.tmpdir/Jetty_localhost_40045_datanode____qgqa70/webapp 2023-11-19 10:53:18,352 INFO [Listener at localhost/36407] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40045 2023-11-19 10:53:18,790 WARN [Listener at localhost/42675] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-11-19 10:53:19,334 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf0901c124c0a6c3f: Processing first storage report for DS-542eeb41-78b8-43e1-8b19-8ce459d30698 from datanode 8e2fbbcd-c08b-4a03-a33d-a6e859d1463d 2023-11-19 10:53:19,336 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf0901c124c0a6c3f: from storage DS-542eeb41-78b8-43e1-8b19-8ce459d30698 node DatanodeRegistration(127.0.0.1:44929, datanodeUuid=8e2fbbcd-c08b-4a03-a33d-a6e859d1463d, infoPort=46793, infoSecurePort=0, ipcPort=42675, storageInfo=lv=-57;cid=testClusterID;nsid=1116433136;c=1700391196931), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-11-19 10:53:19,336 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf0901c124c0a6c3f: Processing first storage report for DS-2a88b8f6-b30c-450a-bb56-d3645cc0d2fa from datanode 8e2fbbcd-c08b-4a03-a33d-a6e859d1463d 2023-11-19 10:53:19,336 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf0901c124c0a6c3f: from storage DS-2a88b8f6-b30c-450a-bb56-d3645cc0d2fa node DatanodeRegistration(127.0.0.1:44929, datanodeUuid=8e2fbbcd-c08b-4a03-a33d-a6e859d1463d, infoPort=46793, infoSecurePort=0, ipcPort=42675, storageInfo=lv=-57;cid=testClusterID;nsid=1116433136;c=1700391196931), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-11-19 10:53:19,410 DEBUG [Listener at localhost/42675] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/404937f1-f8cc-7c23-e42f-3dd0b22b5057 2023-11-19 10:53:19,525 INFO [Listener at localhost/42675] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/404937f1-f8cc-7c23-e42f-3dd0b22b5057/cluster_0d30b9ac-b1ea-f838-523d-c3632a7c9c3a/zookeeper_0, clientPort=60497, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/404937f1-f8cc-7c23-e42f-3dd0b22b5057/cluster_0d30b9ac-b1ea-f838-523d-c3632a7c9c3a/zookeeper_0/version-2, dataDirSize=457 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/404937f1-f8cc-7c23-e42f-3dd0b22b5057/cluster_0d30b9ac-b1ea-f838-523d-c3632a7c9c3a/zookeeper_0/version-2, dataLogSize=457 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, clientPortListenBacklog=-1, serverId=0 2023-11-19 10:53:19,542 INFO [Listener at localhost/42675] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=60497 2023-11-19 10:53:19,550 INFO [Listener at localhost/42675] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-19 10:53:19,553 INFO [Listener at localhost/42675] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-19 10:53:20,247 INFO [Listener at localhost/42675] util.FSUtils(471): Created version file at hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f with version=8 2023-11-19 10:53:20,247 INFO [Listener at localhost/42675] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/hbase-staging 2023-11-19 10:53:20,535 INFO [Listener at localhost/42675] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-11-19 10:53:20,985 INFO [Listener at localhost/42675] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=3 2023-11-19 10:53:21,016 INFO [Listener at localhost/42675] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-19 10:53:21,017 INFO [Listener at localhost/42675] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-11-19 10:53:21,017 INFO [Listener at localhost/42675] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-11-19 10:53:21,017 INFO [Listener at localhost/42675] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-19 10:53:21,017 INFO [Listener at localhost/42675] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-11-19 10:53:21,214 INFO [Listener at localhost/42675] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-11-19 10:53:21,285 DEBUG [Listener at localhost/42675] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-11-19 10:53:21,378 INFO [Listener at localhost/42675] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33457 2023-11-19 10:53:21,387 INFO [Listener at localhost/42675] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-19 10:53:21,389 INFO [Listener at localhost/42675] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-19 10:53:21,411 INFO [Listener at localhost/42675] zookeeper.RecoverableZooKeeper(93): Process identifier=master:33457 connecting to ZooKeeper ensemble=127.0.0.1:60497 2023-11-19 10:53:21,454 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:334570x0, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-11-19 10:53:21,456 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:33457-0x1000546872b0000 connected 2023-11-19 10:53:21,494 DEBUG [Listener at localhost/42675] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-11-19 10:53:21,495 DEBUG [Listener at localhost/42675] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-19 10:53:21,499 DEBUG [Listener at localhost/42675] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-11-19 10:53:21,507 DEBUG [Listener at localhost/42675] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33457 2023-11-19 10:53:21,507 DEBUG [Listener at localhost/42675] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33457 2023-11-19 10:53:21,507 DEBUG [Listener at localhost/42675] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33457 2023-11-19 10:53:21,508 DEBUG [Listener at localhost/42675] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33457 2023-11-19 10:53:21,508 DEBUG [Listener at localhost/42675] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33457 2023-11-19 10:53:21,514 INFO [Listener at localhost/42675] master.HMaster(444): hbase.rootdir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f, hbase.cluster.distributed=false 2023-11-19 10:53:21,580 INFO [Listener at localhost/42675] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=3 2023-11-19 10:53:21,580 INFO [Listener at localhost/42675] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-19 10:53:21,580 INFO [Listener at localhost/42675] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-11-19 10:53:21,580 INFO [Listener at localhost/42675] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-11-19 10:53:21,580 INFO [Listener at localhost/42675] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-19 10:53:21,580 INFO [Listener at localhost/42675] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-11-19 10:53:21,585 INFO [Listener at localhost/42675] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-11-19 10:53:21,587 INFO [Listener at localhost/42675] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46035 2023-11-19 10:53:21,589 INFO [Listener at localhost/42675] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-11-19 10:53:21,595 DEBUG [Listener at localhost/42675] mob.MobFileCache(121): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-11-19 10:53:21,596 INFO [Listener at localhost/42675] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-19 10:53:21,599 INFO [Listener at localhost/42675] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-19 10:53:21,600 INFO [Listener at localhost/42675] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46035 connecting to ZooKeeper ensemble=127.0.0.1:60497 2023-11-19 10:53:21,605 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:460350x0, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-11-19 10:53:21,606 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:46035-0x1000546872b0001 connected 2023-11-19 10:53:21,606 DEBUG [Listener at localhost/42675] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-11-19 10:53:21,607 DEBUG [Listener at localhost/42675] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-19 10:53:21,608 DEBUG [Listener at localhost/42675] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-11-19 10:53:21,609 DEBUG [Listener at localhost/42675] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46035 2023-11-19 10:53:21,609 DEBUG [Listener at localhost/42675] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46035 2023-11-19 10:53:21,612 DEBUG [Listener at localhost/42675] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46035 2023-11-19 10:53:21,613 DEBUG [Listener at localhost/42675] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46035 2023-11-19 10:53:21,616 DEBUG [Listener at localhost/42675] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46035 2023-11-19 10:53:21,619 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,33457,1700391200382 2023-11-19 10:53:21,628 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-11-19 10:53:21,631 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,33457,1700391200382 2023-11-19 10:53:21,650 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-11-19 10:53:21,650 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-11-19 10:53:21,650 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-19 10:53:21,651 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-11-19 10:53:21,652 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,33457,1700391200382 from backup master directory 2023-11-19 10:53:21,652 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-11-19 10:53:21,656 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,33457,1700391200382 2023-11-19 10:53:21,656 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-11-19 10:53:21,657 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-11-19 10:53:21,657 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,33457,1700391200382 2023-11-19 10:53:21,659 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-11-19 10:53:21,661 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-11-19 10:53:21,746 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/hbase.id with ID: 4fd6412e-fdce-43ec-be22-aa90e413fb1e 2023-11-19 10:53:21,789 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-19 10:53:21,808 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-19 10:53:21,848 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x6d1d4b17 to 127.0.0.1:60497 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-19 10:53:21,886 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@21c0f26d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-19 10:53:21,910 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-11-19 10:53:21,912 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-11-19 10:53:21,927 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-11-19 10:53:21,927 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-11-19 10:53:21,930 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-11-19 10:53:21,935 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-11-19 10:53:21,937 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-11-19 10:53:21,975 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/MasterData/data/master/store-tmp 2023-11-19 10:53:22,401 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-19 10:53:22,401 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-11-19 10:53:22,401 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-19 10:53:22,401 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-19 10:53:22,401 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-11-19 10:53:22,401 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-19 10:53:22,401 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-19 10:53:22,401 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-11-19 10:53:22,403 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/MasterData/WALs/jenkins-hbase4.apache.org,33457,1700391200382 2023-11-19 10:53:22,425 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33457%2C1700391200382, suffix=, logDir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/MasterData/WALs/jenkins-hbase4.apache.org,33457,1700391200382, archiveDir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/MasterData/oldWALs, maxLogs=10 2023-11-19 10:53:22,498 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44929,DS-542eeb41-78b8-43e1-8b19-8ce459d30698,DISK] 2023-11-19 10:53:22,507 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:499) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:407) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-11-19 10:53:22,585 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/MasterData/WALs/jenkins-hbase4.apache.org,33457,1700391200382/jenkins-hbase4.apache.org%2C33457%2C1700391200382.1700391202435 2023-11-19 10:53:22,586 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44929,DS-542eeb41-78b8-43e1-8b19-8ce459d30698,DISK]] 2023-11-19 10:53:22,587 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-11-19 10:53:22,587 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-19 10:53:22,591 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-11-19 10:53:22,593 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-11-19 10:53:22,674 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-11-19 10:53:22,681 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-11-19 10:53:22,708 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-11-19 10:53:22,719 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-19 10:53:22,725 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-11-19 10:53:22,726 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-11-19 10:53:22,741 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-11-19 10:53:22,746 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-19 10:53:22,746 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60689091, jitterRate=-0.09566207230091095}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-19 10:53:22,747 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-11-19 10:53:22,748 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-11-19 10:53:22,765 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-11-19 10:53:22,765 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-11-19 10:53:22,767 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-11-19 10:53:22,769 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 0 msec 2023-11-19 10:53:22,800 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 31 msec 2023-11-19 10:53:22,801 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-11-19 10:53:22,825 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-11-19 10:53:22,831 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-11-19 10:53:22,857 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-11-19 10:53:22,860 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-11-19 10:53:22,863 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-11-19 10:53:22,868 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-11-19 10:53:22,872 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-11-19 10:53:22,875 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-19 10:53:22,877 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-11-19 10:53:22,877 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-11-19 10:53:22,891 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-11-19 10:53:22,896 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-11-19 10:53:22,896 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-11-19 10:53:22,896 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-19 10:53:22,897 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,33457,1700391200382, sessionid=0x1000546872b0000, setting cluster-up flag (Was=false) 2023-11-19 10:53:22,917 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-19 10:53:22,925 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-11-19 10:53:22,926 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,33457,1700391200382 2023-11-19 10:53:22,932 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-19 10:53:22,939 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-11-19 10:53:22,941 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,33457,1700391200382 2023-11-19 10:53:22,944 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.hbase-snapshot/.tmp 2023-11-19 10:53:23,022 INFO [RS:0;jenkins-hbase4:46035] regionserver.HRegionServer(951): ClusterId : 4fd6412e-fdce-43ec-be22-aa90e413fb1e 2023-11-19 10:53:23,028 DEBUG [RS:0;jenkins-hbase4:46035] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-11-19 10:53:23,038 DEBUG [RS:0;jenkins-hbase4:46035] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-11-19 10:53:23,038 DEBUG [RS:0;jenkins-hbase4:46035] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-11-19 10:53:23,043 DEBUG [RS:0;jenkins-hbase4:46035] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-11-19 10:53:23,046 DEBUG [RS:0;jenkins-hbase4:46035] zookeeper.ReadOnlyZKClient(139): Connect 0x315590c1 to 127.0.0.1:60497 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-19 10:53:23,056 DEBUG [RS:0;jenkins-hbase4:46035] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f92789b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-19 10:53:23,057 DEBUG [RS:0;jenkins-hbase4:46035] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3badfbb1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-11-19 10:53:23,090 DEBUG [RS:0;jenkins-hbase4:46035] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:46035 2023-11-19 10:53:23,095 INFO [RS:0;jenkins-hbase4:46035] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-11-19 10:53:23,095 INFO [RS:0;jenkins-hbase4:46035] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-11-19 10:53:23,096 DEBUG [RS:0;jenkins-hbase4:46035] regionserver.HRegionServer(1022): About to register with Master. 2023-11-19 10:53:23,099 INFO [RS:0;jenkins-hbase4:46035] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,33457,1700391200382 with isa=jenkins-hbase4.apache.org/172.31.14.131:46035, startcode=1700391201579 2023-11-19 10:53:23,103 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-11-19 10:53:23,116 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-11-19 10:53:23,116 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-11-19 10:53:23,116 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-11-19 10:53:23,116 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-11-19 10:53:23,116 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-11-19 10:53:23,117 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-19 10:53:23,117 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-11-19 10:53:23,117 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-19 10:53:23,118 DEBUG [RS:0;jenkins-hbase4:46035] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-11-19 10:53:23,123 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1700391233123 2023-11-19 10:53:23,125 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-11-19 10:53:23,125 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-11-19 10:53:23,126 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-11-19 10:53:23,132 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-11-19 10:53:23,146 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-11-19 10:53:23,157 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-11-19 10:53:23,158 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-11-19 10:53:23,158 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-11-19 10:53:23,158 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-11-19 10:53:23,159 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-11-19 10:53:23,161 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-11-19 10:53:23,163 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-11-19 10:53:23,163 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-11-19 10:53:23,166 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-11-19 10:53:23,167 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-11-19 10:53:23,172 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1700391203169,5,FailOnTimeoutGroup] 2023-11-19 10:53:23,172 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1700391203172,5,FailOnTimeoutGroup] 2023-11-19 10:53:23,172 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-11-19 10:53:23,173 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-11-19 10:53:23,175 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-11-19 10:53:23,175 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-11-19 10:53:23,186 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-11-19 10:53:23,188 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-11-19 10:53:23,188 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f 2023-11-19 10:53:23,198 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41577, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-11-19 10:53:23,204 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-19 10:53:23,211 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-11-19 10:53:23,214 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/hbase/meta/1588230740/info 2023-11-19 10:53:23,215 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-11-19 10:53:23,216 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33457] master.ServerManager(388): Registering regionserver=jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:23,220 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-19 10:53:23,220 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-11-19 10:53:23,224 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/hbase/meta/1588230740/rep_barrier 2023-11-19 10:53:23,224 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-11-19 10:53:23,225 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-19 10:53:23,226 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-11-19 10:53:23,228 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/hbase/meta/1588230740/table 2023-11-19 10:53:23,229 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-11-19 10:53:23,234 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-19 10:53:23,235 DEBUG [RS:0;jenkins-hbase4:46035] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f 2023-11-19 10:53:23,236 DEBUG [RS:0;jenkins-hbase4:46035] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:36407 2023-11-19 10:53:23,236 DEBUG [RS:0;jenkins-hbase4:46035] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-11-19 10:53:23,237 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/hbase/meta/1588230740 2023-11-19 10:53:23,237 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/hbase/meta/1588230740 2023-11-19 10:53:23,242 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-11-19 10:53:23,244 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-11-19 10:53:23,245 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-11-19 10:53:23,246 DEBUG [RS:0;jenkins-hbase4:46035] zookeeper.ZKUtil(162): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:23,246 WARN [RS:0;jenkins-hbase4:46035] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-11-19 10:53:23,249 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-19 10:53:23,249 INFO [RS:0;jenkins-hbase4:46035] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-11-19 10:53:23,250 DEBUG [RS:0;jenkins-hbase4:46035] regionserver.HRegionServer(1948): logDir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/WALs/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:23,251 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69505761, jitterRate=0.035716548562049866}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-11-19 10:53:23,251 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-11-19 10:53:23,252 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-11-19 10:53:23,252 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-11-19 10:53:23,252 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-11-19 10:53:23,252 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-11-19 10:53:23,252 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-11-19 10:53:23,252 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,46035,1700391201579] 2023-11-19 10:53:23,253 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-11-19 10:53:23,254 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-11-19 10:53:23,261 DEBUG [RS:0;jenkins-hbase4:46035] zookeeper.ZKUtil(162): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:23,267 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-11-19 10:53:23,267 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-11-19 10:53:23,275 DEBUG [RS:0;jenkins-hbase4:46035] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-11-19 10:53:23,277 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-11-19 10:53:23,286 INFO [RS:0;jenkins-hbase4:46035] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-11-19 10:53:23,292 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-11-19 10:53:23,294 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-11-19 10:53:23,308 INFO [RS:0;jenkins-hbase4:46035] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-11-19 10:53:23,312 INFO [RS:0;jenkins-hbase4:46035] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-19 10:53:23,312 INFO [RS:0;jenkins-hbase4:46035] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-19 10:53:23,316 INFO [RS:0;jenkins-hbase4:46035] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-11-19 10:53:23,325 INFO [RS:0;jenkins-hbase4:46035] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=100, unit=MILLISECONDS is enabled. 2023-11-19 10:53:23,325 DEBUG [RS:0;jenkins-hbase4:46035] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-19 10:53:23,325 DEBUG [RS:0;jenkins-hbase4:46035] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-19 10:53:23,325 DEBUG [RS:0;jenkins-hbase4:46035] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-19 10:53:23,326 DEBUG [RS:0;jenkins-hbase4:46035] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-19 10:53:23,326 DEBUG [RS:0;jenkins-hbase4:46035] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-19 10:53:23,326 DEBUG [RS:0;jenkins-hbase4:46035] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-11-19 10:53:23,326 DEBUG [RS:0;jenkins-hbase4:46035] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-19 10:53:23,326 DEBUG [RS:0;jenkins-hbase4:46035] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-19 10:53:23,326 DEBUG [RS:0;jenkins-hbase4:46035] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-19 10:53:23,326 DEBUG [RS:0;jenkins-hbase4:46035] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-19 10:53:23,327 INFO [RS:0;jenkins-hbase4:46035] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-11-19 10:53:23,327 INFO [RS:0;jenkins-hbase4:46035] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-11-19 10:53:23,327 INFO [RS:0;jenkins-hbase4:46035] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-11-19 10:53:23,346 INFO [RS:0;jenkins-hbase4:46035] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-11-19 10:53:23,348 INFO [RS:0;jenkins-hbase4:46035] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46035,1700391201579-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-11-19 10:53:23,366 INFO [RS:0;jenkins-hbase4:46035] regionserver.Replication(203): jenkins-hbase4.apache.org,46035,1700391201579 started 2023-11-19 10:53:23,366 INFO [RS:0;jenkins-hbase4:46035] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,46035,1700391201579, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:46035, sessionid=0x1000546872b0001 2023-11-19 10:53:23,367 DEBUG [RS:0;jenkins-hbase4:46035] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-11-19 10:53:23,367 DEBUG [RS:0;jenkins-hbase4:46035] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:23,367 DEBUG [RS:0;jenkins-hbase4:46035] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46035,1700391201579' 2023-11-19 10:53:23,367 DEBUG [RS:0;jenkins-hbase4:46035] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:53:23,368 DEBUG [RS:0;jenkins-hbase4:46035] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:53:23,368 DEBUG [RS:0;jenkins-hbase4:46035] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-11-19 10:53:23,369 DEBUG [RS:0;jenkins-hbase4:46035] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-11-19 10:53:23,369 DEBUG [RS:0;jenkins-hbase4:46035] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:23,369 DEBUG [RS:0;jenkins-hbase4:46035] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46035,1700391201579' 2023-11-19 10:53:23,369 DEBUG [RS:0;jenkins-hbase4:46035] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-11-19 10:53:23,369 DEBUG [RS:0;jenkins-hbase4:46035] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-11-19 10:53:23,370 DEBUG [RS:0;jenkins-hbase4:46035] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-11-19 10:53:23,370 INFO [RS:0;jenkins-hbase4:46035] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-11-19 10:53:23,370 INFO [RS:0;jenkins-hbase4:46035] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-11-19 10:53:23,446 DEBUG [jenkins-hbase4:33457] assignment.AssignmentManager(2186): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-11-19 10:53:23,449 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,46035,1700391201579, state=OPENING 2023-11-19 10:53:23,456 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-11-19 10:53:23,459 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-19 10:53:23,459 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-11-19 10:53:23,462 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,46035,1700391201579}] 2023-11-19 10:53:23,481 INFO [RS:0;jenkins-hbase4:46035] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46035%2C1700391201579, suffix=, logDir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/WALs/jenkins-hbase4.apache.org,46035,1700391201579, archiveDir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/oldWALs, maxLogs=32 2023-11-19 10:53:23,501 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44929,DS-542eeb41-78b8-43e1-8b19-8ce459d30698,DISK] 2023-11-19 10:53:23,504 INFO [RS:0;jenkins-hbase4:46035] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/WALs/jenkins-hbase4.apache.org,46035,1700391201579/jenkins-hbase4.apache.org%2C46035%2C1700391201579.1700391203484 2023-11-19 10:53:23,505 DEBUG [RS:0;jenkins-hbase4:46035] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44929,DS-542eeb41-78b8-43e1-8b19-8ce459d30698,DISK]] 2023-11-19 10:53:23,646 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:23,648 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-11-19 10:53:23,651 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34088, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-11-19 10:53:23,662 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-11-19 10:53:23,662 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-11-19 10:53:23,665 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46035%2C1700391201579.meta, suffix=.meta, logDir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/WALs/jenkins-hbase4.apache.org,46035,1700391201579, archiveDir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/oldWALs, maxLogs=32 2023-11-19 10:53:23,685 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44929,DS-542eeb41-78b8-43e1-8b19-8ce459d30698,DISK] 2023-11-19 10:53:23,689 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/WALs/jenkins-hbase4.apache.org,46035,1700391201579/jenkins-hbase4.apache.org%2C46035%2C1700391201579.meta.1700391203667.meta 2023-11-19 10:53:23,690 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44929,DS-542eeb41-78b8-43e1-8b19-8ce459d30698,DISK]] 2023-11-19 10:53:23,690 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-11-19 10:53:23,692 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-11-19 10:53:23,712 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-11-19 10:53:23,717 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-11-19 10:53:23,723 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-11-19 10:53:23,723 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-19 10:53:23,723 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-11-19 10:53:23,723 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-11-19 10:53:23,727 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-11-19 10:53:23,729 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/hbase/meta/1588230740/info 2023-11-19 10:53:23,729 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/hbase/meta/1588230740/info 2023-11-19 10:53:23,730 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-11-19 10:53:23,732 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-19 10:53:23,732 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-11-19 10:53:23,733 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/hbase/meta/1588230740/rep_barrier 2023-11-19 10:53:23,733 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/hbase/meta/1588230740/rep_barrier 2023-11-19 10:53:23,734 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-11-19 10:53:23,735 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-19 10:53:23,735 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-11-19 10:53:23,736 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/hbase/meta/1588230740/table 2023-11-19 10:53:23,736 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/hbase/meta/1588230740/table 2023-11-19 10:53:23,737 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-11-19 10:53:23,738 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-19 10:53:23,739 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/hbase/meta/1588230740 2023-11-19 10:53:23,742 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/hbase/meta/1588230740 2023-11-19 10:53:23,745 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-11-19 10:53:23,748 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-11-19 10:53:23,750 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71440135, jitterRate=0.06454096734523773}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-11-19 10:53:23,750 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-11-19 10:53:23,763 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1700391203638 2023-11-19 10:53:23,783 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-11-19 10:53:23,784 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-11-19 10:53:23,785 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,46035,1700391201579, state=OPEN 2023-11-19 10:53:23,790 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-11-19 10:53:23,790 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-11-19 10:53:23,794 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-11-19 10:53:23,794 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,46035,1700391201579 in 328 msec 2023-11-19 10:53:23,799 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-11-19 10:53:23,799 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 518 msec 2023-11-19 10:53:23,806 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 795 msec 2023-11-19 10:53:23,806 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1700391203806, completionTime=-1 2023-11-19 10:53:23,806 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(808): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-11-19 10:53:23,806 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1527): Joining cluster... 2023-11-19 10:53:23,867 DEBUG [hconnection-0x4eb3ff-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-19 10:53:23,870 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34090, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-19 10:53:23,885 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1539): Number of RegionServers=1 2023-11-19 10:53:23,885 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1700391263885 2023-11-19 10:53:23,885 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1700391323885 2023-11-19 10:53:23,885 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1546): Joined the cluster in 78 msec 2023-11-19 10:53:23,911 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33457,1700391200382-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-11-19 10:53:23,911 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33457,1700391200382-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-11-19 10:53:23,912 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33457,1700391200382-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-11-19 10:53:23,913 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:33457, period=300000, unit=MILLISECONDS is enabled. 2023-11-19 10:53:23,914 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-11-19 10:53:23,920 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-11-19 10:53:23,929 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-11-19 10:53:23,930 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-11-19 10:53:23,939 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-11-19 10:53:23,941 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-11-19 10:53:23,944 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-19 10:53:23,964 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/hbase/namespace/7d69714ba10fe87dbfc7ff1b8a18f779 2023-11-19 10:53:23,966 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/hbase/namespace/7d69714ba10fe87dbfc7ff1b8a18f779 empty. 2023-11-19 10:53:23,967 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/hbase/namespace/7d69714ba10fe87dbfc7ff1b8a18f779 2023-11-19 10:53:23,967 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-11-19 10:53:24,386 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-11-19 10:53:24,389 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7d69714ba10fe87dbfc7ff1b8a18f779, NAME => 'hbase:namespace,,1700391203930.7d69714ba10fe87dbfc7ff1b8a18f779.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp 2023-11-19 10:53:24,402 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1700391203930.7d69714ba10fe87dbfc7ff1b8a18f779.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-19 10:53:24,402 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 7d69714ba10fe87dbfc7ff1b8a18f779, disabling compactions & flushes 2023-11-19 10:53:24,402 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1700391203930.7d69714ba10fe87dbfc7ff1b8a18f779. 2023-11-19 10:53:24,402 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1700391203930.7d69714ba10fe87dbfc7ff1b8a18f779. 2023-11-19 10:53:24,402 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1700391203930.7d69714ba10fe87dbfc7ff1b8a18f779. after waiting 0 ms 2023-11-19 10:53:24,402 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1700391203930.7d69714ba10fe87dbfc7ff1b8a18f779. 2023-11-19 10:53:24,402 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1700391203930.7d69714ba10fe87dbfc7ff1b8a18f779. 2023-11-19 10:53:24,402 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 7d69714ba10fe87dbfc7ff1b8a18f779: 2023-11-19 10:53:24,407 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-11-19 10:53:24,423 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1700391203930.7d69714ba10fe87dbfc7ff1b8a18f779.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1700391204410"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700391204410"}]},"ts":"1700391204410"} 2023-11-19 10:53:24,450 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-19 10:53:24,452 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-19 10:53:24,457 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700391204452"}]},"ts":"1700391204452"} 2023-11-19 10:53:24,461 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-11-19 10:53:24,469 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=7d69714ba10fe87dbfc7ff1b8a18f779, ASSIGN}] 2023-11-19 10:53:24,472 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=7d69714ba10fe87dbfc7ff1b8a18f779, ASSIGN 2023-11-19 10:53:24,474 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=7d69714ba10fe87dbfc7ff1b8a18f779, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46035,1700391201579; forceNewPlan=false, retain=false 2023-11-19 10:53:24,625 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=7d69714ba10fe87dbfc7ff1b8a18f779, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:24,625 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1700391203930.7d69714ba10fe87dbfc7ff1b8a18f779.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1700391204625"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700391204625"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700391204625"}]},"ts":"1700391204625"} 2023-11-19 10:53:24,631 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 7d69714ba10fe87dbfc7ff1b8a18f779, server=jenkins-hbase4.apache.org,46035,1700391201579}] 2023-11-19 10:53:24,784 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:24,790 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1700391203930.7d69714ba10fe87dbfc7ff1b8a18f779. 2023-11-19 10:53:24,790 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7d69714ba10fe87dbfc7ff1b8a18f779, NAME => 'hbase:namespace,,1700391203930.7d69714ba10fe87dbfc7ff1b8a18f779.', STARTKEY => '', ENDKEY => ''} 2023-11-19 10:53:24,791 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 7d69714ba10fe87dbfc7ff1b8a18f779 2023-11-19 10:53:24,791 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1700391203930.7d69714ba10fe87dbfc7ff1b8a18f779.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-19 10:53:24,791 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7d69714ba10fe87dbfc7ff1b8a18f779 2023-11-19 10:53:24,791 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7d69714ba10fe87dbfc7ff1b8a18f779 2023-11-19 10:53:24,793 INFO [StoreOpener-7d69714ba10fe87dbfc7ff1b8a18f779-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 7d69714ba10fe87dbfc7ff1b8a18f779 2023-11-19 10:53:24,796 DEBUG [StoreOpener-7d69714ba10fe87dbfc7ff1b8a18f779-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/hbase/namespace/7d69714ba10fe87dbfc7ff1b8a18f779/info 2023-11-19 10:53:24,796 DEBUG [StoreOpener-7d69714ba10fe87dbfc7ff1b8a18f779-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/hbase/namespace/7d69714ba10fe87dbfc7ff1b8a18f779/info 2023-11-19 10:53:24,796 INFO [StoreOpener-7d69714ba10fe87dbfc7ff1b8a18f779-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7d69714ba10fe87dbfc7ff1b8a18f779 columnFamilyName info 2023-11-19 10:53:24,797 INFO [StoreOpener-7d69714ba10fe87dbfc7ff1b8a18f779-1] regionserver.HStore(310): Store=7d69714ba10fe87dbfc7ff1b8a18f779/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-19 10:53:24,799 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/hbase/namespace/7d69714ba10fe87dbfc7ff1b8a18f779 2023-11-19 10:53:24,800 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/hbase/namespace/7d69714ba10fe87dbfc7ff1b8a18f779 2023-11-19 10:53:24,804 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7d69714ba10fe87dbfc7ff1b8a18f779 2023-11-19 10:53:24,807 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/hbase/namespace/7d69714ba10fe87dbfc7ff1b8a18f779/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-19 10:53:24,808 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7d69714ba10fe87dbfc7ff1b8a18f779; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71127669, jitterRate=0.05988486111164093}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-19 10:53:24,808 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7d69714ba10fe87dbfc7ff1b8a18f779: 2023-11-19 10:53:24,810 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1700391203930.7d69714ba10fe87dbfc7ff1b8a18f779., pid=6, masterSystemTime=1700391204784 2023-11-19 10:53:24,813 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1700391203930.7d69714ba10fe87dbfc7ff1b8a18f779. 2023-11-19 10:53:24,814 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1700391203930.7d69714ba10fe87dbfc7ff1b8a18f779. 2023-11-19 10:53:24,815 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=7d69714ba10fe87dbfc7ff1b8a18f779, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:24,815 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1700391203930.7d69714ba10fe87dbfc7ff1b8a18f779.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1700391204814"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700391204814"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700391204814"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700391204814"}]},"ts":"1700391204814"} 2023-11-19 10:53:24,822 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-11-19 10:53:24,822 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 7d69714ba10fe87dbfc7ff1b8a18f779, server=jenkins-hbase4.apache.org,46035,1700391201579 in 188 msec 2023-11-19 10:53:24,825 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-11-19 10:53:24,826 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=7d69714ba10fe87dbfc7ff1b8a18f779, ASSIGN in 353 msec 2023-11-19 10:53:24,827 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-19 10:53:24,827 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700391204827"}]},"ts":"1700391204827"} 2023-11-19 10:53:24,830 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-11-19 10:53:24,834 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-11-19 10:53:24,836 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 903 msec 2023-11-19 10:53:24,842 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-11-19 10:53:24,843 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-11-19 10:53:24,843 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-19 10:53:24,875 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-11-19 10:53:24,892 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-11-19 10:53:24,899 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 30 msec 2023-11-19 10:53:24,909 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-11-19 10:53:24,922 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-11-19 10:53:24,928 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 17 msec 2023-11-19 10:53:24,936 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-11-19 10:53:24,940 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-11-19 10:53:24,940 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.283sec 2023-11-19 10:53:24,942 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-11-19 10:53:24,944 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-11-19 10:53:24,944 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-11-19 10:53:24,945 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33457,1700391200382-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-11-19 10:53:24,945 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33457,1700391200382-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-11-19 10:53:24,955 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-11-19 10:53:25,028 DEBUG [Listener at localhost/42675] zookeeper.ReadOnlyZKClient(139): Connect 0x77fd41f4 to 127.0.0.1:60497 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-19 10:53:25,034 DEBUG [Listener at localhost/42675] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1ed63e4c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-19 10:53:25,052 DEBUG [hconnection-0x40c4f23-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-19 10:53:25,067 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34096, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-19 10:53:25,079 INFO [Listener at localhost/42675] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,33457,1700391200382 2023-11-19 10:53:25,081 DEBUG [Listener at localhost/42675] zookeeper.ReadOnlyZKClient(139): Connect 0x0a11c17b to 127.0.0.1:60497 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-19 10:53:25,092 DEBUG [Listener at localhost/42675] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@31f4d39e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-19 10:53:25,093 INFO [Listener at localhost/42675] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-19 10:53:25,160 INFO [Listener at localhost/42675] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=213, OpenFileDescriptor=505, MaxFileDescriptor=60000, SystemLoadAverage=284, ProcessCount=170, AvailableMemoryMB=16241 2023-11-19 10:53:25,170 DEBUG [Listener at localhost/42675] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-19 10:53:25,175 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49664, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-19 10:53:25,191 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-19 10:53:25,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:25,195 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_PRE_OPERATION 2023-11-19 10:53:25,197 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-19 10:53:25,200 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa 2023-11-19 10:53:25,200 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthly" procId is: 9 2023-11-19 10:53:25,201 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa empty. 2023-11-19 10:53:25,203 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa 2023-11-19 10:53:25,203 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthly regions 2023-11-19 10:53:25,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-19 10:53:25,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-19 10:53:25,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-19 10:53:25,621 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-11-19 10:53:25,623 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(7675): creating {ENCODED => f2cb6679d87b843f3747aea4a88ed8aa, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp 2023-11-19 10:53:25,638 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-19 10:53:25,638 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1604): Closing f2cb6679d87b843f3747aea4a88ed8aa, disabling compactions & flushes 2023-11-19 10:53:25,638 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa. 2023-11-19 10:53:25,638 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa. 2023-11-19 10:53:25,638 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa. after waiting 0 ms 2023-11-19 10:53:25,638 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa. 2023-11-19 10:53:25,638 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa. 2023-11-19 10:53:25,638 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1558): Region close journal for f2cb6679d87b843f3747aea4a88ed8aa: 2023-11-19 10:53:25,643 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ADD_TO_META 2023-11-19 10:53:25,645 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1700391205645"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700391205645"}]},"ts":"1700391205645"} 2023-11-19 10:53:25,648 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-19 10:53:25,650 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-19 10:53:25,650 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700391205650"}]},"ts":"1700391205650"} 2023-11-19 10:53:25,653 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLING in hbase:meta 2023-11-19 10:53:25,657 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=f2cb6679d87b843f3747aea4a88ed8aa, ASSIGN}] 2023-11-19 10:53:25,660 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=f2cb6679d87b843f3747aea4a88ed8aa, ASSIGN 2023-11-19 10:53:25,662 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=f2cb6679d87b843f3747aea4a88ed8aa, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46035,1700391201579; forceNewPlan=false, retain=false 2023-11-19 10:53:25,813 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=f2cb6679d87b843f3747aea4a88ed8aa, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:25,814 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1700391205813"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700391205813"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700391205813"}]},"ts":"1700391205813"} 2023-11-19 10:53:25,817 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure f2cb6679d87b843f3747aea4a88ed8aa, server=jenkins-hbase4.apache.org,46035,1700391201579}] 2023-11-19 10:53:25,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-19 10:53:25,970 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:25,977 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa. 2023-11-19 10:53:25,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f2cb6679d87b843f3747aea4a88ed8aa, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa.', STARTKEY => '', ENDKEY => ''} 2023-11-19 10:53:25,978 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly f2cb6679d87b843f3747aea4a88ed8aa 2023-11-19 10:53:25,978 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-19 10:53:25,978 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f2cb6679d87b843f3747aea4a88ed8aa 2023-11-19 10:53:25,978 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f2cb6679d87b843f3747aea4a88ed8aa 2023-11-19 10:53:25,982 INFO [StoreOpener-f2cb6679d87b843f3747aea4a88ed8aa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region f2cb6679d87b843f3747aea4a88ed8aa 2023-11-19 10:53:25,985 DEBUG [StoreOpener-f2cb6679d87b843f3747aea4a88ed8aa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1 2023-11-19 10:53:25,985 DEBUG [StoreOpener-f2cb6679d87b843f3747aea4a88ed8aa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1 2023-11-19 10:53:25,989 INFO [StoreOpener-f2cb6679d87b843f3747aea4a88ed8aa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f2cb6679d87b843f3747aea4a88ed8aa columnFamilyName family1 2023-11-19 10:53:25,994 INFO [StoreOpener-f2cb6679d87b843f3747aea4a88ed8aa-1] regionserver.HStore(310): Store=f2cb6679d87b843f3747aea4a88ed8aa/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-19 10:53:25,997 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa 2023-11-19 10:53:26,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa 2023-11-19 10:53:26,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f2cb6679d87b843f3747aea4a88ed8aa 2023-11-19 10:53:26,026 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-19 10:53:26,027 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f2cb6679d87b843f3747aea4a88ed8aa; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62622356, jitterRate=-0.06685417890548706}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-19 10:53:26,027 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f2cb6679d87b843f3747aea4a88ed8aa: 2023-11-19 10:53:26,029 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa., pid=11, masterSystemTime=1700391205970 2023-11-19 10:53:26,032 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa. 2023-11-19 10:53:26,032 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa. 2023-11-19 10:53:26,033 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=f2cb6679d87b843f3747aea4a88ed8aa, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:26,033 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1700391206033"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700391206033"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700391206033"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700391206033"}]},"ts":"1700391206033"} 2023-11-19 10:53:26,043 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-11-19 10:53:26,043 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure f2cb6679d87b843f3747aea4a88ed8aa, server=jenkins-hbase4.apache.org,46035,1700391201579 in 223 msec 2023-11-19 10:53:26,047 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-11-19 10:53:26,047 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=f2cb6679d87b843f3747aea4a88ed8aa, ASSIGN in 386 msec 2023-11-19 10:53:26,048 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-19 10:53:26,049 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700391206049"}]},"ts":"1700391206049"} 2023-11-19 10:53:26,051 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLED in hbase:meta 2023-11-19 10:53:26,054 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_POST_OPERATION 2023-11-19 10:53:26,057 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 863 msec 2023-11-19 10:53:26,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-19 10:53:26,321 INFO [Listener at localhost/42675] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthly, procId: 9 completed 2023-11-19 10:53:26,338 DEBUG [hconnection-0x2c9fcfea-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-19 10:53:26,341 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34100, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-19 10:53:26,492 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:53:26,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:26,501 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-19 10:53:26,501 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:53:26,502 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-19 10:53:26,502 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-19 10:53:26,503 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:26,503 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:26,504 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:53:26,504 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:26,504 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:53:26,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:53:26,505 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:26,505 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:53:26,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:26,506 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:26,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:53:26,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:26,507 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:26,508 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:26,509 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-19 10:53:26,509 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:53:26,509 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-19 10:53:26,510 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-19 10:53:26,510 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:53:26,510 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa. 2023-11-19 10:53:26,511 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa. started... 2023-11-19 10:53:26,512 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f2cb6679d87b843f3747aea4a88ed8aa 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-19 10:53:27,064 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511307ee7c1972e6044f08bcef638afa2f548 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511307ee7c1972e6044f08bcef638afa2f548 2023-11-19 10:53:27,084 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/.tmp/family1/d4d408ddc25e4d2984a59910d8048e6e 2023-11-19 10:53:27,095 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/.tmp/family1/d4d408ddc25e4d2984a59910d8048e6e as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/d4d408ddc25e4d2984a59910d8048e6e 2023-11-19 10:53:27,104 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/d4d408ddc25e4d2984a59910d8048e6e, entries=1000, sequenceid=5, filesize=175.8 K 2023-11-19 10:53:27,108 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for f2cb6679d87b843f3747aea4a88ed8aa in 596ms, sequenceid=5, compaction requested=false 2023-11-19 10:53:27,110 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-19 10:53:27,114 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f2cb6679d87b843f3747aea4a88ed8aa: 2023-11-19 10:53:27,114 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa. 2023-11-19 10:53:27,114 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-19 10:53:27,115 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-19 10:53:27,115 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:27,115 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-19 10:53:27,115 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-19 10:53:27,119 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:27,119 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:27,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:27,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:27,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:27,120 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:27,120 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:53:27,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:27,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:27,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:27,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:27,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:27,123 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-19 10:53:27,123 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-19 10:53:27,123 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7ee1d3c8[Count = 0] remaining members to acquire global barrier 2023-11-19 10:53:27,123 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:27,125 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:27,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:27,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:27,126 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-19 10:53:27,126 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-19 10:53:27,126 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:53:27,126 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:27,126 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:53:27,130 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-19 10:53:27,130 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:27,130 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:53:27,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:27,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:27,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:27,130 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-19 10:53:27,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:27,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:27,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:27,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:27,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:27,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:27,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:27,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:53:27,134 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-19 10:53:27,134 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-19 10:53:27,134 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:53:27,134 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:53:27,134 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:27,134 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:53:27,137 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:27,137 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:27,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:27,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:27,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:27,137 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:27,137 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:53:27,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:27,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:27,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:53:27,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:53:27,138 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:27,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:27,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:27,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:27,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:27,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:27,140 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:27,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:27,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:27,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:27,148 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:27,148 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:27,148 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:53:27,148 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:27,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:53:27,148 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:53:27,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:53:27,148 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:27,148 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:53:27,148 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-19 10:53:27,149 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:53:27,148 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:27,149 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:27,149 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:27,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:53:27,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:53:27,151 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-19 10:53:27,151 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:53:27,251 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:53:27,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:53:27,269 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:53:27,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-19 10:53:27,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:27,272 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-19 10:53:27,272 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:53:27,273 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-19 10:53:27,273 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-19 10:53:27,273 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:27,274 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:27,281 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:53:27,281 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:27,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:53:27,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:53:27,282 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:27,282 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:53:27,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:27,283 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:27,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:53:27,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:27,283 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:27,284 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-19 10:53:27,284 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:27,284 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-19 10:53:27,284 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:53:27,284 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-19 10:53:27,285 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-19 10:53:27,285 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:53:27,285 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa. 2023-11-19 10:53:27,285 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa. started... 2023-11-19 10:53:27,285 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f2cb6679d87b843f3747aea4a88ed8aa 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-19 10:53:27,716 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511287ab9a22bb1094ad2970fa52c2574adcb to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511287ab9a22bb1094ad2970fa52c2574adcb 2023-11-19 10:53:27,730 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/.tmp/family1/921b5dd23ee847dba50fcb15bdf85728 2023-11-19 10:53:27,740 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/.tmp/family1/921b5dd23ee847dba50fcb15bdf85728 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/921b5dd23ee847dba50fcb15bdf85728 2023-11-19 10:53:27,749 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/921b5dd23ee847dba50fcb15bdf85728, entries=1, sequenceid=9, filesize=5.0 K 2023-11-19 10:53:27,751 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for f2cb6679d87b843f3747aea4a88ed8aa in 466ms, sequenceid=9, compaction requested=false 2023-11-19 10:53:27,751 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f2cb6679d87b843f3747aea4a88ed8aa: 2023-11-19 10:53:27,751 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa. 2023-11-19 10:53:27,751 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-19 10:53:27,752 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-19 10:53:27,752 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:27,752 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-19 10:53:27,752 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-19 10:53:27,754 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:27,754 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:27,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:27,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:27,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:27,755 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:27,755 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:53:27,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:27,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:27,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:27,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:27,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:27,757 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-19 10:53:27,758 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@71454fd6[Count = 0] remaining members to acquire global barrier 2023-11-19 10:53:27,758 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-19 10:53:27,758 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:27,760 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:27,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:27,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:27,760 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-19 10:53:27,760 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-19 10:53:27,760 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:53:27,760 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:27,760 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:53:27,762 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-19 10:53:27,762 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:53:27,762 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:27,762 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-19 10:53:27,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:27,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:27,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:27,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:27,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:27,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:27,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:27,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:27,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:27,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:27,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:53:27,768 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-19 10:53:27,768 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-19 10:53:27,768 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:53:27,768 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:53:27,768 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:27,768 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:53:27,772 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:27,772 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:27,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:27,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:27,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:27,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:27,772 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:53:27,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:27,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:27,773 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:27,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:53:27,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:53:27,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:27,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:27,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:27,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:27,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:27,776 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:27,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:27,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:27,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:27,781 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:27,781 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:53:27,781 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:27,781 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:27,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:53:27,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:53:27,781 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:27,782 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:53:27,782 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:27,782 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:27,782 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:27,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:53:27,782 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-19 10:53:27,782 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:53:27,782 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:53:27,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:53:27,783 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-19 10:53:27,783 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:53:27,883 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:53:27,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:53:27,894 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:53:27,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-19 10:53:27,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:27,900 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-19 10:53:27,900 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:53:27,901 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-19 10:53:27,901 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-19 10:53:27,902 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:27,902 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:27,904 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:53:27,904 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:27,904 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:53:27,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:53:27,904 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:27,905 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:53:27,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:27,906 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:27,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:53:27,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:27,907 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:27,907 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-19 10:53:27,907 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:27,907 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-19 10:53:27,907 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:53:27,908 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-19 10:53:27,908 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-19 10:53:27,908 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:53:27,908 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa. 2023-11-19 10:53:27,908 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa. started... 2023-11-19 10:53:27,908 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f2cb6679d87b843f3747aea4a88ed8aa 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-19 10:53:28,350 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512014bba957bf729455b94f10b928788e386 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512014bba957bf729455b94f10b928788e386 2023-11-19 10:53:28,362 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/.tmp/family1/d018b11aea1e40ef8e04d1a6b4f3ff44 2023-11-19 10:53:28,372 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/.tmp/family1/d018b11aea1e40ef8e04d1a6b4f3ff44 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/d018b11aea1e40ef8e04d1a6b4f3ff44 2023-11-19 10:53:28,381 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/d018b11aea1e40ef8e04d1a6b4f3ff44, entries=1, sequenceid=13, filesize=5.0 K 2023-11-19 10:53:28,382 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f2cb6679d87b843f3747aea4a88ed8aa in 474ms, sequenceid=13, compaction requested=true 2023-11-19 10:53:28,383 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f2cb6679d87b843f3747aea4a88ed8aa: 2023-11-19 10:53:28,383 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa. 2023-11-19 10:53:28,383 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-19 10:53:28,383 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-19 10:53:28,383 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:28,383 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-19 10:53:28,383 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-19 10:53:28,386 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:28,386 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:28,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:28,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:28,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:28,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:28,387 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:28,387 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:53:28,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:28,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:28,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:28,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:28,390 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-19 10:53:28,390 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1f29e93f[Count = 0] remaining members to acquire global barrier 2023-11-19 10:53:28,390 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-19 10:53:28,390 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:28,393 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:28,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:28,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:28,393 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-19 10:53:28,393 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-19 10:53:28,394 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:53:28,394 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:28,394 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:53:28,396 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-19 10:53:28,396 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:28,396 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:53:28,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:28,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:28,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:28,396 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-19 10:53:28,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:28,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:28,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:28,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:28,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:28,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:28,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:28,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:53:28,402 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-19 10:53:28,402 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-19 10:53:28,402 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:53:28,402 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:53:28,402 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:28,402 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:53:28,405 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:28,405 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:28,405 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:53:28,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:28,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:28,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:28,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:28,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:28,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:28,406 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:53:28,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:53:28,406 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:28,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:28,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:28,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:28,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:28,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:28,409 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:28,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:28,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:28,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:28,415 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:53:28,415 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:53:28,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:53:28,415 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:53:28,415 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:28,415 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:28,415 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:28,415 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:28,415 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:28,415 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:28,415 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:28,415 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:53:28,415 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-19 10:53:28,416 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:53:28,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:53:28,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:53:28,419 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-19 10:53:28,419 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:53:28,520 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:53:28,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:53:28,528 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:53:28,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-19 10:53:28,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:28,531 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-19 10:53:28,531 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:53:28,532 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-19 10:53:28,532 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-19 10:53:28,532 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:28,532 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:28,535 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:28,535 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:53:28,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:53:28,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:53:28,535 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:28,535 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:53:28,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:28,536 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:28,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:53:28,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:28,536 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:28,537 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-19 10:53:28,537 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:28,537 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-19 10:53:28,537 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:53:28,537 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-19 10:53:28,537 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-19 10:53:28,537 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:53:28,537 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa. 2023-11-19 10:53:28,538 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa. started... 2023-11-19 10:53:28,538 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f2cb6679d87b843f3747aea4a88ed8aa 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-19 10:53:28,985 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205a85fd2303e6a4ace81c91090be77140e to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205a85fd2303e6a4ace81c91090be77140e 2023-11-19 10:53:29,247 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-19 10:53:29,308 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-11-19 10:53:29,309 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-11-19 10:53:29,417 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/.tmp/family1/f2900868becb4335a8ae461c980b14ff 2023-11-19 10:53:29,435 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/.tmp/family1/f2900868becb4335a8ae461c980b14ff as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/f2900868becb4335a8ae461c980b14ff 2023-11-19 10:53:29,445 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/f2900868becb4335a8ae461c980b14ff, entries=1, sequenceid=17, filesize=5.0 K 2023-11-19 10:53:29,447 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f2cb6679d87b843f3747aea4a88ed8aa in 909ms, sequenceid=17, compaction requested=true 2023-11-19 10:53:29,447 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f2cb6679d87b843f3747aea4a88ed8aa: 2023-11-19 10:53:29,447 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa. 2023-11-19 10:53:29,447 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-19 10:53:29,449 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-19 10:53:29,449 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:29,449 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-19 10:53:29,449 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-19 10:53:29,452 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:29,452 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:29,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:29,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:29,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:29,453 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:29,453 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:53:29,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:29,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:29,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:29,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:29,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:29,456 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-19 10:53:29,456 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@12769640[Count = 0] remaining members to acquire global barrier 2023-11-19 10:53:29,456 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-19 10:53:29,456 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:29,458 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:29,458 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:29,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:29,458 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-19 10:53:29,458 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-19 10:53:29,458 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:53:29,459 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:29,459 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:53:29,462 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-19 10:53:29,462 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:29,462 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:53:29,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:29,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:29,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:29,463 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-19 10:53:29,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:29,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:29,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:29,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:29,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:29,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:29,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:29,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:53:29,468 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-19 10:53:29,468 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-19 10:53:29,468 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:53:29,468 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:53:29,468 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:29,468 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:53:29,476 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:29,476 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:29,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:29,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:29,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:29,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:29,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:29,476 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:53:29,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:53:29,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:53:29,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:29,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:29,478 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:29,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:29,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:29,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:29,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:29,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:29,482 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:29,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:29,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:29,493 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:53:29,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:53:29,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:53:29,493 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:53:29,493 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:29,493 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:29,493 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:29,493 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:29,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:53:29,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:53:29,494 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:29,494 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:53:29,494 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:29,494 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-19 10:53:29,495 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:53:29,495 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:29,496 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-19 10:53:29,496 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:53:29,597 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:53:29,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:53:29,606 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:53:29,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-19 10:53:29,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:29,609 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-19 10:53:29,609 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:53:29,609 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-19 10:53:29,609 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-19 10:53:29,610 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:29,610 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:29,613 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:29,613 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:53:29,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:53:29,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:53:29,613 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:29,613 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:53:29,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:29,614 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:29,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:53:29,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:29,614 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:29,615 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-19 10:53:29,615 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:29,615 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-19 10:53:29,615 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:53:29,615 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-19 10:53:29,615 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-19 10:53:29,615 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:53:29,615 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa. 2023-11-19 10:53:29,615 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa. started... 2023-11-19 10:53:29,616 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f2cb6679d87b843f3747aea4a88ed8aa 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-19 10:53:30,038 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228d4cea6cde1dd4dda9fbe0bb3edfb3d72 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228d4cea6cde1dd4dda9fbe0bb3edfb3d72 2023-11-19 10:53:30,451 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/.tmp/family1/944acab6f442488093c9fae67128ee49 2023-11-19 10:53:30,460 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/.tmp/family1/944acab6f442488093c9fae67128ee49 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/944acab6f442488093c9fae67128ee49 2023-11-19 10:53:30,469 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/944acab6f442488093c9fae67128ee49, entries=1, sequenceid=21, filesize=5.0 K 2023-11-19 10:53:30,470 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f2cb6679d87b843f3747aea4a88ed8aa in 854ms, sequenceid=21, compaction requested=true 2023-11-19 10:53:30,470 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f2cb6679d87b843f3747aea4a88ed8aa: 2023-11-19 10:53:30,470 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa. 2023-11-19 10:53:30,470 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-19 10:53:30,471 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-19 10:53:30,471 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:30,471 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-19 10:53:30,471 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-19 10:53:30,478 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:30,478 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:30,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:30,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:30,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:30,478 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:30,478 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:53:30,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:30,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:30,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:30,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:30,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:30,480 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-19 10:53:30,480 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@62797855[Count = 0] remaining members to acquire global barrier 2023-11-19 10:53:30,480 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-19 10:53:30,480 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:30,481 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:30,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:30,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:30,482 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-19 10:53:30,482 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-19 10:53:30,482 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:53:30,482 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:30,482 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:53:30,489 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-19 10:53:30,489 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:30,489 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:53:30,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:30,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:30,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:30,489 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-19 10:53:30,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:30,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:30,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:30,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:30,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:30,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:30,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:30,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:53:30,493 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-19 10:53:30,493 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-19 10:53:30,493 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:53:30,493 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:53:30,493 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:30,493 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:53:30,495 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:30,495 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:30,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:30,495 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:30,495 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:53:30,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:30,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:30,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:30,496 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:53:30,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:53:30,496 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:30,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:30,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:30,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:30,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:30,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:30,497 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:30,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:30,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:30,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:30,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:30,500 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:30,500 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:30,500 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:53:30,500 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:30,501 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:30,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:53:30,501 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:30,501 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:53:30,501 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-19 10:53:30,501 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:53:30,501 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-19 10:53:30,501 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:53:30,501 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:30,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:53:30,501 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:30,502 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-19 10:53:30,502 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:53:30,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:53:30,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:53:30,532 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-11-19 10:53:30,532 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-11-19 10:53:30,602 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:53:30,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:53:30,611 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:53:30,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-19 10:53:30,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:30,613 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-19 10:53:30,614 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:53:30,614 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-19 10:53:30,614 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-19 10:53:30,615 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:30,615 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:30,617 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:53:30,617 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:30,617 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:53:30,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:53:30,618 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:30,618 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:53:30,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:30,618 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:30,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:53:30,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:30,619 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:30,619 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-19 10:53:30,619 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:30,619 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-19 10:53:30,619 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:53:30,619 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-19 10:53:30,620 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-19 10:53:30,620 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:53:30,620 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa. 2023-11-19 10:53:30,620 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa. started... 2023-11-19 10:53:30,620 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f2cb6679d87b843f3747aea4a88ed8aa 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-19 10:53:31,042 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512312aa67e03247e483f8c050ae5a45481f3 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512312aa67e03247e483f8c050ae5a45481f3 2023-11-19 10:53:31,452 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/.tmp/family1/4761f35c03e446afbb9ed51742cc2047 2023-11-19 10:53:31,461 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/.tmp/family1/4761f35c03e446afbb9ed51742cc2047 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/4761f35c03e446afbb9ed51742cc2047 2023-11-19 10:53:31,469 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/4761f35c03e446afbb9ed51742cc2047, entries=1, sequenceid=25, filesize=5.0 K 2023-11-19 10:53:31,470 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f2cb6679d87b843f3747aea4a88ed8aa in 850ms, sequenceid=25, compaction requested=true 2023-11-19 10:53:31,470 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f2cb6679d87b843f3747aea4a88ed8aa: 2023-11-19 10:53:31,470 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa. 2023-11-19 10:53:31,470 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-19 10:53:31,471 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-19 10:53:31,471 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:31,471 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-19 10:53:31,471 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-19 10:53:31,473 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:31,473 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:31,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:31,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:31,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:31,474 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:31,474 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:53:31,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:31,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:31,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:31,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:31,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:31,477 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-19 10:53:31,477 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3919b033[Count = 0] remaining members to acquire global barrier 2023-11-19 10:53:31,477 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-19 10:53:31,477 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:31,479 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:31,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:31,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:31,479 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-19 10:53:31,479 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-19 10:53:31,480 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:53:31,480 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:31,480 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:53:31,482 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-19 10:53:31,482 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:53:31,482 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-19 10:53:31,482 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:31,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:31,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:31,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:31,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:31,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:31,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:31,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:31,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:31,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:31,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:31,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:53:31,488 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-19 10:53:31,488 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-19 10:53:31,488 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:53:31,488 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:53:31,488 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:31,488 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:53:31,490 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:31,491 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:31,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:31,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:31,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:31,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:31,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:31,491 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:53:31,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:31,492 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:31,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:31,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:31,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:31,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:31,495 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:31,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:31,496 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:53:31,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:53:31,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:31,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:31,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:31,499 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:31,499 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:31,499 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:31,499 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:53:31,500 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:53:31,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:53:31,500 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:31,500 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:53:31,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:53:31,500 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:31,500 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-19 10:53:31,501 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:53:31,501 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:31,501 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:31,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:53:31,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:53:31,501 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-19 10:53:31,501 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:53:31,601 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:53:31,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:53:31,611 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:53:31,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-19 10:53:31,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:31,614 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-19 10:53:31,614 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:53:31,614 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-19 10:53:31,614 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-19 10:53:31,615 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:31,615 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:31,617 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:31,617 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:53:31,617 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:53:31,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:53:31,617 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:31,617 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:53:31,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:31,618 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:31,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:53:31,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:31,619 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:31,619 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-19 10:53:31,619 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:31,619 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-19 10:53:31,619 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:53:31,620 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-19 10:53:31,620 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-19 10:53:31,620 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:53:31,620 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa. 2023-11-19 10:53:31,620 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa. started... 2023-11-19 10:53:31,620 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f2cb6679d87b843f3747aea4a88ed8aa 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-19 10:53:32,045 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101ecdc89f5f2b145c894b34a97c9eb63cf to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101ecdc89f5f2b145c894b34a97c9eb63cf 2023-11-19 10:53:32,455 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/.tmp/family1/fede17dc7d5945e096b5413233b65382 2023-11-19 10:53:32,463 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/.tmp/family1/fede17dc7d5945e096b5413233b65382 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/fede17dc7d5945e096b5413233b65382 2023-11-19 10:53:32,472 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/fede17dc7d5945e096b5413233b65382, entries=1, sequenceid=29, filesize=5.0 K 2023-11-19 10:53:32,473 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f2cb6679d87b843f3747aea4a88ed8aa in 853ms, sequenceid=29, compaction requested=true 2023-11-19 10:53:32,473 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f2cb6679d87b843f3747aea4a88ed8aa: 2023-11-19 10:53:32,474 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa. 2023-11-19 10:53:32,474 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-19 10:53:32,474 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-19 10:53:32,474 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:32,474 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-19 10:53:32,474 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-19 10:53:32,479 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:32,479 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:32,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:32,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:32,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:32,479 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:32,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:32,480 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:53:32,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:32,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:32,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:32,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:32,482 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-19 10:53:32,482 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6929c63e[Count = 0] remaining members to acquire global barrier 2023-11-19 10:53:32,482 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-19 10:53:32,482 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:32,483 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:32,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:32,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:32,483 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-19 10:53:32,483 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:32,483 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:53:32,483 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-19 10:53:32,484 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:53:32,487 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:32,487 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-19 10:53:32,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:32,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:32,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:32,487 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:53:32,487 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-19 10:53:32,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:32,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:32,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:32,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:32,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:32,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:32,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:32,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:53:32,491 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-19 10:53:32,491 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-19 10:53:32,491 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:53:32,491 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:53:32,491 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:32,491 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:53:32,493 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:32,493 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:32,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:32,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:32,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:32,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:32,493 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:53:32,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:32,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:53:32,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:32,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:53:32,494 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:32,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:32,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:32,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:32,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:32,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:32,496 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:32,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:32,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:32,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:32,499 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:32,499 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:32,499 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:32,500 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:32,500 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:32,500 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:53:32,500 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:32,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:53:32,500 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:53:32,500 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:53:32,500 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-19 10:53:32,500 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:53:32,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:53:32,500 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:32,501 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-19 10:53:32,501 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:53:32,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:53:32,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:53:32,601 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:53:32,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:53:32,611 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:53:32,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-19 10:53:32,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:32,613 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-19 10:53:32,613 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:53:32,614 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-19 10:53:32,614 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-19 10:53:32,614 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:32,614 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:32,616 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:53:32,616 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:32,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:53:32,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:53:32,616 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:32,617 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:53:32,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:32,617 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:32,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:53:32,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:32,618 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:32,618 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-19 10:53:32,618 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:32,618 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-19 10:53:32,618 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:53:32,618 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-19 10:53:32,619 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-19 10:53:32,619 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:53:32,619 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa. 2023-11-19 10:53:32,619 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa. started... 2023-11-19 10:53:32,619 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f2cb6679d87b843f3747aea4a88ed8aa 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-19 10:53:33,039 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010359ab5bde663f417ca8965976dfc6bae9 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010359ab5bde663f417ca8965976dfc6bae9 2023-11-19 10:53:33,448 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/.tmp/family1/feb9e8d9a9e94abc8f2e8fd19e1f2c00 2023-11-19 10:53:33,457 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/.tmp/family1/feb9e8d9a9e94abc8f2e8fd19e1f2c00 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/feb9e8d9a9e94abc8f2e8fd19e1f2c00 2023-11-19 10:53:33,465 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/feb9e8d9a9e94abc8f2e8fd19e1f2c00, entries=1, sequenceid=33, filesize=5.0 K 2023-11-19 10:53:33,467 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f2cb6679d87b843f3747aea4a88ed8aa in 848ms, sequenceid=33, compaction requested=true 2023-11-19 10:53:33,467 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f2cb6679d87b843f3747aea4a88ed8aa: 2023-11-19 10:53:33,467 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa. 2023-11-19 10:53:33,467 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-19 10:53:33,467 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-19 10:53:33,468 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:33,468 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-19 10:53:33,468 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-19 10:53:33,472 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:33,472 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:33,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:33,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:33,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:33,475 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:33,475 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:53:33,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:33,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:33,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:33,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:33,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:33,506 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-19 10:53:33,506 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4f4b99cd[Count = 0] remaining members to acquire global barrier 2023-11-19 10:53:33,506 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-19 10:53:33,506 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:33,509 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:33,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:33,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:33,509 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-19 10:53:33,509 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-19 10:53:33,509 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:53:33,509 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:33,509 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:53:33,511 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-19 10:53:33,511 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:33,511 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:53:33,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:33,511 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-19 10:53:33,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:33,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:33,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:33,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:33,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:33,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:33,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:33,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:33,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:33,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:53:33,515 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-19 10:53:33,515 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-19 10:53:33,515 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:53:33,515 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:53:33,515 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:33,515 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:53:33,517 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:33,517 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:53:33,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:33,517 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:33,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:33,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:33,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:33,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:33,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:53:33,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:53:33,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:33,518 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:33,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:33,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:33,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:33,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:33,520 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:33,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:33,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:33,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:33,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:33,524 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:33,524 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:53:33,524 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:33,524 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:53:33,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:53:33,524 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:33,525 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-19 10:53:33,525 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:53:33,525 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:33,524 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:53:33,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:53:33,525 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:33,525 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-19 10:53:33,525 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:33,525 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:33,525 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-19 10:53:33,526 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:53:33,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:53:33,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:53:33,626 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:53:33,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:53:33,634 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:53:33,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-19 10:53:33,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:33,637 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-19 10:53:33,637 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:53:33,638 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-19 10:53:33,638 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-19 10:53:33,638 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:33,638 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:33,640 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:53:33,640 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:33,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:53:33,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:53:33,640 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:33,640 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:53:33,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:33,641 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:33,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:53:33,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:33,641 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:33,641 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-19 10:53:33,641 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:33,641 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-19 10:53:33,641 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:53:33,642 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-19 10:53:33,642 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-19 10:53:33,642 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:53:33,642 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa. 2023-11-19 10:53:33,642 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa. started... 2023-11-19 10:53:33,642 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f2cb6679d87b843f3747aea4a88ed8aa 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-19 10:53:34,063 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509070991d8c4103a41df8b861c60b2aee4bc to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201509070991d8c4103a41df8b861c60b2aee4bc 2023-11-19 10:53:34,077 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/.tmp/family1/f075670d17c542dbb40a3c7fa6ed1c4c 2023-11-19 10:53:34,085 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/.tmp/family1/f075670d17c542dbb40a3c7fa6ed1c4c as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/f075670d17c542dbb40a3c7fa6ed1c4c 2023-11-19 10:53:34,092 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/f075670d17c542dbb40a3c7fa6ed1c4c, entries=1, sequenceid=37, filesize=5.0 K 2023-11-19 10:53:34,094 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f2cb6679d87b843f3747aea4a88ed8aa in 452ms, sequenceid=37, compaction requested=true 2023-11-19 10:53:34,094 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f2cb6679d87b843f3747aea4a88ed8aa: 2023-11-19 10:53:34,094 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa. 2023-11-19 10:53:34,094 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-19 10:53:34,094 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-19 10:53:34,094 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:34,094 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-19 10:53:34,094 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-19 10:53:34,096 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:34,096 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:34,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:34,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:34,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:34,097 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:34,097 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:53:34,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:34,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:34,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:34,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:34,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:34,101 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-19 10:53:34,101 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6659eba1[Count = 0] remaining members to acquire global barrier 2023-11-19 10:53:34,101 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-19 10:53:34,101 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:34,103 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:34,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:34,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:34,103 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-19 10:53:34,103 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-19 10:53:34,103 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:53:34,104 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:34,104 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:53:34,106 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-19 10:53:34,106 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:34,106 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:53:34,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:34,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:34,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:34,106 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-19 10:53:34,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:34,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:34,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:34,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:34,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:34,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:34,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:34,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:53:34,115 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-19 10:53:34,115 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-19 10:53:34,116 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:53:34,116 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:53:34,116 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:34,116 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:53:34,120 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:34,120 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:34,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:34,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:34,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:34,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:34,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:34,120 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:53:34,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:53:34,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:53:34,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:34,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:34,122 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:34,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:34,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:34,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:34,126 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:34,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:34,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:34,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:34,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:34,132 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:34,132 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:34,133 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:53:34,133 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:34,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:53:34,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:53:34,133 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:53:34,133 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:34,133 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:34,133 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:34,133 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-19 10:53:34,133 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:53:34,133 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:34,133 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:53:34,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:53:34,134 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-19 10:53:34,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:53:34,134 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-19 10:53:34,134 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:53:34,234 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:53:34,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:53:34,244 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:53:34,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-19 10:53:34,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:34,246 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-19 10:53:34,246 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:53:34,247 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-19 10:53:34,247 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-19 10:53:34,248 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:34,248 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:34,251 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:53:34,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:53:34,251 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:34,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:53:34,251 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:34,251 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:53:34,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:34,252 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:34,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:53:34,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:34,253 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:34,253 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-19 10:53:34,253 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:34,253 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-19 10:53:34,253 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:53:34,254 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-19 10:53:34,254 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-19 10:53:34,254 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:53:34,254 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa. 2023-11-19 10:53:34,255 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa. started... 2023-11-19 10:53:34,255 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f2cb6679d87b843f3747aea4a88ed8aa 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-19 10:53:34,274 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112082998ec0e227411396ec62d094552cd1 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112082998ec0e227411396ec62d094552cd1 2023-11-19 10:53:34,282 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/.tmp/family1/ea268a136dee463691f6fd5e7b3e3c17 2023-11-19 10:53:34,288 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/.tmp/family1/ea268a136dee463691f6fd5e7b3e3c17 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/ea268a136dee463691f6fd5e7b3e3c17 2023-11-19 10:53:34,294 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/ea268a136dee463691f6fd5e7b3e3c17, entries=1, sequenceid=41, filesize=5.0 K 2023-11-19 10:53:34,295 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f2cb6679d87b843f3747aea4a88ed8aa in 40ms, sequenceid=41, compaction requested=true 2023-11-19 10:53:34,295 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f2cb6679d87b843f3747aea4a88ed8aa: 2023-11-19 10:53:34,296 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa. 2023-11-19 10:53:34,296 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-19 10:53:34,296 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-19 10:53:34,296 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:34,296 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-19 10:53:34,296 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-19 10:53:34,298 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:34,298 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:34,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:34,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:34,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:34,299 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:34,299 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:53:34,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:34,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:34,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:34,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:34,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:34,300 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-19 10:53:34,300 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@12355771[Count = 0] remaining members to acquire global barrier 2023-11-19 10:53:34,300 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-19 10:53:34,301 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:34,302 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:34,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:34,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:34,302 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-19 10:53:34,302 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-19 10:53:34,302 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:53:34,302 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:34,302 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:53:34,304 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:34,304 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-19 10:53:34,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:34,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:34,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:34,304 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:53:34,304 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-19 10:53:34,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:34,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:34,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:34,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:34,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:34,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:34,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:34,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:53:34,307 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-19 10:53:34,307 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-19 10:53:34,307 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:53:34,307 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:53:34,307 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:34,307 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:53:34,310 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:34,310 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:34,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:34,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:34,310 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:53:34,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:34,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:34,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:34,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:53:34,312 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:34,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:34,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:53:34,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:34,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:34,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:34,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:34,314 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:34,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:34,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:34,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:34,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:34,317 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:53:34,317 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:34,317 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:53:34,317 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:53:34,317 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:34,317 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-19 10:53:34,317 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:53:34,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:53:34,317 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:53:34,317 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:34,318 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:34,318 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:34,318 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:34,318 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:34,318 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-19 10:53:34,318 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-19 10:53:34,318 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:53:34,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:53:34,318 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:53:34,418 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:53:34,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:53:34,424 DEBUG [Listener at localhost/42675] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-11-19 10:53:34,427 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37570, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-11-19 10:53:34,428 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=33457] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:34,441 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-19 10:53:34,442 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-19 10:53:34,444 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-19 10:53:34,444 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=12, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700391814444 2023-11-19 10:53:34,445 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-19 10:53:34,449 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-11-19 10:53:34,449 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-19 10:53:34,450 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] zookeeper.ReadOnlyZKClient(139): Connect 0x289eafe1 to 127.0.0.1:60497 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-19 10:53:34,454 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@216b4046, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-19 10:53:34,455 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-19 10:53:34,930 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103616acfe6e3f04e63aeed85b851ac8827 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103616acfe6e3f04e63aeed85b851ac8827 2023-11-19 10:53:34,931 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-19 10:53:34,949 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-19 10:53:34,951 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40760, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-19 10:53:34,961 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-19 10:53:34,962 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37580, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-19 10:53:34,997 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/e86c989809134d719e7b935d890ae241 first=Optional[r3] last=Optional[r6] 2023-11-19 10:53:35,009 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa., hostname=jenkins-hbase4.apache.org,46035,1700391201579, seqNum=2 for row with hfile group [{family1,hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/e86c989809134d719e7b935d890ae241}] 2023-11-19 10:53:35,025 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(763): Validating hfile at hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/e86c989809134d719e7b935d890ae241 for inclusion in f2cb6679d87b843f3747aea4a88ed8aa/family1 2023-11-19 10:53:35,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-19 10:53:35,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(777): Region bounds: first= last= 2023-11-19 10:53:35,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegion(2446): Flush status journal for f2cb6679d87b843f3747aea4a88ed8aa: 2023-11-19 10:53:35,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/e86c989809134d719e7b935d890ae241 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__u1jl578icfd633jjo0eemm6pt8inqs15qqupcrnra9jvqv74p1ol8d3715r9bop0/family1/e86c989809134d719e7b935d890ae241 2023-11-19 10:53:35,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__u1jl578icfd633jjo0eemm6pt8inqs15qqupcrnra9jvqv74p1ol8d3715r9bop0/family1/e86c989809134d719e7b935d890ae241 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/2f718b66d77b43a4b3a89a9f77f305de_SeqId_44_ 2023-11-19 10:53:35,037 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(849): Loaded HFile hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__u1jl578icfd633jjo0eemm6pt8inqs15qqupcrnra9jvqv74p1ol8d3715r9bop0/family1/e86c989809134d719e7b935d890ae241 into f2cb6679d87b843f3747aea4a88ed8aa/family1 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/2f718b66d77b43a4b3a89a9f77f305de_SeqId_44_ - updating store file list. 2023-11-19 10:53:35,043 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(882): Loaded HFile hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/2f718b66d77b43a4b3a89a9f77f305de_SeqId_44_ into f2cb6679d87b843f3747aea4a88ed8aa/family1 2023-11-19 10:53:35,044 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(855): Successfully loaded hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__u1jl578icfd633jjo0eemm6pt8inqs15qqupcrnra9jvqv74p1ol8d3715r9bop0/family1/e86c989809134d719e7b935d890ae241 into f2cb6679d87b843f3747aea4a88ed8aa/family1 (new location: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/2f718b66d77b43a4b3a89a9f77f305de_SeqId_44_) 2023-11-19 10:53:35,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__u1jl578icfd633jjo0eemm6pt8inqs15qqupcrnra9jvqv74p1ol8d3715r9bop0/family1/e86c989809134d719e7b935d890ae241 2023-11-19 10:53:35,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-19 10:53:35,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51357 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-19 10:53:35,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(1912): f2cb6679d87b843f3747aea4a88ed8aa/family1 is initiating minor compaction 2023-11-19 10:53:35,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@437271ba; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-19 10:53:35,055 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of f2cb6679d87b843f3747aea4a88ed8aa/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa. 2023-11-19 10:53:35,056 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/921b5dd23ee847dba50fcb15bdf85728, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/d018b11aea1e40ef8e04d1a6b4f3ff44, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/f2900868becb4335a8ae461c980b14ff, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/944acab6f442488093c9fae67128ee49, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/4761f35c03e446afbb9ed51742cc2047, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/fede17dc7d5945e096b5413233b65382, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/feb9e8d9a9e94abc8f2e8fd19e1f2c00, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/f075670d17c542dbb40a3c7fa6ed1c4c, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/ea268a136dee463691f6fd5e7b3e3c17, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/2f718b66d77b43a4b3a89a9f77f305de_SeqId_44_] into tmpdir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/.tmp, totalSize=50.2 K 2023-11-19 10:53:35,057 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting 921b5dd23ee847dba50fcb15bdf85728, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-19 10:53:35,057 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting d018b11aea1e40ef8e04d1a6b4f3ff44, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-19 10:53:35,057 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting f2900868becb4335a8ae461c980b14ff, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-19 10:53:35,057 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting 944acab6f442488093c9fae67128ee49, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-19 10:53:35,057 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting 4761f35c03e446afbb9ed51742cc2047, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-19 10:53:35,057 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting fede17dc7d5945e096b5413233b65382, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-19 10:53:35,057 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting feb9e8d9a9e94abc8f2e8fd19e1f2c00, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-19 10:53:35,057 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting f075670d17c542dbb40a3c7fa6ed1c4c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-19 10:53:35,057 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting ea268a136dee463691f6fd5e7b3e3c17, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-19 10:53:35,057 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting 2f718b66d77b43a4b3a89a9f77f305de_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-19 10:53:35,071 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-19 10:53:35,073 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:53:35,079 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228d4cea6cde1dd4dda9fbe0bb3edfb3d72 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228d4cea6cde1dd4dda9fbe0bb3edfb3d72 2023-11-19 10:53:35,080 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512312aa67e03247e483f8c050ae5a45481f3 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512312aa67e03247e483f8c050ae5a45481f3 2023-11-19 10:53:35,082 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101ecdc89f5f2b145c894b34a97c9eb63cf to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101ecdc89f5f2b145c894b34a97c9eb63cf 2023-11-19 10:53:35,084 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010359ab5bde663f417ca8965976dfc6bae9 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010359ab5bde663f417ca8965976dfc6bae9 2023-11-19 10:53:35,085 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 4 expired mob files are deleted 2023-11-19 10:53:35,085 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-19 10:53:35,085 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-19 10:53:35,085 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-19 10:53:35,085 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-19 10:53:35,085 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-19 10:53:35,086 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-19 10:53:35,086 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-19 10:53:35,086 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-19 10:53:35,086 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-19 10:53:35,113 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] throttle.PressureAwareThroughputController(145): f2cb6679d87b843f3747aea4a88ed8aa#family1#compaction#10 average throughput is 0.29 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-19 10:53:35,541 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/.tmp/family1/5d6622e20f5a43cd884ea4ae6744e837 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/5d6622e20f5a43cd884ea4ae6744e837 2023-11-19 10:53:35,556 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in f2cb6679d87b843f3747aea4a88ed8aa/family1 of f2cb6679d87b843f3747aea4a88ed8aa into 5d6622e20f5a43cd884ea4ae6744e837(size=6.6 K), total size for store is 182.5 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-19 10:53:35,556 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for f2cb6679d87b843f3747aea4a88ed8aa: 2023-11-19 10:53:35,558 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa., storeName=family1, fileCount=10, fileSize=50.2 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.5 K), priority=2, time=1700391215053; duration=0sec 2023-11-19 10:53:35,558 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-19 10:53:35,639 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/921b5dd23ee847dba50fcb15bdf85728, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/d018b11aea1e40ef8e04d1a6b4f3ff44, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/f2900868becb4335a8ae461c980b14ff, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/944acab6f442488093c9fae67128ee49, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/4761f35c03e446afbb9ed51742cc2047, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/fede17dc7d5945e096b5413233b65382, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/feb9e8d9a9e94abc8f2e8fd19e1f2c00, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/f075670d17c542dbb40a3c7fa6ed1c4c, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/ea268a136dee463691f6fd5e7b3e3c17, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/2f718b66d77b43a4b3a89a9f77f305de_SeqId_44_] to archive 2023-11-19 10:53:35,640 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:53:35,642 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/921b5dd23ee847dba50fcb15bdf85728 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/921b5dd23ee847dba50fcb15bdf85728 2023-11-19 10:53:35,644 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/d018b11aea1e40ef8e04d1a6b4f3ff44 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/d018b11aea1e40ef8e04d1a6b4f3ff44 2023-11-19 10:53:35,645 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/f2900868becb4335a8ae461c980b14ff to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/f2900868becb4335a8ae461c980b14ff 2023-11-19 10:53:35,647 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/944acab6f442488093c9fae67128ee49 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/944acab6f442488093c9fae67128ee49 2023-11-19 10:53:35,648 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/4761f35c03e446afbb9ed51742cc2047 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/4761f35c03e446afbb9ed51742cc2047 2023-11-19 10:53:35,650 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/fede17dc7d5945e096b5413233b65382 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/fede17dc7d5945e096b5413233b65382 2023-11-19 10:53:35,652 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/feb9e8d9a9e94abc8f2e8fd19e1f2c00 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/feb9e8d9a9e94abc8f2e8fd19e1f2c00 2023-11-19 10:53:35,653 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/f075670d17c542dbb40a3c7fa6ed1c4c to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/f075670d17c542dbb40a3c7fa6ed1c4c 2023-11-19 10:53:35,655 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/ea268a136dee463691f6fd5e7b3e3c17 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/ea268a136dee463691f6fd5e7b3e3c17 2023-11-19 10:53:35,657 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/2f718b66d77b43a4b3a89a9f77f305de_SeqId_44_ to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/2f718b66d77b43a4b3a89a9f77f305de_SeqId_44_ 2023-11-19 10:53:35,981 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512055b300f26529e4cc89d50969928a915ac to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512055b300f26529e4cc89d50969928a915ac 2023-11-19 10:53:35,982 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-19 10:53:36,012 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/98050aaff83d461eb7986ea6220f44e4 first=Optional[r00] last=Optional[r2] 2023-11-19 10:53:36,013 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa., hostname=jenkins-hbase4.apache.org,46035,1700391201579, seqNum=2 for row with hfile group [{family1,hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/98050aaff83d461eb7986ea6220f44e4}] 2023-11-19 10:53:36,016 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(763): Validating hfile at hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/98050aaff83d461eb7986ea6220f44e4 for inclusion in f2cb6679d87b843f3747aea4a88ed8aa/family1 2023-11-19 10:53:36,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-19 10:53:36,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(777): Region bounds: first= last= 2023-11-19 10:53:36,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegion(2446): Flush status journal for f2cb6679d87b843f3747aea4a88ed8aa: 2023-11-19 10:53:36,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/98050aaff83d461eb7986ea6220f44e4 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__rm4hr5t3o8jiaiadvmeree13ptq7mih93l71auc2d24g6nvufofp3rl47qv3gggo/family1/98050aaff83d461eb7986ea6220f44e4 2023-11-19 10:53:36,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__rm4hr5t3o8jiaiadvmeree13ptq7mih93l71auc2d24g6nvufofp3rl47qv3gggo/family1/98050aaff83d461eb7986ea6220f44e4 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/6b6520e0948049be861264b0abdeaf50_SeqId_47_ 2023-11-19 10:53:36,025 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(849): Loaded HFile hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__rm4hr5t3o8jiaiadvmeree13ptq7mih93l71auc2d24g6nvufofp3rl47qv3gggo/family1/98050aaff83d461eb7986ea6220f44e4 into f2cb6679d87b843f3747aea4a88ed8aa/family1 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/6b6520e0948049be861264b0abdeaf50_SeqId_47_ - updating store file list. 2023-11-19 10:53:36,031 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(882): Loaded HFile hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/6b6520e0948049be861264b0abdeaf50_SeqId_47_ into f2cb6679d87b843f3747aea4a88ed8aa/family1 2023-11-19 10:53:36,031 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(855): Successfully loaded hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__rm4hr5t3o8jiaiadvmeree13ptq7mih93l71auc2d24g6nvufofp3rl47qv3gggo/family1/98050aaff83d461eb7986ea6220f44e4 into f2cb6679d87b843f3747aea4a88ed8aa/family1 (new location: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/6b6520e0948049be861264b0abdeaf50_SeqId_47_) 2023-11-19 10:53:36,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__rm4hr5t3o8jiaiadvmeree13ptq7mih93l71auc2d24g6nvufofp3rl47qv3gggo/family1/98050aaff83d461eb7986ea6220f44e4 2023-11-19 10:53:36,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-19 10:53:36,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 367249 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-19 10:53:36,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(1912): f2cb6679d87b843f3747aea4a88ed8aa/family1 is initiating minor compaction (all files) 2023-11-19 10:53:36,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@6c3bd058; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-19 10:53:36,033 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of f2cb6679d87b843f3747aea4a88ed8aa/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa. 2023-11-19 10:53:36,034 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/d4d408ddc25e4d2984a59910d8048e6e, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/5d6622e20f5a43cd884ea4ae6744e837, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/6b6520e0948049be861264b0abdeaf50_SeqId_47_] into tmpdir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/.tmp, totalSize=358.6 K 2023-11-19 10:53:36,034 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting d4d408ddc25e4d2984a59910d8048e6e, keycount=1000, bloomtype=ROW, size=175.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878825094 2023-11-19 10:53:36,035 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting 5d6622e20f5a43cd884ea4ae6744e837, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621225094 2023-11-19 10:53:36,036 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting 6b6520e0948049be861264b0abdeaf50_SeqId_47_, keycount=1002, bloomtype=ROW, size=176.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878825094 2023-11-19 10:53:36,036 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-19 10:53:36,038 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:53:36,040 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511307ee7c1972e6044f08bcef638afa2f548 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511307ee7c1972e6044f08bcef638afa2f548 2023-11-19 10:53:36,042 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512014bba957bf729455b94f10b928788e386 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512014bba957bf729455b94f10b928788e386 2023-11-19 10:53:36,044 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205a85fd2303e6a4ace81c91090be77140e to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205a85fd2303e6a4ace81c91090be77140e 2023-11-19 10:53:36,044 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 3 expired mob files are deleted 2023-11-19 10:53:36,044 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-19 10:53:36,045 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-19 10:53:36,045 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-19 10:53:36,045 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-19 10:53:36,046 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=12, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-19 10:53:36,049 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 1.6130 sec 2023-11-19 10:53:36,076 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] throttle.PressureAwareThroughputController(145): f2cb6679d87b843f3747aea4a88ed8aa#family1#compaction#11 average throughput is 6.61 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-19 10:53:36,218 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthly from 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-19 10:53:36,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure2.ProcedureExecutor(1028): Stored pid=13, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:36,248 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-11-19 10:53:36,255 DEBUG [PEWorker-2] util.FSTableDescriptors(519): Deleted hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-11-19 10:53:36,255 INFO [PEWorker-2] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-11-19 10:53:36,262 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly}] 2023-11-19 10:53:36,283 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=f2cb6679d87b843f3747aea4a88ed8aa, REOPEN/MOVE}] 2023-11-19 10:53:36,285 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=f2cb6679d87b843f3747aea4a88ed8aa, REOPEN/MOVE 2023-11-19 10:53:36,287 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=f2cb6679d87b843f3747aea4a88ed8aa, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:36,287 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1700391216286"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700391216286"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700391216286"}]},"ts":"1700391216286"} 2023-11-19 10:53:36,290 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE; CloseRegionProcedure f2cb6679d87b843f3747aea4a88ed8aa, server=jenkins-hbase4.apache.org,46035,1700391201579}] 2023-11-19 10:53:36,450 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:36,458 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f2cb6679d87b843f3747aea4a88ed8aa 2023-11-19 10:53:36,458 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f2cb6679d87b843f3747aea4a88ed8aa, disabling compactions & flushes 2023-11-19 10:53:36,458 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa. 2023-11-19 10:53:37,310 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/.tmp/family1/a49ecef9d2894bb4a541aa9e304790e5 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/a49ecef9d2894bb4a541aa9e304790e5 2023-11-19 10:53:37,318 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in f2cb6679d87b843f3747aea4a88ed8aa/family1 of f2cb6679d87b843f3747aea4a88ed8aa into a49ecef9d2894bb4a541aa9e304790e5(size=177.2 K), total size for store is 177.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-19 10:53:37,318 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for f2cb6679d87b843f3747aea4a88ed8aa: 2023-11-19 10:53:37,318 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa. 2023-11-19 10:53:37,320 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa. 2023-11-19 10:53:37,320 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa. after waiting 0 ms 2023-11-19 10:53:37,320 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa. 2023-11-19 10:53:37,320 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa., storeName=family1, fileCount=3, fileSize=358.6 K (175.8 K, 6.6 K, 176.2 K), priority=2, time=1700391216033; duration=1sec 2023-11-19 10:53:37,320 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-19 10:53:37,323 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/d4d408ddc25e4d2984a59910d8048e6e, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/5d6622e20f5a43cd884ea4ae6744e837, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/6b6520e0948049be861264b0abdeaf50_SeqId_47_] to archive 2023-11-19 10:53:37,324 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:53:37,326 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/d4d408ddc25e4d2984a59910d8048e6e to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/d4d408ddc25e4d2984a59910d8048e6e 2023-11-19 10:53:37,328 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/5d6622e20f5a43cd884ea4ae6744e837 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/5d6622e20f5a43cd884ea4ae6744e837 2023-11-19 10:53:37,329 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/6b6520e0948049be861264b0abdeaf50_SeqId_47_ to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/6b6520e0948049be861264b0abdeaf50_SeqId_47_ 2023-11-19 10:53:37,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-19 10:53:37,338 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa. 2023-11-19 10:53:37,338 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f2cb6679d87b843f3747aea4a88ed8aa: 2023-11-19 10:53:37,338 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3510): Not adding moved region record: f2cb6679d87b843f3747aea4a88ed8aa to self. 2023-11-19 10:53:37,340 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f2cb6679d87b843f3747aea4a88ed8aa 2023-11-19 10:53:37,340 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=f2cb6679d87b843f3747aea4a88ed8aa, regionState=CLOSED 2023-11-19 10:53:37,341 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1700391217340"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700391217340"}]},"ts":"1700391217340"} 2023-11-19 10:53:37,344 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=15 2023-11-19 10:53:37,344 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=15, state=SUCCESS; CloseRegionProcedure f2cb6679d87b843f3747aea4a88ed8aa, server=jenkins-hbase4.apache.org,46035,1700391201579 in 1.0520 sec 2023-11-19 10:53:37,345 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=f2cb6679d87b843f3747aea4a88ed8aa, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,46035,1700391201579; forceNewPlan=false, retain=true 2023-11-19 10:53:37,496 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=f2cb6679d87b843f3747aea4a88ed8aa, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:37,496 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1700391217496"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700391217496"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700391217496"}]},"ts":"1700391217496"} 2023-11-19 10:53:37,499 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=17, ppid=15, state=RUNNABLE; OpenRegionProcedure f2cb6679d87b843f3747aea4a88ed8aa, server=jenkins-hbase4.apache.org,46035,1700391201579}] 2023-11-19 10:53:37,652 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:37,656 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa. 2023-11-19 10:53:37,656 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f2cb6679d87b843f3747aea4a88ed8aa, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa.', STARTKEY => '', ENDKEY => ''} 2023-11-19 10:53:37,656 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly f2cb6679d87b843f3747aea4a88ed8aa 2023-11-19 10:53:37,656 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-19 10:53:37,656 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f2cb6679d87b843f3747aea4a88ed8aa 2023-11-19 10:53:37,657 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f2cb6679d87b843f3747aea4a88ed8aa 2023-11-19 10:53:37,658 INFO [StoreOpener-f2cb6679d87b843f3747aea4a88ed8aa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region f2cb6679d87b843f3747aea4a88ed8aa 2023-11-19 10:53:37,659 DEBUG [StoreOpener-f2cb6679d87b843f3747aea4a88ed8aa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1 2023-11-19 10:53:37,659 DEBUG [StoreOpener-f2cb6679d87b843f3747aea4a88ed8aa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1 2023-11-19 10:53:37,660 INFO [StoreOpener-f2cb6679d87b843f3747aea4a88ed8aa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f2cb6679d87b843f3747aea4a88ed8aa columnFamilyName family1 2023-11-19 10:53:37,667 DEBUG [StoreOpener-f2cb6679d87b843f3747aea4a88ed8aa-1] regionserver.HStore(539): loaded hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/a49ecef9d2894bb4a541aa9e304790e5 2023-11-19 10:53:37,667 INFO [StoreOpener-f2cb6679d87b843f3747aea4a88ed8aa-1] regionserver.HStore(310): Store=f2cb6679d87b843f3747aea4a88ed8aa/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-19 10:53:37,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa 2023-11-19 10:53:37,670 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa 2023-11-19 10:53:37,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f2cb6679d87b843f3747aea4a88ed8aa 2023-11-19 10:53:37,674 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f2cb6679d87b843f3747aea4a88ed8aa; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64651809, jitterRate=-0.03661297261714935}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-19 10:53:37,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f2cb6679d87b843f3747aea4a88ed8aa: 2023-11-19 10:53:37,675 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa., pid=17, masterSystemTime=1700391217652 2023-11-19 10:53:37,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa. 2023-11-19 10:53:37,677 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa. 2023-11-19 10:53:37,678 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=f2cb6679d87b843f3747aea4a88ed8aa, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:37,678 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1700391217677"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700391217677"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700391217677"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700391217677"}]},"ts":"1700391217677"} 2023-11-19 10:53:37,682 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=17, resume processing ppid=15 2023-11-19 10:53:37,682 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=17, ppid=15, state=SUCCESS; OpenRegionProcedure f2cb6679d87b843f3747aea4a88ed8aa, server=jenkins-hbase4.apache.org,46035,1700391201579 in 181 msec 2023-11-19 10:53:37,684 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=14 2023-11-19 10:53:37,684 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=14, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=f2cb6679d87b843f3747aea4a88ed8aa, REOPEN/MOVE in 1.3990 sec 2023-11-19 10:53:37,687 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=14, resume processing ppid=13 2023-11-19 10:53:37,687 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=13, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 1.4250 sec 2023-11-19 10:53:37,690 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=13, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 1.4680 sec 2023-11-19 10:53:37,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=13 2023-11-19 10:53:37,700 INFO [Listener at localhost/42675] compactions.TestMobCompactor(278): alter status finished 2023-11-19 10:53:37,701 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=33457] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-19 10:53:37,703 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-19 10:53:37,703 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-19 10:53:37,704 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-19 10:53:37,704 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700391817704 2023-11-19 10:53:37,705 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-19 10:53:37,706 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-11-19 10:53:37,706 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-19 10:53:37,707 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] zookeeper.ReadOnlyZKClient(139): Connect 0x1dbc392a to 127.0.0.1:60497 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-19 10:53:37,791 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1cc85331, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-19 10:53:37,792 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-19 10:53:37,792 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-19 10:53:37,792 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-19 10:53:37,792 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-19 10:53:37,792 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-19 10:53:38,229 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112821786861732a47cba647a68fa057f252 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112821786861732a47cba647a68fa057f252 2023-11-19 10:53:38,230 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-19 10:53:38,243 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-19 10:53:38,244 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40764, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-19 10:53:38,252 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-19 10:53:38,253 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37592, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-19 10:53:38,264 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/4ebbc6f92ab64e2ab3751415e8bc03bf first=Optional[r05] last=Optional[r8] 2023-11-19 10:53:38,265 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa., hostname=jenkins-hbase4.apache.org,46035,1700391201579, seqNum=51 for row with hfile group [{family1,hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/4ebbc6f92ab64e2ab3751415e8bc03bf}] 2023-11-19 10:53:38,269 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(763): Validating hfile at hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/4ebbc6f92ab64e2ab3751415e8bc03bf for inclusion in f2cb6679d87b843f3747aea4a88ed8aa/family1 2023-11-19 10:53:38,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-11-19 10:53:38,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(777): Region bounds: first= last= 2023-11-19 10:53:38,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegion(2446): Flush status journal for f2cb6679d87b843f3747aea4a88ed8aa: 2023-11-19 10:53:38,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/4ebbc6f92ab64e2ab3751415e8bc03bf to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__kkt3g5v84go5orlpkvtslrishmtbdutt5lfba1usa4orcq6onvbb5po00u1ob4fn/family1/4ebbc6f92ab64e2ab3751415e8bc03bf 2023-11-19 10:53:38,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__kkt3g5v84go5orlpkvtslrishmtbdutt5lfba1usa4orcq6onvbb5po00u1ob4fn/family1/4ebbc6f92ab64e2ab3751415e8bc03bf as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/ffc3db6300f44c95bdcc457fc41fc184_SeqId_53_ 2023-11-19 10:53:38,277 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(849): Loaded HFile hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__kkt3g5v84go5orlpkvtslrishmtbdutt5lfba1usa4orcq6onvbb5po00u1ob4fn/family1/4ebbc6f92ab64e2ab3751415e8bc03bf into f2cb6679d87b843f3747aea4a88ed8aa/family1 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/ffc3db6300f44c95bdcc457fc41fc184_SeqId_53_ - updating store file list. 2023-11-19 10:53:38,282 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(882): Loaded HFile hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/ffc3db6300f44c95bdcc457fc41fc184_SeqId_53_ into f2cb6679d87b843f3747aea4a88ed8aa/family1 2023-11-19 10:53:38,282 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(855): Successfully loaded hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__kkt3g5v84go5orlpkvtslrishmtbdutt5lfba1usa4orcq6onvbb5po00u1ob4fn/family1/4ebbc6f92ab64e2ab3751415e8bc03bf into f2cb6679d87b843f3747aea4a88ed8aa/family1 (new location: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/family1/ffc3db6300f44c95bdcc457fc41fc184_SeqId_53_) 2023-11-19 10:53:38,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__kkt3g5v84go5orlpkvtslrishmtbdutt5lfba1usa4orcq6onvbb5po00u1ob4fn/family1/4ebbc6f92ab64e2ab3751415e8bc03bf 2023-11-19 10:53:38,285 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-19 10:53:38,286 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:53:38,288 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112082998ec0e227411396ec62d094552cd1 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112082998ec0e227411396ec62d094552cd1 2023-11-19 10:53:38,289 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511287ab9a22bb1094ad2970fa52c2574adcb to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511287ab9a22bb1094ad2970fa52c2574adcb 2023-11-19 10:53:38,289 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 2 expired mob files are deleted 2023-11-19 10:53:38,289 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-19 10:53:38,290 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-19 10:53:38,290 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-19 10:53:38,290 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-19 10:53:38,290 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-19 10:53:38,290 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-19 10:53:38,291 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-19 10:53:38,292 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 589 msec 2023-11-19 10:53:38,383 INFO [Listener at localhost/42675] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=251 (was 213) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_348511746_17 at /127.0.0.1:54884 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1b764fd8-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:60497@0x289eafe1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$88/586051327.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_348511746_17 at /127.0.0.1:55078 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:60497@0x1dbc392a sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$88/586051327.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_348511746_17 at /127.0.0.1:54986 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_348511746_17 at /127.0.0.1:55046 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_348511746_17 at /127.0.0.1:54990 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xb17fc05-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_348511746_17 at /127.0.0.1:54848 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:60497@0x1dbc392a-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:549) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_348511746_17 at /127.0.0.1:54942 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-434764726_17 at /127.0.0.1:55026 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:316) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:373) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1b764fd8-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_348511746_17 at /127.0.0.1:54982 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RSProcedureDispatcher-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/404937f1-f8cc-7c23-e42f-3dd0b22b5057/cluster_0d30b9ac-b1ea-f838-523d-c3632a7c9c3a/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xb17fc05-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:60497@0x289eafe1-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:549) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_348511746_17 at /127.0.0.1:55006 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:60497@0x289eafe1-SendThread(127.0.0.1:60497) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:332) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1289) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_348511746_17 at /127.0.0.1:55002 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_348511746_17 at /127.0.0.1:55030 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_348511746_17 at /127.0.0.1:54822 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobCompactor-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_348511746_17 at /127.0.0.1:54958 [Waiting for operation #22] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_348511746_17 at /127.0.0.1:38056 [Waiting for operation #16] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_348511746_17 at /127.0.0.1:55018 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xb17fc05-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS:0;jenkins-hbase4:46035-shortCompactions-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:549) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:60497@0x1dbc392a-SendThread(127.0.0.1:60497) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:332) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1289) - Thread LEAK? -, OpenFileDescriptor=626 (was 505) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=248 (was 284), ProcessCount=172 (was 170) - ProcessCount LEAK? -, AvailableMemoryMB=15867 (was 16241) 2023-11-19 10:53:38,398 INFO [Listener at localhost/42675] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=251, OpenFileDescriptor=626, MaxFileDescriptor=60000, SystemLoadAverage=248, ProcessCount=172, AvailableMemoryMB=15866 2023-11-19 10:53:38,400 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-19 10:53:38,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:38,404 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-19 10:53:38,404 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithMonthlyPolicy" procId is: 19 2023-11-19 10:53:38,405 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-19 10:53:38,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-19 10:53:38,408 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e 2023-11-19 10:53:38,409 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e empty. 2023-11-19 10:53:38,409 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e 2023-11-19 10:53:38,410 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithMonthlyPolicy regions 2023-11-19 10:53:38,420 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-19 10:53:38,422 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => f1630f7551bce81ee7e30ea665d7671e, NAME => 'testMajorCompactionWithMonthlyPolicy,,1700391218400.f1630f7551bce81ee7e30ea665d7671e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp 2023-11-19 10:53:38,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-19 10:53:38,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-19 10:53:38,841 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1700391218400.f1630f7551bce81ee7e30ea665d7671e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-19 10:53:38,841 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing f1630f7551bce81ee7e30ea665d7671e, disabling compactions & flushes 2023-11-19 10:53:38,841 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1700391218400.f1630f7551bce81ee7e30ea665d7671e. 2023-11-19 10:53:38,841 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1700391218400.f1630f7551bce81ee7e30ea665d7671e. 2023-11-19 10:53:38,841 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1700391218400.f1630f7551bce81ee7e30ea665d7671e. after waiting 0 ms 2023-11-19 10:53:38,841 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1700391218400.f1630f7551bce81ee7e30ea665d7671e. 2023-11-19 10:53:38,841 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1700391218400.f1630f7551bce81ee7e30ea665d7671e. 2023-11-19 10:53:38,841 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for f1630f7551bce81ee7e30ea665d7671e: 2023-11-19 10:53:38,844 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-19 10:53:38,845 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithMonthlyPolicy,,1700391218400.f1630f7551bce81ee7e30ea665d7671e.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1700391218845"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700391218845"}]},"ts":"1700391218845"} 2023-11-19 10:53:38,847 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-19 10:53:38,848 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-19 10:53:38,848 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700391218848"}]},"ts":"1700391218848"} 2023-11-19 10:53:38,850 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-11-19 10:53:38,990 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=f1630f7551bce81ee7e30ea665d7671e, ASSIGN}] 2023-11-19 10:53:39,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-19 10:53:39,023 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=f1630f7551bce81ee7e30ea665d7671e, ASSIGN 2023-11-19 10:53:39,024 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=f1630f7551bce81ee7e30ea665d7671e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46035,1700391201579; forceNewPlan=false, retain=false 2023-11-19 10:53:39,176 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=f1630f7551bce81ee7e30ea665d7671e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:39,176 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithMonthlyPolicy,,1700391218400.f1630f7551bce81ee7e30ea665d7671e.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1700391219175"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700391219175"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700391219175"}]},"ts":"1700391219175"} 2023-11-19 10:53:39,178 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure f1630f7551bce81ee7e30ea665d7671e, server=jenkins-hbase4.apache.org,46035,1700391201579}] 2023-11-19 10:53:39,330 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:39,333 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithMonthlyPolicy,,1700391218400.f1630f7551bce81ee7e30ea665d7671e. 2023-11-19 10:53:39,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f1630f7551bce81ee7e30ea665d7671e, NAME => 'testMajorCompactionWithMonthlyPolicy,,1700391218400.f1630f7551bce81ee7e30ea665d7671e.', STARTKEY => '', ENDKEY => ''} 2023-11-19 10:53:39,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithMonthlyPolicy f1630f7551bce81ee7e30ea665d7671e 2023-11-19 10:53:39,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1700391218400.f1630f7551bce81ee7e30ea665d7671e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-19 10:53:39,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f1630f7551bce81ee7e30ea665d7671e 2023-11-19 10:53:39,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f1630f7551bce81ee7e30ea665d7671e 2023-11-19 10:53:39,336 INFO [StoreOpener-f1630f7551bce81ee7e30ea665d7671e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region f1630f7551bce81ee7e30ea665d7671e 2023-11-19 10:53:39,337 DEBUG [StoreOpener-f1630f7551bce81ee7e30ea665d7671e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1 2023-11-19 10:53:39,337 DEBUG [StoreOpener-f1630f7551bce81ee7e30ea665d7671e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1 2023-11-19 10:53:39,338 INFO [StoreOpener-f1630f7551bce81ee7e30ea665d7671e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f1630f7551bce81ee7e30ea665d7671e columnFamilyName family1 2023-11-19 10:53:39,339 INFO [StoreOpener-f1630f7551bce81ee7e30ea665d7671e-1] regionserver.HStore(310): Store=f1630f7551bce81ee7e30ea665d7671e/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-19 10:53:39,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e 2023-11-19 10:53:39,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e 2023-11-19 10:53:39,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f1630f7551bce81ee7e30ea665d7671e 2023-11-19 10:53:39,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-19 10:53:39,346 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f1630f7551bce81ee7e30ea665d7671e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73838993, jitterRate=0.10028673708438873}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-19 10:53:39,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f1630f7551bce81ee7e30ea665d7671e: 2023-11-19 10:53:39,347 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithMonthlyPolicy,,1700391218400.f1630f7551bce81ee7e30ea665d7671e., pid=21, masterSystemTime=1700391219330 2023-11-19 10:53:39,348 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithMonthlyPolicy,,1700391218400.f1630f7551bce81ee7e30ea665d7671e. 2023-11-19 10:53:39,349 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithMonthlyPolicy,,1700391218400.f1630f7551bce81ee7e30ea665d7671e. 2023-11-19 10:53:39,349 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=f1630f7551bce81ee7e30ea665d7671e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:39,349 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithMonthlyPolicy,,1700391218400.f1630f7551bce81ee7e30ea665d7671e.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1700391219349"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700391219349"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700391219349"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700391219349"}]},"ts":"1700391219349"} 2023-11-19 10:53:39,353 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=21, resume processing ppid=20 2023-11-19 10:53:39,354 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure f1630f7551bce81ee7e30ea665d7671e, server=jenkins-hbase4.apache.org,46035,1700391201579 in 173 msec 2023-11-19 10:53:39,356 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=20, resume processing ppid=19 2023-11-19 10:53:39,356 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=20, ppid=19, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=f1630f7551bce81ee7e30ea665d7671e, ASSIGN in 364 msec 2023-11-19 10:53:39,356 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-19 10:53:39,357 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700391219356"}]},"ts":"1700391219356"} 2023-11-19 10:53:39,358 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-11-19 10:53:39,412 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-19 10:53:39,414 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy in 1.0120 sec 2023-11-19 10:53:39,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-19 10:53:39,512 INFO [Listener at localhost/42675] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithMonthlyPolicy, procId: 19 completed 2023-11-19 10:53:39,552 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:53:39,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:39,555 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-19 10:53:39,555 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:53:39,556 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-19 10:53:39,556 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-19 10:53:39,556 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:39,556 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:39,644 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:39,644 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:53:39,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:53:39,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:53:39,644 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:39,644 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:53:39,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:39,645 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:39,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:53:39,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:39,646 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:39,646 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:39,646 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-19 10:53:39,646 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:53:39,646 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-19 10:53:39,647 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-19 10:53:39,647 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:53:39,647 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700391218400.f1630f7551bce81ee7e30ea665d7671e. 2023-11-19 10:53:39,647 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700391218400.f1630f7551bce81ee7e30ea665d7671e. started... 2023-11-19 10:53:39,648 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f1630f7551bce81ee7e30ea665d7671e 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-19 10:53:40,070 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511306f9cacb0005249e8913094b91572f7c7 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511306f9cacb0005249e8913094b91572f7c7 2023-11-19 10:53:40,487 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/.tmp/family1/30ed7904958d4d2392ced5e06da24f3e 2023-11-19 10:53:40,493 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/.tmp/family1/30ed7904958d4d2392ced5e06da24f3e as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/30ed7904958d4d2392ced5e06da24f3e 2023-11-19 10:53:40,499 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/30ed7904958d4d2392ced5e06da24f3e, entries=1000, sequenceid=5, filesize=166.0 K 2023-11-19 10:53:40,500 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for f1630f7551bce81ee7e30ea665d7671e in 852ms, sequenceid=5, compaction requested=false 2023-11-19 10:53:40,500 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithMonthlyPolicy' 2023-11-19 10:53:40,500 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f1630f7551bce81ee7e30ea665d7671e: 2023-11-19 10:53:40,501 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700391218400.f1630f7551bce81ee7e30ea665d7671e. 2023-11-19 10:53:40,501 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-19 10:53:40,501 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-19 10:53:40,501 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:40,501 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-19 10:53:40,501 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-19 10:53:40,560 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:40,560 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:40,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:40,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:40,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:40,561 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:40,561 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:53:40,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:40,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:40,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:40,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:40,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:40,563 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-19 10:53:40,563 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@350a6b3f[Count = 0] remaining members to acquire global barrier 2023-11-19 10:53:40,563 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-19 10:53:40,563 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:40,613 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:40,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:40,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:40,613 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-19 10:53:40,613 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-19 10:53:40,613 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:53:40,613 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:40,613 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:53:40,667 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-19 10:53:40,667 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:40,667 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:53:40,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:40,667 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-19 10:53:40,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:40,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:40,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:40,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:40,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:40,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:40,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:40,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:40,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:40,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:53:40,672 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-19 10:53:40,672 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-19 10:53:40,672 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:53:40,672 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:53:40,672 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:40,672 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:53:40,728 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:40,728 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:40,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:40,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:40,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:40,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:40,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:40,729 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:53:40,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:53:40,729 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:40,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:40,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:53:40,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:40,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:40,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:40,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:40,731 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:40,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:40,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:40,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:40,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:40,808 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:40,808 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:53:40,808 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:40,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:53:40,808 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-19 10:53:40,808 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:53:40,808 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:53:40,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:53:40,808 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-19 10:53:40,808 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:53:40,808 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:40,809 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-19 10:53:40,809 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:40,809 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:53:40,809 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:40,809 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:53:40,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:53:40,809 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:40,810 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:40,909 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:53:40,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:53:40,916 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:53:40,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-19 10:53:40,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:40,918 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-19 10:53:40,918 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:53:40,918 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-19 10:53:40,918 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-19 10:53:40,919 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:40,919 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:40,944 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:40,944 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:53:40,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:53:40,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:53:40,944 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:40,944 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:53:40,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:40,945 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:40,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:53:40,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:40,945 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:40,946 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-19 10:53:40,946 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:40,946 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-19 10:53:40,946 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:53:40,946 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-19 10:53:40,946 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-19 10:53:40,946 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:53:40,946 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700391218400.f1630f7551bce81ee7e30ea665d7671e. 2023-11-19 10:53:40,947 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700391218400.f1630f7551bce81ee7e30ea665d7671e. started... 2023-11-19 10:53:40,947 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f1630f7551bce81ee7e30ea665d7671e 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-19 10:53:41,361 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128af0dec4f10314e7e835fd915e6674d27 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128af0dec4f10314e7e835fd915e6674d27 2023-11-19 10:53:41,767 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/.tmp/family1/3595c38980594688a1e7fc706abbeee1 2023-11-19 10:53:41,774 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/.tmp/family1/3595c38980594688a1e7fc706abbeee1 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/3595c38980594688a1e7fc706abbeee1 2023-11-19 10:53:41,779 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/3595c38980594688a1e7fc706abbeee1, entries=1, sequenceid=9, filesize=5.0 K 2023-11-19 10:53:41,780 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for f1630f7551bce81ee7e30ea665d7671e in 833ms, sequenceid=9, compaction requested=false 2023-11-19 10:53:41,781 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f1630f7551bce81ee7e30ea665d7671e: 2023-11-19 10:53:41,781 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700391218400.f1630f7551bce81ee7e30ea665d7671e. 2023-11-19 10:53:41,781 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-19 10:53:41,781 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-19 10:53:41,781 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:41,781 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-19 10:53:41,781 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-19 10:53:41,783 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:41,783 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:41,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:41,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:41,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:41,783 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:41,784 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:53:41,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:41,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:41,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:41,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:41,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:41,785 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-19 10:53:41,785 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@261c09a2[Count = 0] remaining members to acquire global barrier 2023-11-19 10:53:41,785 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-19 10:53:41,785 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:41,786 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:41,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:41,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:41,787 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-19 10:53:41,787 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-19 10:53:41,787 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:53:41,787 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:41,787 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:53:41,788 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-19 10:53:41,788 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:41,788 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:53:41,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:41,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:41,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:41,788 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-19 10:53:41,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:41,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:41,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:41,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:41,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:41,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:41,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:41,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:53:41,792 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-19 10:53:41,792 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-19 10:53:41,792 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:53:41,792 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:53:41,792 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:41,792 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:53:41,794 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:41,794 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:41,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:41,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:41,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:41,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:41,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:41,794 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:53:41,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:41,795 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:53:41,795 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:41,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:53:41,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:41,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:41,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:41,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:41,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:41,797 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:41,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:41,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:41,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:41,799 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:41,799 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:53:41,799 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:41,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:53:41,799 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:41,799 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:53:41,799 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:53:41,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:53:41,799 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:41,799 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-19 10:53:41,800 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:53:41,800 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:41,800 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:41,800 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:41,800 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:53:41,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:53:41,800 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-19 10:53:41,801 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:53:41,901 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:53:41,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:53:41,906 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:53:41,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-19 10:53:41,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:41,908 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-19 10:53:41,908 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:53:41,909 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-19 10:53:41,909 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-19 10:53:41,909 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:41,909 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:41,911 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:41,911 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:53:41,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:53:41,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:53:41,911 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:41,911 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:53:41,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:41,912 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:41,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:53:41,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:41,912 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:41,912 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-19 10:53:41,912 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:41,912 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-19 10:53:41,912 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:53:41,913 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-19 10:53:41,913 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-19 10:53:41,913 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:53:41,913 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700391218400.f1630f7551bce81ee7e30ea665d7671e. 2023-11-19 10:53:41,913 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700391218400.f1630f7551bce81ee7e30ea665d7671e. started... 2023-11-19 10:53:41,913 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f1630f7551bce81ee7e30ea665d7671e 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-19 10:53:42,327 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512014df9f0dc0e414489bec5e5e7928976a4 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512014df9f0dc0e414489bec5e5e7928976a4 2023-11-19 10:53:42,733 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/.tmp/family1/8d5632625a844739b51113553d7e2fc9 2023-11-19 10:53:42,740 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/.tmp/family1/8d5632625a844739b51113553d7e2fc9 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/8d5632625a844739b51113553d7e2fc9 2023-11-19 10:53:42,745 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/8d5632625a844739b51113553d7e2fc9, entries=1, sequenceid=13, filesize=4.9 K 2023-11-19 10:53:42,746 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f1630f7551bce81ee7e30ea665d7671e in 833ms, sequenceid=13, compaction requested=true 2023-11-19 10:53:42,746 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f1630f7551bce81ee7e30ea665d7671e: 2023-11-19 10:53:42,746 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700391218400.f1630f7551bce81ee7e30ea665d7671e. 2023-11-19 10:53:42,747 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-19 10:53:42,747 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-19 10:53:42,747 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:42,747 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-19 10:53:42,747 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-19 10:53:42,748 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:42,748 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:42,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:42,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:42,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:42,749 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:42,749 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:53:42,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:42,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:42,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:42,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:42,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:42,751 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-19 10:53:42,751 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@fb1ea23[Count = 0] remaining members to acquire global barrier 2023-11-19 10:53:42,751 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-19 10:53:42,751 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:42,753 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:42,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:42,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:42,753 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-19 10:53:42,753 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-19 10:53:42,754 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:53:42,754 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:42,754 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:53:42,755 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:42,755 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-19 10:53:42,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:42,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:42,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:42,755 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:53:42,756 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-19 10:53:42,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:42,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:42,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:42,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:42,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:42,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:42,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:42,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:53:42,759 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-19 10:53:42,759 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-19 10:53:42,759 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:53:42,759 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:53:42,759 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:42,760 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:53:42,762 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:42,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:42,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:42,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:42,762 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:42,762 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:53:42,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:42,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:42,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:42,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:53:42,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:53:42,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:42,763 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:42,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:42,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:42,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:42,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:42,765 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:42,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:42,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:42,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:42,768 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:42,768 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:53:42,768 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:42,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:53:42,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:53:42,768 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:42,768 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:42,768 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:53:42,768 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:53:42,768 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-19 10:53:42,769 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:53:42,768 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:42,769 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:53:42,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:53:42,769 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:42,769 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:42,769 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-19 10:53:42,769 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:53:42,863 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-19 10:53:42,870 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:53:42,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:53:42,877 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:53:42,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-19 10:53:42,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:42,880 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-19 10:53:42,880 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:53:42,881 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-19 10:53:42,881 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-19 10:53:42,881 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:42,881 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:42,884 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:42,884 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:53:42,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:53:42,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:53:42,884 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:42,884 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:53:42,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:42,885 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:42,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:53:42,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:42,886 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:42,887 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-19 10:53:42,888 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:42,888 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-19 10:53:42,888 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:53:42,888 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-19 10:53:42,888 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-19 10:53:42,889 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:53:42,889 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700391218400.f1630f7551bce81ee7e30ea665d7671e. 2023-11-19 10:53:42,889 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700391218400.f1630f7551bce81ee7e30ea665d7671e. started... 2023-11-19 10:53:42,889 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f1630f7551bce81ee7e30ea665d7671e 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-19 10:53:42,906 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205f49cf3455fd44a47bf2d1544fb83d449 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205f49cf3455fd44a47bf2d1544fb83d449 2023-11-19 10:53:43,311 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/.tmp/family1/85817683b13c46678ab2c88493519a34 2023-11-19 10:53:43,319 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/.tmp/family1/85817683b13c46678ab2c88493519a34 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/85817683b13c46678ab2c88493519a34 2023-11-19 10:53:43,325 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/85817683b13c46678ab2c88493519a34, entries=1, sequenceid=17, filesize=4.9 K 2023-11-19 10:53:43,326 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f1630f7551bce81ee7e30ea665d7671e in 437ms, sequenceid=17, compaction requested=true 2023-11-19 10:53:43,327 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f1630f7551bce81ee7e30ea665d7671e: 2023-11-19 10:53:43,327 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700391218400.f1630f7551bce81ee7e30ea665d7671e. 2023-11-19 10:53:43,327 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-19 10:53:43,327 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-19 10:53:43,327 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:43,327 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-19 10:53:43,327 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-19 10:53:43,329 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:43,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:43,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:43,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:43,329 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:43,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:43,329 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:43,329 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:53:43,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:43,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:43,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:43,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:43,332 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-19 10:53:43,332 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3707aa7b[Count = 0] remaining members to acquire global barrier 2023-11-19 10:53:43,332 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-19 10:53:43,332 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:43,333 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:43,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:43,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:43,333 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-19 10:53:43,333 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:43,333 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:53:43,333 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-19 10:53:43,333 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:53:43,340 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:43,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:43,340 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-19 10:53:43,340 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:53:43,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:43,340 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-19 10:53:43,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:43,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:43,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:43,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:43,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:43,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:43,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:43,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:43,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:53:43,349 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-19 10:53:43,349 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-19 10:53:43,349 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:53:43,349 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:53:43,349 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:43,349 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:53:43,353 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:43,353 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:43,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:43,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:43,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:43,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:43,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:43,353 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:53:43,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:43,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:53:43,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:53:43,354 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:43,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:43,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:43,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:43,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:43,355 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:43,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:43,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:43,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:43,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:43,360 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:43,360 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:43,360 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:43,360 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:43,360 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:53:43,360 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:43,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:53:43,360 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:43,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:53:43,360 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:53:43,360 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-19 10:53:43,360 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:53:43,360 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:53:43,361 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-19 10:53:43,360 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:43,361 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:53:43,360 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-19 10:53:43,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:53:43,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:53:43,462 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:53:43,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:53:43,469 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:53:43,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-19 10:53:43,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:43,471 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-19 10:53:43,471 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:53:43,472 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-19 10:53:43,472 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-19 10:53:43,473 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:43,473 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:43,474 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:43,474 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:53:43,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:53:43,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:53:43,475 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:43,475 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:53:43,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:43,475 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:43,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:53:43,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:43,476 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:43,476 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-19 10:53:43,476 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:43,476 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-19 10:53:43,476 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:53:43,477 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-19 10:53:43,480 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-19 10:53:43,480 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:53:43,480 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700391218400.f1630f7551bce81ee7e30ea665d7671e. 2023-11-19 10:53:43,480 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700391218400.f1630f7551bce81ee7e30ea665d7671e. started... 2023-11-19 10:53:43,480 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f1630f7551bce81ee7e30ea665d7671e 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-19 10:53:43,505 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228e299139dd3e8492abe9b5701c511e4bc to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228e299139dd3e8492abe9b5701c511e4bc 2023-11-19 10:53:43,513 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/.tmp/family1/69d116ca07b947ef8bfcf1be3f47914d 2023-11-19 10:53:43,519 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/.tmp/family1/69d116ca07b947ef8bfcf1be3f47914d as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/69d116ca07b947ef8bfcf1be3f47914d 2023-11-19 10:53:43,524 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/69d116ca07b947ef8bfcf1be3f47914d, entries=1, sequenceid=21, filesize=4.9 K 2023-11-19 10:53:43,525 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f1630f7551bce81ee7e30ea665d7671e in 45ms, sequenceid=21, compaction requested=true 2023-11-19 10:53:43,525 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f1630f7551bce81ee7e30ea665d7671e: 2023-11-19 10:53:43,525 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700391218400.f1630f7551bce81ee7e30ea665d7671e. 2023-11-19 10:53:43,525 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-19 10:53:43,526 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-19 10:53:43,526 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:43,526 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-19 10:53:43,526 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-19 10:53:43,528 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:43,528 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:43,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:43,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:43,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:43,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:43,531 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:43,531 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:53:43,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:43,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:43,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:43,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:43,534 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-19 10:53:43,535 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@51b27c37[Count = 0] remaining members to acquire global barrier 2023-11-19 10:53:43,535 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-19 10:53:43,535 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:43,536 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:43,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:43,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:43,537 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-19 10:53:43,537 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-19 10:53:43,537 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:53:43,537 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:43,537 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:53:43,539 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-19 10:53:43,539 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:43,539 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:53:43,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:43,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:43,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:43,539 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-19 10:53:43,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:43,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:43,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:43,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:43,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:43,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:43,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:43,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:53:43,543 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-19 10:53:43,543 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-19 10:53:43,543 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:53:43,543 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:53:43,543 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:43,543 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:53:43,545 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:43,545 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:43,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:43,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:43,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:43,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:43,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:43,546 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:53:43,547 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:53:43,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:43,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:53:43,547 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:43,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:43,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:43,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:43,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:43,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:43,550 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:43,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:43,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:43,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:43,556 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:43,556 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:53:43,556 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:53:43,557 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:53:43,557 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-19 10:53:43,557 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:53:43,556 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:43,558 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:43,558 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:43,558 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:43,558 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:43,558 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:43,558 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-19 10:53:43,558 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:53:43,556 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-19 10:53:43,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:53:43,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:53:43,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:53:43,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:53:43,658 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:53:43,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:53:43,664 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:53:43,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-19 10:53:43,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:43,666 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-19 10:53:43,666 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:53:43,667 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-19 10:53:43,667 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-19 10:53:43,668 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:43,668 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:43,669 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:43,669 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:53:43,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:53:43,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:53:43,670 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:43,670 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:53:43,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:43,670 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:43,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:53:43,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:43,671 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:43,671 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-19 10:53:43,671 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:43,671 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-19 10:53:43,671 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:53:43,672 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-19 10:53:43,672 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-19 10:53:43,672 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:53:43,672 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700391218400.f1630f7551bce81ee7e30ea665d7671e. 2023-11-19 10:53:43,672 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700391218400.f1630f7551bce81ee7e30ea665d7671e. started... 2023-11-19 10:53:43,672 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f1630f7551bce81ee7e30ea665d7671e 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-19 10:53:44,092 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123149a6e1ca5b064b1f803ee11b14cd83cc to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015123149a6e1ca5b064b1f803ee11b14cd83cc 2023-11-19 10:53:44,498 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/.tmp/family1/beba58b5479543de92bdbe1fb90171e7 2023-11-19 10:53:44,505 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/.tmp/family1/beba58b5479543de92bdbe1fb90171e7 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/beba58b5479543de92bdbe1fb90171e7 2023-11-19 10:53:44,510 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/beba58b5479543de92bdbe1fb90171e7, entries=1, sequenceid=25, filesize=4.9 K 2023-11-19 10:53:44,511 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f1630f7551bce81ee7e30ea665d7671e in 839ms, sequenceid=25, compaction requested=true 2023-11-19 10:53:44,511 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f1630f7551bce81ee7e30ea665d7671e: 2023-11-19 10:53:44,511 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700391218400.f1630f7551bce81ee7e30ea665d7671e. 2023-11-19 10:53:44,512 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-19 10:53:44,512 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-19 10:53:44,512 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:44,512 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-19 10:53:44,512 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-19 10:53:44,514 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:44,514 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:44,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:44,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:44,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:44,514 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:44,514 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:53:44,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:44,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:44,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:44,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:44,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:44,515 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-19 10:53:44,515 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@17253eba[Count = 0] remaining members to acquire global barrier 2023-11-19 10:53:44,515 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-19 10:53:44,516 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:44,517 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:44,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:44,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:44,517 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-19 10:53:44,517 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-19 10:53:44,517 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:53:44,517 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:44,517 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:53:44,522 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-19 10:53:44,522 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:44,523 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:53:44,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:44,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:44,523 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-19 10:53:44,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:44,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:44,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:44,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:44,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:44,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:44,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:44,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:44,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:53:44,526 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-19 10:53:44,526 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-19 10:53:44,526 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:53:44,526 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:53:44,526 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:44,526 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:53:44,528 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:44,528 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:44,528 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:44,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:44,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:44,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:44,528 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:53:44,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:44,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:44,528 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:44,528 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:53:44,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:53:44,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:44,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:44,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:44,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:44,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:44,531 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:44,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:44,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:44,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:44,533 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:44,533 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:44,533 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:53:44,533 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:44,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:53:44,533 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-19 10:53:44,533 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:53:44,533 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:53:44,533 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:44,533 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:53:44,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:53:44,534 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:44,534 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:44,534 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:44,534 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-19 10:53:44,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:53:44,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:53:44,534 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:53:44,634 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:53:44,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:53:44,640 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:53:44,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-19 10:53:44,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:44,642 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-19 10:53:44,642 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:53:44,643 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-19 10:53:44,643 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-19 10:53:44,643 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:44,643 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:44,644 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:53:44,644 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:44,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:53:44,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:53:44,645 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:44,645 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:53:44,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:44,645 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:44,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:53:44,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:44,646 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:44,646 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-19 10:53:44,646 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:44,646 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-19 10:53:44,646 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:53:44,647 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-19 10:53:44,647 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-19 10:53:44,647 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:53:44,647 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700391218400.f1630f7551bce81ee7e30ea665d7671e. 2023-11-19 10:53:44,647 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700391218400.f1630f7551bce81ee7e30ea665d7671e. started... 2023-11-19 10:53:44,647 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f1630f7551bce81ee7e30ea665d7671e 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-19 10:53:45,062 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010152243d7c20314c589b02265c169dee72 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010152243d7c20314c589b02265c169dee72 2023-11-19 10:53:45,468 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/.tmp/family1/714ccd69e31e4574b6d543f4a303d565 2023-11-19 10:53:45,474 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/.tmp/family1/714ccd69e31e4574b6d543f4a303d565 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/714ccd69e31e4574b6d543f4a303d565 2023-11-19 10:53:45,480 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/714ccd69e31e4574b6d543f4a303d565, entries=1, sequenceid=29, filesize=4.9 K 2023-11-19 10:53:45,481 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f1630f7551bce81ee7e30ea665d7671e in 834ms, sequenceid=29, compaction requested=true 2023-11-19 10:53:45,481 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f1630f7551bce81ee7e30ea665d7671e: 2023-11-19 10:53:45,481 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700391218400.f1630f7551bce81ee7e30ea665d7671e. 2023-11-19 10:53:45,481 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-19 10:53:45,481 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-19 10:53:45,481 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:45,481 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-19 10:53:45,481 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-19 10:53:45,487 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:45,487 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:45,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:45,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:45,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:45,487 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:45,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:45,487 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:53:45,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:45,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:45,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:45,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:45,489 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-19 10:53:45,489 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@17c53e8f[Count = 0] remaining members to acquire global barrier 2023-11-19 10:53:45,489 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-19 10:53:45,489 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:45,490 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:45,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:45,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:45,490 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-19 10:53:45,490 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-19 10:53:45,490 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:53:45,490 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:45,490 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:53:45,492 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:45,492 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-19 10:53:45,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:45,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:45,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:45,492 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:53:45,492 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-19 10:53:45,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:45,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:45,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:45,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:45,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:45,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:45,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:45,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:53:45,495 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-19 10:53:45,495 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-19 10:53:45,495 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:53:45,495 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:53:45,495 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:45,495 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:53:45,497 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:45,497 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:45,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:45,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:45,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:45,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:45,497 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:53:45,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:45,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:45,497 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:45,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:53:45,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:53:45,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:45,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:45,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:45,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:45,500 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:45,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:45,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:45,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:45,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:45,503 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:45,503 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:53:45,503 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:45,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:53:45,503 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-19 10:53:45,503 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-19 10:53:45,503 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:53:45,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:53:45,503 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:53:45,503 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:45,503 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:45,503 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:53:45,504 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:45,504 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:45,504 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:45,504 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-19 10:53:45,504 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:53:45,504 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:53:45,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:53:45,604 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:53:45,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:53:45,611 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:53:45,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-19 10:53:45,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:45,613 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-19 10:53:45,613 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:53:45,613 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-19 10:53:45,614 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-19 10:53:45,614 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:45,614 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:45,615 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:45,615 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:53:45,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:53:45,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:53:45,616 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:45,616 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:53:45,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:45,616 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:45,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:53:45,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:45,616 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:45,617 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-19 10:53:45,617 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:45,618 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-19 10:53:45,618 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:53:45,618 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-19 10:53:45,618 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-19 10:53:45,618 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:53:45,618 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700391218400.f1630f7551bce81ee7e30ea665d7671e. 2023-11-19 10:53:45,618 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700391218400.f1630f7551bce81ee7e30ea665d7671e. started... 2023-11-19 10:53:45,618 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f1630f7551bce81ee7e30ea665d7671e 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-19 10:53:46,033 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601030aae28508c1c4de5b09ba46aa1a51ec4 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601030aae28508c1c4de5b09ba46aa1a51ec4 2023-11-19 10:53:46,038 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/.tmp/family1/d5859a5607e3427c96be1fbd76233f00 2023-11-19 10:53:46,043 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/.tmp/family1/d5859a5607e3427c96be1fbd76233f00 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/d5859a5607e3427c96be1fbd76233f00 2023-11-19 10:53:46,048 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/d5859a5607e3427c96be1fbd76233f00, entries=1, sequenceid=33, filesize=4.9 K 2023-11-19 10:53:46,049 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f1630f7551bce81ee7e30ea665d7671e in 431ms, sequenceid=33, compaction requested=true 2023-11-19 10:53:46,049 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f1630f7551bce81ee7e30ea665d7671e: 2023-11-19 10:53:46,049 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700391218400.f1630f7551bce81ee7e30ea665d7671e. 2023-11-19 10:53:46,049 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-19 10:53:46,050 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-19 10:53:46,050 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:46,050 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-19 10:53:46,050 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-19 10:53:46,051 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:46,051 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:46,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:46,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:46,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:46,052 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:46,052 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:53:46,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:46,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:46,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:46,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:46,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:46,053 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-19 10:53:46,053 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-19 10:53:46,053 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1d1b0a7e[Count = 0] remaining members to acquire global barrier 2023-11-19 10:53:46,053 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:46,055 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:46,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:46,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:46,055 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-19 10:53:46,055 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-19 10:53:46,055 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:53:46,055 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:46,055 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:53:46,057 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-19 10:53:46,057 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:46,057 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:53:46,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:46,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:46,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:46,057 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-19 10:53:46,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:46,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:46,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:46,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:46,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:46,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:46,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:46,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:53:46,061 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-19 10:53:46,061 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-19 10:53:46,061 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:53:46,061 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:53:46,061 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:46,061 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:53:46,062 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:46,062 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:53:46,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:46,062 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:46,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:46,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:46,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:46,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:46,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:53:46,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:53:46,063 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:46,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:46,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:46,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:46,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:46,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:46,064 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:46,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:46,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:46,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:46,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:46,067 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:46,067 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:46,067 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:46,067 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:46,067 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:46,067 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:53:46,067 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:53:46,068 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-19 10:53:46,068 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:53:46,067 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-19 10:53:46,068 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:53:46,067 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:46,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:53:46,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:53:46,068 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:46,068 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-19 10:53:46,069 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:53:46,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:53:46,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:53:46,169 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:53:46,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:53:46,175 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:53:46,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-19 10:53:46,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:46,177 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-19 10:53:46,177 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:53:46,178 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-19 10:53:46,178 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-19 10:53:46,178 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:46,178 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:46,179 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:46,179 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:53:46,180 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:53:46,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:53:46,180 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:46,180 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:53:46,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:46,180 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:46,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:53:46,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:46,181 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:46,181 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-19 10:53:46,181 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:46,181 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-19 10:53:46,181 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:53:46,182 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-19 10:53:46,182 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-19 10:53:46,182 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:53:46,182 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700391218400.f1630f7551bce81ee7e30ea665d7671e. 2023-11-19 10:53:46,182 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700391218400.f1630f7551bce81ee7e30ea665d7671e. started... 2023-11-19 10:53:46,182 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f1630f7551bce81ee7e30ea665d7671e 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-19 10:53:46,598 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509071a8940a2e1004293b6673c67b653a863 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201509071a8940a2e1004293b6673c67b653a863 2023-11-19 10:53:47,003 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/.tmp/family1/49cc242c48274870b2e4b3bffd6652c2 2023-11-19 10:53:47,009 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/.tmp/family1/49cc242c48274870b2e4b3bffd6652c2 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/49cc242c48274870b2e4b3bffd6652c2 2023-11-19 10:53:47,014 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/49cc242c48274870b2e4b3bffd6652c2, entries=1, sequenceid=37, filesize=4.9 K 2023-11-19 10:53:47,015 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f1630f7551bce81ee7e30ea665d7671e in 833ms, sequenceid=37, compaction requested=true 2023-11-19 10:53:47,015 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f1630f7551bce81ee7e30ea665d7671e: 2023-11-19 10:53:47,016 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700391218400.f1630f7551bce81ee7e30ea665d7671e. 2023-11-19 10:53:47,016 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-19 10:53:47,016 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-19 10:53:47,016 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:47,016 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-19 10:53:47,016 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-19 10:53:47,017 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:47,017 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:47,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:47,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:47,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:47,018 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:47,018 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:53:47,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:47,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:47,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:47,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:47,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:47,019 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-19 10:53:47,019 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5f8a9e2e[Count = 0] remaining members to acquire global barrier 2023-11-19 10:53:47,019 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-19 10:53:47,019 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:47,021 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:47,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:47,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:47,021 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-19 10:53:47,021 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-19 10:53:47,021 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:53:47,021 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:47,021 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:53:47,022 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:47,022 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-19 10:53:47,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:47,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:47,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:47,022 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:53:47,022 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-19 10:53:47,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:47,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:47,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:47,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:47,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:47,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:47,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:47,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:53:47,025 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-19 10:53:47,025 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-19 10:53:47,025 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:53:47,025 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:53:47,025 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:47,025 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:53:47,028 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:47,028 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:47,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:47,028 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:53:47,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:47,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:47,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:47,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:47,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:53:47,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:53:47,028 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:47,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:47,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:47,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:47,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:47,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:47,030 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:47,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:47,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:47,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:47,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:47,036 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:47,036 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:47,036 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:53:47,036 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:47,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:53:47,036 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:53:47,036 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:53:47,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:53:47,036 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-19 10:53:47,036 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-19 10:53:47,037 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:53:47,036 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:47,037 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:47,037 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:47,037 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:47,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:53:47,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:53:47,037 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-19 10:53:47,037 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:53:47,137 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:53:47,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:53:47,144 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:53:47,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-19 10:53:47,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:47,146 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-19 10:53:47,146 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:53:47,146 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-19 10:53:47,146 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-19 10:53:47,147 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:47,147 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:47,148 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:53:47,148 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:47,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:53:47,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:53:47,149 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:47,149 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:53:47,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:47,149 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:47,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:53:47,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:47,150 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:47,151 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-19 10:53:47,151 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:47,151 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-19 10:53:47,151 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:53:47,152 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-19 10:53:47,152 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-19 10:53:47,152 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:53:47,152 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700391218400.f1630f7551bce81ee7e30ea665d7671e. 2023-11-19 10:53:47,153 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700391218400.f1630f7551bce81ee7e30ea665d7671e. started... 2023-11-19 10:53:47,153 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f1630f7551bce81ee7e30ea665d7671e 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-19 10:53:47,179 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112060b921f45cc84bc48bde2a6775a48f4c to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015112060b921f45cc84bc48bde2a6775a48f4c 2023-11-19 10:53:47,586 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/.tmp/family1/76f8db9afeb54641a12fbe0ab91ae5ca 2023-11-19 10:53:47,592 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/.tmp/family1/76f8db9afeb54641a12fbe0ab91ae5ca as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/76f8db9afeb54641a12fbe0ab91ae5ca 2023-11-19 10:53:47,598 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/76f8db9afeb54641a12fbe0ab91ae5ca, entries=1, sequenceid=41, filesize=4.9 K 2023-11-19 10:53:47,599 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f1630f7551bce81ee7e30ea665d7671e in 446ms, sequenceid=41, compaction requested=true 2023-11-19 10:53:47,600 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f1630f7551bce81ee7e30ea665d7671e: 2023-11-19 10:53:47,600 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700391218400.f1630f7551bce81ee7e30ea665d7671e. 2023-11-19 10:53:47,600 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-19 10:53:47,600 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-19 10:53:47,600 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:47,600 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-19 10:53:47,600 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-19 10:53:47,602 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:47,602 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:47,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:47,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:47,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:47,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:47,602 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:47,602 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:53:47,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:47,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:47,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:47,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:47,604 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-19 10:53:47,604 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@61e4bb8b[Count = 0] remaining members to acquire global barrier 2023-11-19 10:53:47,604 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-19 10:53:47,604 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:47,605 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:47,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:47,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:47,605 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-19 10:53:47,606 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-19 10:53:47,606 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:53:47,606 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:47,606 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:53:47,607 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:47,607 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-19 10:53:47,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:47,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:47,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:47,607 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:53:47,607 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-19 10:53:47,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:47,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:47,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:47,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:47,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:47,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:47,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:47,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:53:47,611 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-19 10:53:47,611 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-19 10:53:47,611 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:53:47,611 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:53:47,611 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:47,611 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:53:47,613 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:47,613 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:47,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:47,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:47,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:47,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:47,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:47,613 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:53:47,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:47,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:53:47,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:53:47,613 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:47,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:47,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:47,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:47,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:47,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:47,615 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:47,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:47,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:47,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:47,617 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:47,617 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:47,617 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:53:47,617 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:47,617 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:53:47,617 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:47,617 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:53:47,617 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:53:47,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:53:47,617 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-19 10:53:47,617 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-19 10:53:47,619 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:53:47,617 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:47,619 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:47,619 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:47,619 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-19 10:53:47,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:53:47,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:53:47,620 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:53:47,720 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:53:47,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:53:47,722 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=33457] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithMonthlyPolicy 2023-11-19 10:53:47,724 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] procedure2.ProcedureExecutor(1028): Stored pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-19 10:53:47,725 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-19 10:53:47,725 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-19 10:53:47,726 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=22, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700391827725 2023-11-19 10:53:47,726 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-19 10:53:47,728 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithMonthlyPolicy' and column 'family1' 2023-11-19 10:53:47,728 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-19 10:53:47,730 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] zookeeper.ReadOnlyZKClient(139): Connect 0x2e3461f0 to 127.0.0.1:60497 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-19 10:53:47,735 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@703beedc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-19 10:53:47,735 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-19 10:53:48,577 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103ddfd8dc0055f48069fe783bc4e197af7 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103ddfd8dc0055f48069fe783bc4e197af7 2023-11-19 10:53:48,578 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-19 10:53:48,590 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-19 10:53:48,591 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48226, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-19 10:53:48,598 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-19 10:53:48,599 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54244, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-19 10:53:48,608 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/6ad9ca04d80d4136a567be67aada9244 first=Optional[r5] last=Optional[r6] 2023-11-19 10:53:48,609 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1700391218400.f1630f7551bce81ee7e30ea665d7671e., hostname=jenkins-hbase4.apache.org,46035,1700391201579, seqNum=2 for row with hfile group [{family1,hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/6ad9ca04d80d4136a567be67aada9244}] 2023-11-19 10:53:48,612 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(763): Validating hfile at hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/6ad9ca04d80d4136a567be67aada9244 for inclusion in f1630f7551bce81ee7e30ea665d7671e/family1 2023-11-19 10:53:48,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-11-19 10:53:48,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(777): Region bounds: first= last= 2023-11-19 10:53:48,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegion(2446): Flush status journal for f1630f7551bce81ee7e30ea665d7671e: 2023-11-19 10:53:48,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/6ad9ca04d80d4136a567be67aada9244 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__beklmtgl706dpujnuqrf9qodmbivdg9norvbegqp3e9oh8bvplo3k7rrdg39gij0/family1/6ad9ca04d80d4136a567be67aada9244 2023-11-19 10:53:48,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__beklmtgl706dpujnuqrf9qodmbivdg9norvbegqp3e9oh8bvplo3k7rrdg39gij0/family1/6ad9ca04d80d4136a567be67aada9244 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/0a43b167964c4b87b485364d558fc06d_SeqId_44_ 2023-11-19 10:53:48,619 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(849): Loaded HFile hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__beklmtgl706dpujnuqrf9qodmbivdg9norvbegqp3e9oh8bvplo3k7rrdg39gij0/family1/6ad9ca04d80d4136a567be67aada9244 into f1630f7551bce81ee7e30ea665d7671e/family1 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/0a43b167964c4b87b485364d558fc06d_SeqId_44_ - updating store file list. 2023-11-19 10:53:48,624 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(882): Loaded HFile hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/0a43b167964c4b87b485364d558fc06d_SeqId_44_ into f1630f7551bce81ee7e30ea665d7671e/family1 2023-11-19 10:53:48,624 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(855): Successfully loaded hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__beklmtgl706dpujnuqrf9qodmbivdg9norvbegqp3e9oh8bvplo3k7rrdg39gij0/family1/6ad9ca04d80d4136a567be67aada9244 into f1630f7551bce81ee7e30ea665d7671e/family1 (new location: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/0a43b167964c4b87b485364d558fc06d_SeqId_44_) 2023-11-19 10:53:48,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__beklmtgl706dpujnuqrf9qodmbivdg9norvbegqp3e9oh8bvplo3k7rrdg39gij0/family1/6ad9ca04d80d4136a567be67aada9244 2023-11-19 10:53:48,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-19 10:53:48,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-19 10:53:48,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(1912): f1630f7551bce81ee7e30ea665d7671e/family1 is initiating minor compaction 2023-11-19 10:53:48,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@647f693a; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-19 10:53:48,628 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of f1630f7551bce81ee7e30ea665d7671e/family1 in testMajorCompactionWithMonthlyPolicy,,1700391218400.f1630f7551bce81ee7e30ea665d7671e. 2023-11-19 10:53:48,629 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/3595c38980594688a1e7fc706abbeee1, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/8d5632625a844739b51113553d7e2fc9, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/85817683b13c46678ab2c88493519a34, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/69d116ca07b947ef8bfcf1be3f47914d, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/beba58b5479543de92bdbe1fb90171e7, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/714ccd69e31e4574b6d543f4a303d565, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/d5859a5607e3427c96be1fbd76233f00, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/49cc242c48274870b2e4b3bffd6652c2, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/76f8db9afeb54641a12fbe0ab91ae5ca, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/0a43b167964c4b87b485364d558fc06d_SeqId_44_] into tmpdir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/.tmp, totalSize=49.7 K 2023-11-19 10:53:48,629 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting 3595c38980594688a1e7fc706abbeee1, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-19 10:53:48,629 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting 8d5632625a844739b51113553d7e2fc9, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-19 10:53:48,629 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting 85817683b13c46678ab2c88493519a34, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-19 10:53:48,629 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting 69d116ca07b947ef8bfcf1be3f47914d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-19 10:53:48,629 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting beba58b5479543de92bdbe1fb90171e7, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-19 10:53:48,629 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting 714ccd69e31e4574b6d543f4a303d565, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-19 10:53:48,629 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting d5859a5607e3427c96be1fbd76233f00, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-19 10:53:48,629 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting 49cc242c48274870b2e4b3bffd6652c2, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-19 10:53:48,629 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting 76f8db9afeb54641a12fbe0ab91ae5ca, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-19 10:53:48,629 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting 0a43b167964c4b87b485364d558fc06d_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-19 10:53:48,630 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-19 10:53:48,631 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:53:48,633 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010152243d7c20314c589b02265c169dee72 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010152243d7c20314c589b02265c169dee72 2023-11-19 10:53:48,635 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601030aae28508c1c4de5b09ba46aa1a51ec4 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601030aae28508c1c4de5b09ba46aa1a51ec4 2023-11-19 10:53:48,635 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-11-19 10:53:48,635 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-11-19 10:53:48,635 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-19 10:53:48,635 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-19 10:53:48,675 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] throttle.PressureAwareThroughputController(145): f1630f7551bce81ee7e30ea665d7671e#family1#compaction#22 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-19 10:53:49,095 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/.tmp/family1/21a300459347467d81b42e25b7f45f2a as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/21a300459347467d81b42e25b7f45f2a 2023-11-19 10:53:49,097 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512318675396de7d04175b24e150f35b7f480 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512318675396de7d04175b24e150f35b7f480 2023-11-19 10:53:49,098 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-19 10:53:49,101 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in f1630f7551bce81ee7e30ea665d7671e/family1 of f1630f7551bce81ee7e30ea665d7671e into 21a300459347467d81b42e25b7f45f2a(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-19 10:53:49,101 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for f1630f7551bce81ee7e30ea665d7671e: 2023-11-19 10:53:49,102 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1700391218400.f1630f7551bce81ee7e30ea665d7671e., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1700391228628; duration=0sec 2023-11-19 10:53:49,102 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-19 10:53:49,122 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/1c857004f9f84e3288c8b2daa0a1fdb2 first=Optional[r1] last=Optional[r4] 2023-11-19 10:53:49,123 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1700391218400.f1630f7551bce81ee7e30ea665d7671e., hostname=jenkins-hbase4.apache.org,46035,1700391201579, seqNum=2 for row with hfile group [{family1,hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/1c857004f9f84e3288c8b2daa0a1fdb2}] 2023-11-19 10:53:49,125 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(763): Validating hfile at hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/1c857004f9f84e3288c8b2daa0a1fdb2 for inclusion in f1630f7551bce81ee7e30ea665d7671e/family1 2023-11-19 10:53:49,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-11-19 10:53:49,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(777): Region bounds: first= last= 2023-11-19 10:53:49,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegion(2446): Flush status journal for f1630f7551bce81ee7e30ea665d7671e: 2023-11-19 10:53:49,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/1c857004f9f84e3288c8b2daa0a1fdb2 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__anic02348lrdu8eqpt44tr6bqgobig571hedabb572e2bfsi5efajtrool8svcq3/family1/1c857004f9f84e3288c8b2daa0a1fdb2 2023-11-19 10:53:49,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__anic02348lrdu8eqpt44tr6bqgobig571hedabb572e2bfsi5efajtrool8svcq3/family1/1c857004f9f84e3288c8b2daa0a1fdb2 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/8a7aaeb261194a20945722dd87c6a279_SeqId_47_ 2023-11-19 10:53:49,134 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(849): Loaded HFile hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__anic02348lrdu8eqpt44tr6bqgobig571hedabb572e2bfsi5efajtrool8svcq3/family1/1c857004f9f84e3288c8b2daa0a1fdb2 into f1630f7551bce81ee7e30ea665d7671e/family1 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/8a7aaeb261194a20945722dd87c6a279_SeqId_47_ - updating store file list. 2023-11-19 10:53:49,141 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/3595c38980594688a1e7fc706abbeee1, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/8d5632625a844739b51113553d7e2fc9, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/85817683b13c46678ab2c88493519a34, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/69d116ca07b947ef8bfcf1be3f47914d, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/beba58b5479543de92bdbe1fb90171e7, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/714ccd69e31e4574b6d543f4a303d565, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/d5859a5607e3427c96be1fbd76233f00, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/49cc242c48274870b2e4b3bffd6652c2, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/76f8db9afeb54641a12fbe0ab91ae5ca, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/0a43b167964c4b87b485364d558fc06d_SeqId_44_] to archive 2023-11-19 10:53:49,142 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:53:49,144 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/3595c38980594688a1e7fc706abbeee1 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/3595c38980594688a1e7fc706abbeee1 2023-11-19 10:53:49,145 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(882): Loaded HFile hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/8a7aaeb261194a20945722dd87c6a279_SeqId_47_ into f1630f7551bce81ee7e30ea665d7671e/family1 2023-11-19 10:53:49,145 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(855): Successfully loaded hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__anic02348lrdu8eqpt44tr6bqgobig571hedabb572e2bfsi5efajtrool8svcq3/family1/1c857004f9f84e3288c8b2daa0a1fdb2 into f1630f7551bce81ee7e30ea665d7671e/family1 (new location: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/8a7aaeb261194a20945722dd87c6a279_SeqId_47_) 2023-11-19 10:53:49,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__anic02348lrdu8eqpt44tr6bqgobig571hedabb572e2bfsi5efajtrool8svcq3/family1/1c857004f9f84e3288c8b2daa0a1fdb2 2023-11-19 10:53:49,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-19 10:53:49,146 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/8d5632625a844739b51113553d7e2fc9 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/8d5632625a844739b51113553d7e2fc9 2023-11-19 10:53:49,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-19 10:53:49,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(1912): f1630f7551bce81ee7e30ea665d7671e/family1 is initiating minor compaction (all files) 2023-11-19 10:53:49,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@31c64074; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-19 10:53:49,148 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of f1630f7551bce81ee7e30ea665d7671e/family1 in testMajorCompactionWithMonthlyPolicy,,1700391218400.f1630f7551bce81ee7e30ea665d7671e. 2023-11-19 10:53:49,148 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/85817683b13c46678ab2c88493519a34 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/85817683b13c46678ab2c88493519a34 2023-11-19 10:53:49,148 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/30ed7904958d4d2392ced5e06da24f3e, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/21a300459347467d81b42e25b7f45f2a, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/8a7aaeb261194a20945722dd87c6a279_SeqId_47_] into tmpdir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/.tmp, totalSize=178.1 K 2023-11-19 10:53:49,149 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting 30ed7904958d4d2392ced5e06da24f3e, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878825094 2023-11-19 10:53:49,149 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting 21a300459347467d81b42e25b7f45f2a, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621225094 2023-11-19 10:53:49,150 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/69d116ca07b947ef8bfcf1be3f47914d to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/69d116ca07b947ef8bfcf1be3f47914d 2023-11-19 10:53:49,150 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting 8a7aaeb261194a20945722dd87c6a279_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965225094 2023-11-19 10:53:49,150 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-19 10:53:49,151 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:53:49,151 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/beba58b5479543de92bdbe1fb90171e7 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/beba58b5479543de92bdbe1fb90171e7 2023-11-19 10:53:49,153 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/714ccd69e31e4574b6d543f4a303d565 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/714ccd69e31e4574b6d543f4a303d565 2023-11-19 10:53:49,153 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512014df9f0dc0e414489bec5e5e7928976a4 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512014df9f0dc0e414489bec5e5e7928976a4 2023-11-19 10:53:49,154 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205f49cf3455fd44a47bf2d1544fb83d449 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205f49cf3455fd44a47bf2d1544fb83d449 2023-11-19 10:53:49,155 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/d5859a5607e3427c96be1fbd76233f00 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/d5859a5607e3427c96be1fbd76233f00 2023-11-19 10:53:49,156 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228e299139dd3e8492abe9b5701c511e4bc to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228e299139dd3e8492abe9b5701c511e4bc 2023-11-19 10:53:49,156 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/49cc242c48274870b2e4b3bffd6652c2 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/49cc242c48274870b2e4b3bffd6652c2 2023-11-19 10:53:49,159 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/76f8db9afeb54641a12fbe0ab91ae5ca to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/76f8db9afeb54641a12fbe0ab91ae5ca 2023-11-19 10:53:49,161 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015123149a6e1ca5b064b1f803ee11b14cd83cc to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015123149a6e1ca5b064b1f803ee11b14cd83cc 2023-11-19 10:53:49,161 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-11-19 10:53:49,161 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-11-19 10:53:49,161 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/0a43b167964c4b87b485364d558fc06d_SeqId_44_ to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/0a43b167964c4b87b485364d558fc06d_SeqId_44_ 2023-11-19 10:53:49,162 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-19 10:53:49,162 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-19 10:53:49,172 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] throttle.PressureAwareThroughputController(145): f1630f7551bce81ee7e30ea665d7671e#family1#compaction#23 average throughput is 15.56 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-19 10:53:49,195 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/.tmp/family1/cc912929e53044879e1e225e62f733dd as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/cc912929e53044879e1e225e62f733dd 2023-11-19 10:53:49,202 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in f1630f7551bce81ee7e30ea665d7671e/family1 of f1630f7551bce81ee7e30ea665d7671e into cc912929e53044879e1e225e62f733dd(size=167.4 K), total size for store is 167.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-19 10:53:49,202 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for f1630f7551bce81ee7e30ea665d7671e: 2023-11-19 10:53:49,203 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1700391218400.f1630f7551bce81ee7e30ea665d7671e., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1700391229148; duration=0sec 2023-11-19 10:53:49,203 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-19 10:53:49,228 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/30ed7904958d4d2392ced5e06da24f3e, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/21a300459347467d81b42e25b7f45f2a, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/8a7aaeb261194a20945722dd87c6a279_SeqId_47_] to archive 2023-11-19 10:53:49,229 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:53:49,232 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/30ed7904958d4d2392ced5e06da24f3e to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/30ed7904958d4d2392ced5e06da24f3e 2023-11-19 10:53:49,234 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/21a300459347467d81b42e25b7f45f2a to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/21a300459347467d81b42e25b7f45f2a 2023-11-19 10:53:49,235 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/8a7aaeb261194a20945722dd87c6a279_SeqId_47_ to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/8a7aaeb261194a20945722dd87c6a279_SeqId_47_ 2023-11-19 10:53:50,021 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511308854f5b543444e998fea71a7e9782514 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511308854f5b543444e998fea71a7e9782514 2023-11-19 10:53:50,023 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-19 10:53:50,050 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/30b5041097f5427c853f104c17e88f93 first=Optional[r00] last=Optional[r8] 2023-11-19 10:53:50,050 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1700391218400.f1630f7551bce81ee7e30ea665d7671e., hostname=jenkins-hbase4.apache.org,46035,1700391201579, seqNum=2 for row with hfile group [{family1,hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/30b5041097f5427c853f104c17e88f93}] 2023-11-19 10:53:50,052 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(763): Validating hfile at hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/30b5041097f5427c853f104c17e88f93 for inclusion in f1630f7551bce81ee7e30ea665d7671e/family1 2023-11-19 10:53:50,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-11-19 10:53:50,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(777): Region bounds: first= last= 2023-11-19 10:53:50,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegion(2446): Flush status journal for f1630f7551bce81ee7e30ea665d7671e: 2023-11-19 10:53:50,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/30b5041097f5427c853f104c17e88f93 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__bk3l7pm8vklle683tstv4ar2p47jqt3bpje9o874i8csr4deoerg6s0h729o6di1/family1/30b5041097f5427c853f104c17e88f93 2023-11-19 10:53:50,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__bk3l7pm8vklle683tstv4ar2p47jqt3bpje9o874i8csr4deoerg6s0h729o6di1/family1/30b5041097f5427c853f104c17e88f93 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/439a8b3a29424dfcb97afa6b52217454_SeqId_50_ 2023-11-19 10:53:50,059 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(849): Loaded HFile hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__bk3l7pm8vklle683tstv4ar2p47jqt3bpje9o874i8csr4deoerg6s0h729o6di1/family1/30b5041097f5427c853f104c17e88f93 into f1630f7551bce81ee7e30ea665d7671e/family1 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/439a8b3a29424dfcb97afa6b52217454_SeqId_50_ - updating store file list. 2023-11-19 10:53:50,064 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(882): Loaded HFile hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/439a8b3a29424dfcb97afa6b52217454_SeqId_50_ into f1630f7551bce81ee7e30ea665d7671e/family1 2023-11-19 10:53:50,064 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(855): Successfully loaded hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__bk3l7pm8vklle683tstv4ar2p47jqt3bpje9o874i8csr4deoerg6s0h729o6di1/family1/30b5041097f5427c853f104c17e88f93 into f1630f7551bce81ee7e30ea665d7671e/family1 (new location: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/family1/439a8b3a29424dfcb97afa6b52217454_SeqId_50_) 2023-11-19 10:53:50,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__bk3l7pm8vklle683tstv4ar2p47jqt3bpje9o874i8csr4deoerg6s0h729o6di1/family1/30b5041097f5427c853f104c17e88f93 2023-11-19 10:53:50,066 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-19 10:53:50,067 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:53:50,069 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015112060b921f45cc84bc48bde2a6775a48f4c to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015112060b921f45cc84bc48bde2a6775a48f4c 2023-11-19 10:53:50,070 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128af0dec4f10314e7e835fd915e6674d27 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128af0dec4f10314e7e835fd915e6674d27 2023-11-19 10:53:50,071 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511306f9cacb0005249e8913094b91572f7c7 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511306f9cacb0005249e8913094b91572f7c7 2023-11-19 10:53:50,071 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-11-19 10:53:50,071 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-19 10:53:50,072 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-19 10:53:50,072 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-19 10:53:50,072 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-19 10:53:50,072 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-19 10:53:50,072 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-19 10:53:50,073 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=22, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-19 10:53:50,075 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=22, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 2.3500 sec 2023-11-19 10:53:50,174 INFO [Listener at localhost/42675] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=255 (was 251) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_348511746_17 at /127.0.0.1:54884 [Waiting for operation #30] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_348511746_17 at /127.0.0.1:48912 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4478c30a-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-434764726_17 at /127.0.0.1:48800 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:60497@0x2e3461f0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$88/586051327.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_348511746_17 at /127.0.0.1:55078 [Waiting for operation #22] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4478c30a-shared-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_348511746_17 at /127.0.0.1:48826 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_348511746_17 at /127.0.0.1:48814 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4478c30a-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_348511746_17 at /127.0.0.1:55026 [Waiting for operation #33] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_348511746_17 at /127.0.0.1:48750 [Waiting for operation #18] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_348511746_17 at /127.0.0.1:48736 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4478c30a-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_348511746_17 at /127.0.0.1:48730 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_348511746_17 at /127.0.0.1:48716 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4478c30a-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:60497@0x2e3461f0-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:549) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_348511746_17 at /127.0.0.1:48832 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_348511746_17 at /127.0.0.1:48796 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/404937f1-f8cc-7c23-e42f-3dd0b22b5057/cluster_0d30b9ac-b1ea-f838-523d-c3632a7c9c3a/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4478c30a-shared-pool-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4478c30a-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:60497@0x2e3461f0-SendThread(127.0.0.1:60497) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:332) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1289) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_348511746_17 at /127.0.0.1:48802 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=633 (was 626) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=250 (was 248) - SystemLoadAverage LEAK? -, ProcessCount=172 (was 172), AvailableMemoryMB=15705 (was 15866) 2023-11-19 10:53:50,186 INFO [Listener at localhost/42675] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=255, OpenFileDescriptor=633, MaxFileDescriptor=60000, SystemLoadAverage=250, ProcessCount=172, AvailableMemoryMB=15704 2023-11-19 10:53:50,188 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-19 10:53:50,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure2.ProcedureExecutor(1028): Stored pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:50,191 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-19 10:53:50,191 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithWeeklyPolicy" procId is: 23 2023-11-19 10:53:50,192 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-19 10:53:50,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-19 10:53:50,193 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa 2023-11-19 10:53:50,194 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa empty. 2023-11-19 10:53:50,194 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa 2023-11-19 10:53:50,194 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithWeeklyPolicy regions 2023-11-19 10:53:50,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-19 10:53:50,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-19 10:53:50,606 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-19 10:53:50,607 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => bfe0e9384ea435498bea2232dc5c43aa, NAME => 'testMinorCompactionWithWeeklyPolicy,,1700391230188.bfe0e9384ea435498bea2232dc5c43aa.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp 2023-11-19 10:53:50,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-19 10:53:51,014 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1700391230188.bfe0e9384ea435498bea2232dc5c43aa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-19 10:53:51,014 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing bfe0e9384ea435498bea2232dc5c43aa, disabling compactions & flushes 2023-11-19 10:53:51,014 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1700391230188.bfe0e9384ea435498bea2232dc5c43aa. 2023-11-19 10:53:51,014 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1700391230188.bfe0e9384ea435498bea2232dc5c43aa. 2023-11-19 10:53:51,014 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1700391230188.bfe0e9384ea435498bea2232dc5c43aa. after waiting 0 ms 2023-11-19 10:53:51,014 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1700391230188.bfe0e9384ea435498bea2232dc5c43aa. 2023-11-19 10:53:51,014 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1700391230188.bfe0e9384ea435498bea2232dc5c43aa. 2023-11-19 10:53:51,014 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for bfe0e9384ea435498bea2232dc5c43aa: 2023-11-19 10:53:51,017 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-19 10:53:51,018 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithWeeklyPolicy,,1700391230188.bfe0e9384ea435498bea2232dc5c43aa.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1700391231018"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700391231018"}]},"ts":"1700391231018"} 2023-11-19 10:53:51,020 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-19 10:53:51,021 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-19 10:53:51,021 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700391231021"}]},"ts":"1700391231021"} 2023-11-19 10:53:51,023 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-11-19 10:53:51,027 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=bfe0e9384ea435498bea2232dc5c43aa, ASSIGN}] 2023-11-19 10:53:51,029 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=bfe0e9384ea435498bea2232dc5c43aa, ASSIGN 2023-11-19 10:53:51,030 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=bfe0e9384ea435498bea2232dc5c43aa, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46035,1700391201579; forceNewPlan=false, retain=false 2023-11-19 10:53:51,181 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=bfe0e9384ea435498bea2232dc5c43aa, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:51,182 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithWeeklyPolicy,,1700391230188.bfe0e9384ea435498bea2232dc5c43aa.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1700391231181"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700391231181"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700391231181"}]},"ts":"1700391231181"} 2023-11-19 10:53:51,184 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure bfe0e9384ea435498bea2232dc5c43aa, server=jenkins-hbase4.apache.org,46035,1700391201579}] 2023-11-19 10:53:51,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-19 10:53:51,336 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:51,339 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMinorCompactionWithWeeklyPolicy,,1700391230188.bfe0e9384ea435498bea2232dc5c43aa. 2023-11-19 10:53:51,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bfe0e9384ea435498bea2232dc5c43aa, NAME => 'testMinorCompactionWithWeeklyPolicy,,1700391230188.bfe0e9384ea435498bea2232dc5c43aa.', STARTKEY => '', ENDKEY => ''} 2023-11-19 10:53:51,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithWeeklyPolicy bfe0e9384ea435498bea2232dc5c43aa 2023-11-19 10:53:51,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1700391230188.bfe0e9384ea435498bea2232dc5c43aa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-19 10:53:51,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for bfe0e9384ea435498bea2232dc5c43aa 2023-11-19 10:53:51,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for bfe0e9384ea435498bea2232dc5c43aa 2023-11-19 10:53:51,341 INFO [StoreOpener-bfe0e9384ea435498bea2232dc5c43aa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region bfe0e9384ea435498bea2232dc5c43aa 2023-11-19 10:53:51,343 DEBUG [StoreOpener-bfe0e9384ea435498bea2232dc5c43aa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1 2023-11-19 10:53:51,343 DEBUG [StoreOpener-bfe0e9384ea435498bea2232dc5c43aa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1 2023-11-19 10:53:51,343 INFO [StoreOpener-bfe0e9384ea435498bea2232dc5c43aa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bfe0e9384ea435498bea2232dc5c43aa columnFamilyName family1 2023-11-19 10:53:51,345 INFO [StoreOpener-bfe0e9384ea435498bea2232dc5c43aa-1] regionserver.HStore(310): Store=bfe0e9384ea435498bea2232dc5c43aa/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-19 10:53:51,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa 2023-11-19 10:53:51,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa 2023-11-19 10:53:51,348 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for bfe0e9384ea435498bea2232dc5c43aa 2023-11-19 10:53:51,350 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-19 10:53:51,351 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened bfe0e9384ea435498bea2232dc5c43aa; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63879223, jitterRate=-0.04812540113925934}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-19 10:53:51,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for bfe0e9384ea435498bea2232dc5c43aa: 2023-11-19 10:53:51,352 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMinorCompactionWithWeeklyPolicy,,1700391230188.bfe0e9384ea435498bea2232dc5c43aa., pid=25, masterSystemTime=1700391231336 2023-11-19 10:53:51,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMinorCompactionWithWeeklyPolicy,,1700391230188.bfe0e9384ea435498bea2232dc5c43aa. 2023-11-19 10:53:51,353 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMinorCompactionWithWeeklyPolicy,,1700391230188.bfe0e9384ea435498bea2232dc5c43aa. 2023-11-19 10:53:51,354 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=bfe0e9384ea435498bea2232dc5c43aa, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:51,354 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithWeeklyPolicy,,1700391230188.bfe0e9384ea435498bea2232dc5c43aa.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1700391231354"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700391231354"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700391231354"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700391231354"}]},"ts":"1700391231354"} 2023-11-19 10:53:51,358 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=24 2023-11-19 10:53:51,358 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure bfe0e9384ea435498bea2232dc5c43aa, server=jenkins-hbase4.apache.org,46035,1700391201579 in 172 msec 2023-11-19 10:53:51,360 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=23 2023-11-19 10:53:51,361 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=23, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=bfe0e9384ea435498bea2232dc5c43aa, ASSIGN in 331 msec 2023-11-19 10:53:51,361 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-19 10:53:51,361 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700391231361"}]},"ts":"1700391231361"} 2023-11-19 10:53:51,363 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-11-19 10:53:51,365 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-19 10:53:51,367 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=23, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy in 1.1770 sec 2023-11-19 10:53:52,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-19 10:53:52,298 INFO [Listener at localhost/42675] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithWeeklyPolicy, procId: 23 completed 2023-11-19 10:53:52,353 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:53:52,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:52,357 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-19 10:53:52,357 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:53:52,357 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-19 10:53:52,358 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-19 10:53:52,358 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:52,358 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:52,360 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:53:52,360 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:52,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:53:52,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:53:52,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:52,361 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:52,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:53:52,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:52,361 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:52,362 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:53:52,362 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:52,363 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:52,363 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-19 10:53:52,363 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:53:52,363 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-19 10:53:52,363 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-19 10:53:52,363 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:53:52,363 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700391230188.bfe0e9384ea435498bea2232dc5c43aa. 2023-11-19 10:53:52,364 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700391230188.bfe0e9384ea435498bea2232dc5c43aa. started... 2023-11-19 10:53:52,365 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing bfe0e9384ea435498bea2232dc5c43aa 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-19 10:53:52,387 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130751b43f8afbe47b68e21b8d85a0ccf29 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151130751b43f8afbe47b68e21b8d85a0ccf29 2023-11-19 10:53:52,791 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/.tmp/family1/0c201f8d34e94d1d8167dec3e5795f90 2023-11-19 10:53:52,797 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/.tmp/family1/0c201f8d34e94d1d8167dec3e5795f90 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/0c201f8d34e94d1d8167dec3e5795f90 2023-11-19 10:53:52,801 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/0c201f8d34e94d1d8167dec3e5795f90, entries=1000, sequenceid=5, filesize=165.1 K 2023-11-19 10:53:52,802 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for bfe0e9384ea435498bea2232dc5c43aa in 437ms, sequenceid=5, compaction requested=false 2023-11-19 10:53:52,802 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithWeeklyPolicy' 2023-11-19 10:53:52,803 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for bfe0e9384ea435498bea2232dc5c43aa: 2023-11-19 10:53:52,803 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700391230188.bfe0e9384ea435498bea2232dc5c43aa. 2023-11-19 10:53:52,803 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-19 10:53:52,803 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-19 10:53:52,803 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:52,803 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-19 10:53:52,803 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-19 10:53:52,805 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:52,805 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:52,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:52,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:52,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:52,805 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:52,805 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:53:52,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:52,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:52,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:52,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:52,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:52,807 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-19 10:53:52,807 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5f6bc07e[Count = 0] remaining members to acquire global barrier 2023-11-19 10:53:52,807 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-19 10:53:52,807 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:52,808 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:52,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:52,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:52,809 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-19 10:53:52,809 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-19 10:53:52,809 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:52,809 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:53:52,809 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:53:52,812 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:52,812 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-19 10:53:52,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:52,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:52,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:52,812 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:53:52,812 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-19 10:53:52,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:52,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:52,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:52,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:52,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:52,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:52,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:52,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:53:52,815 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-19 10:53:52,815 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-19 10:53:52,815 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:53:52,815 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:53:52,815 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:52,815 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:53:52,817 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:52,817 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:52,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:52,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:52,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:52,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:52,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:52,817 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:53:52,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:52,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:53:52,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:53:52,817 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:52,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:52,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:52,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:52,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:52,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:52,819 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:52,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:52,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:52,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:52,822 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:53:52,822 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:52,822 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-19 10:53:52,822 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:53:52,822 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:52,822 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:52,822 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:52,822 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:52,822 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:52,822 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:52,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:53:52,822 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-19 10:53:52,822 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:53:52,822 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:53:52,822 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:53:52,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:53:52,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:53:52,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:53:52,923 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:53:52,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:53:52,928 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:53:52,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-19 10:53:52,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:52,930 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-19 10:53:52,930 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:53:52,930 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-19 10:53:52,930 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-19 10:53:52,930 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:52,931 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:52,932 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:52,932 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:53:52,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:53:52,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:53:52,932 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:52,932 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:53:52,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:52,933 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:52,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:53:52,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:52,933 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:52,933 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-19 10:53:52,933 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:52,933 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-19 10:53:52,933 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:53:52,933 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-19 10:53:52,934 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-19 10:53:52,934 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:53:52,934 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700391230188.bfe0e9384ea435498bea2232dc5c43aa. 2023-11-19 10:53:52,934 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700391230188.bfe0e9384ea435498bea2232dc5c43aa. started... 2023-11-19 10:53:52,934 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing bfe0e9384ea435498bea2232dc5c43aa 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-19 10:53:52,946 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511284ab0154feb8949efa3ec813bd00bea7f to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201511284ab0154feb8949efa3ec813bd00bea7f 2023-11-19 10:53:53,351 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/.tmp/family1/8cbc1e760364452caa52b9a60bca97b3 2023-11-19 10:53:53,358 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/.tmp/family1/8cbc1e760364452caa52b9a60bca97b3 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/8cbc1e760364452caa52b9a60bca97b3 2023-11-19 10:53:53,364 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/8cbc1e760364452caa52b9a60bca97b3, entries=1, sequenceid=9, filesize=5.0 K 2023-11-19 10:53:53,370 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for bfe0e9384ea435498bea2232dc5c43aa in 436ms, sequenceid=9, compaction requested=false 2023-11-19 10:53:53,370 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for bfe0e9384ea435498bea2232dc5c43aa: 2023-11-19 10:53:53,371 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700391230188.bfe0e9384ea435498bea2232dc5c43aa. 2023-11-19 10:53:53,371 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-19 10:53:53,371 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-19 10:53:53,371 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:53,371 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-19 10:53:53,371 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-19 10:53:53,380 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:53,380 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:53,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:53,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:53,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:53,380 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:53,380 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:53:53,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:53,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:53,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:53,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:53,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:53,382 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-19 10:53:53,382 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-19 10:53:53,382 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1ae66917[Count = 0] remaining members to acquire global barrier 2023-11-19 10:53:53,382 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:53,383 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:53,383 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:53,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:53,384 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-19 10:53:53,384 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-19 10:53:53,384 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:53:53,384 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:53,384 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:53:53,385 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-19 10:53:53,385 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:53,385 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:53:53,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:53,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:53,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:53,385 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-19 10:53:53,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:53,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:53,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:53,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:53,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:53,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:53,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:53,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:53:53,389 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-19 10:53:53,389 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-19 10:53:53,389 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:53:53,389 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:53:53,389 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:53,389 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:53:53,391 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:53,391 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:53:53,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:53,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:53,391 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:53,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:53,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:53,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:53,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:53:53,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:53:53,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:53,391 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:53,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:53,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:53,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:53,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:53,393 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:53,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:53,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:53,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:53,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:53,398 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:53,398 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:53,398 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:53,398 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:53,398 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:53,398 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:53,398 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-19 10:53:53,398 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:53:53,398 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:53:53,398 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:53:53,398 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:53:53,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:53:53,398 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:53:53,398 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-19 10:53:53,398 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:53,398 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-19 10:53:53,398 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:53:53,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:53:53,398 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:53:53,499 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:53:53,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:53:53,504 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:53:53,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-19 10:53:53,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:53,506 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-19 10:53:53,506 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:53:53,506 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-19 10:53:53,506 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-19 10:53:53,506 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:53,506 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:53,508 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:53,508 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:53:53,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:53:53,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:53:53,508 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:53,508 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:53:53,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:53,509 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:53,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:53:53,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:53,509 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:53,509 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-19 10:53:53,509 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:53,509 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-19 10:53:53,509 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:53:53,509 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-19 10:53:53,510 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-19 10:53:53,510 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:53:53,510 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700391230188.bfe0e9384ea435498bea2232dc5c43aa. 2023-11-19 10:53:53,510 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700391230188.bfe0e9384ea435498bea2232dc5c43aa. started... 2023-11-19 10:53:53,510 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing bfe0e9384ea435498bea2232dc5c43aa 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-19 10:53:53,924 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201cb57f045c5144039af9f025d1d07c986 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201cb57f045c5144039af9f025d1d07c986 2023-11-19 10:53:54,329 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/.tmp/family1/fb8be6933ba5463c9230fe46929e9cb3 2023-11-19 10:53:54,335 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/.tmp/family1/fb8be6933ba5463c9230fe46929e9cb3 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/fb8be6933ba5463c9230fe46929e9cb3 2023-11-19 10:53:54,340 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/fb8be6933ba5463c9230fe46929e9cb3, entries=1, sequenceid=13, filesize=4.9 K 2023-11-19 10:53:54,341 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for bfe0e9384ea435498bea2232dc5c43aa in 831ms, sequenceid=13, compaction requested=true 2023-11-19 10:53:54,341 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for bfe0e9384ea435498bea2232dc5c43aa: 2023-11-19 10:53:54,341 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700391230188.bfe0e9384ea435498bea2232dc5c43aa. 2023-11-19 10:53:54,341 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-19 10:53:54,341 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-19 10:53:54,341 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:54,341 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-19 10:53:54,341 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-19 10:53:54,343 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:54,343 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:54,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:54,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:54,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:54,343 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:54,343 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:53:54,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:54,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:54,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:54,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:54,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:54,345 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-19 10:53:54,345 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1116ff8b[Count = 0] remaining members to acquire global barrier 2023-11-19 10:53:54,345 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-19 10:53:54,345 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:54,347 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:54,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:54,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:54,347 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-19 10:53:54,347 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-19 10:53:54,347 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:53:54,347 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:54,347 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:53:54,348 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:54,348 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-19 10:53:54,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:54,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:54,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:54,349 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:53:54,349 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-19 10:53:54,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:54,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:54,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:54,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:54,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:54,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:54,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:54,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:53:54,351 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-19 10:53:54,351 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-19 10:53:54,351 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:53:54,351 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:53:54,351 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:54,351 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:53:54,353 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:54,353 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:54,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:54,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:54,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:54,353 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:53:54,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:54,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:54,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:53:54,354 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:54,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:53:54,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:54,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:54,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:54,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:54,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:54,355 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:54,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:54,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:54,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:54,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:54,357 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:54,357 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:54,358 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:54,358 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:53:54,358 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:53:54,358 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-19 10:53:54,358 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:53:54,358 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:54,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:53:54,358 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:54,358 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-19 10:53:54,358 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:53:54,358 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:54,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:53:54,358 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:54,358 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-19 10:53:54,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:53:54,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:53:54,358 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:53:54,459 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:53:54,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:53:54,463 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:53:54,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-19 10:53:54,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:54,465 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-19 10:53:54,465 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:53:54,465 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-19 10:53:54,465 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-19 10:53:54,466 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:54,466 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:54,467 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:54,467 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:53:54,467 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:53:54,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:53:54,467 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:54,467 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:53:54,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:54,468 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:54,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:53:54,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:54,468 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:54,468 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-19 10:53:54,468 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:54,468 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-19 10:53:54,468 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:53:54,468 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-19 10:53:54,469 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-19 10:53:54,469 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:53:54,469 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700391230188.bfe0e9384ea435498bea2232dc5c43aa. 2023-11-19 10:53:54,469 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700391230188.bfe0e9384ea435498bea2232dc5c43aa. started... 2023-11-19 10:53:54,469 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing bfe0e9384ea435498bea2232dc5c43aa 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-19 10:53:54,884 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205d1f3841033dd4923ae5cf81ca6b3fdf6 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205d1f3841033dd4923ae5cf81ca6b3fdf6 2023-11-19 10:53:55,290 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/.tmp/family1/39d8f80effe1485d8a3c9377811de99d 2023-11-19 10:53:55,296 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/.tmp/family1/39d8f80effe1485d8a3c9377811de99d as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/39d8f80effe1485d8a3c9377811de99d 2023-11-19 10:53:55,300 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/39d8f80effe1485d8a3c9377811de99d, entries=1, sequenceid=17, filesize=4.9 K 2023-11-19 10:53:55,301 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for bfe0e9384ea435498bea2232dc5c43aa in 832ms, sequenceid=17, compaction requested=true 2023-11-19 10:53:55,301 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for bfe0e9384ea435498bea2232dc5c43aa: 2023-11-19 10:53:55,301 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700391230188.bfe0e9384ea435498bea2232dc5c43aa. 2023-11-19 10:53:55,302 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-19 10:53:55,302 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-19 10:53:55,302 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:55,302 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-19 10:53:55,302 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-19 10:53:55,304 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:55,304 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:55,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:55,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:55,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:55,305 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:55,305 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:53:55,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:55,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:55,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:55,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:55,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:55,306 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-19 10:53:55,306 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@556a36c1[Count = 0] remaining members to acquire global barrier 2023-11-19 10:53:55,306 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-19 10:53:55,306 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:55,307 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:55,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:55,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:55,307 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-19 10:53:55,307 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-19 10:53:55,307 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:53:55,307 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:55,308 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:53:55,309 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:55,309 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-19 10:53:55,309 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:53:55,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:55,309 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-19 10:53:55,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:55,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:55,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:55,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:55,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:55,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:55,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:55,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:55,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:55,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:53:55,311 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-19 10:53:55,311 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-19 10:53:55,311 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:53:55,311 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:53:55,311 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:55,311 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:53:55,313 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:55,313 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:55,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:55,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:55,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:55,313 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:53:55,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:55,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:55,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:55,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:53:55,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:53:55,314 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:55,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:55,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:55,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:55,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:55,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:55,315 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:55,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:55,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:55,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:55,321 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:55,321 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:53:55,321 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:55,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:53:55,321 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-19 10:53:55,321 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:53:55,321 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:53:55,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:53:55,321 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:53:55,321 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:55,321 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:55,321 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:55,321 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-19 10:53:55,321 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:53:55,321 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:55,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:53:55,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:53:55,321 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:55,421 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:53:55,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:53:55,427 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:53:55,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-19 10:53:55,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:55,428 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-19 10:53:55,429 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:53:55,429 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-19 10:53:55,429 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-19 10:53:55,429 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:55,429 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:55,430 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:55,430 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:53:55,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:53:55,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:53:55,431 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:55,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:55,431 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:53:55,431 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:55,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:53:55,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:55,432 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:55,432 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-19 10:53:55,432 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:55,432 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-19 10:53:55,432 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:53:55,432 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-19 10:53:55,432 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-19 10:53:55,432 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:53:55,432 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700391230188.bfe0e9384ea435498bea2232dc5c43aa. 2023-11-19 10:53:55,432 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700391230188.bfe0e9384ea435498bea2232dc5c43aa. started... 2023-11-19 10:53:55,433 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing bfe0e9384ea435498bea2232dc5c43aa 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-19 10:53:55,846 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228f8d4a9c47e7c426e8e6d43d9de023532 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228f8d4a9c47e7c426e8e6d43d9de023532 2023-11-19 10:53:56,252 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/.tmp/family1/73adfdf2cb654d7b823287f8fbe3c0a1 2023-11-19 10:53:56,257 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/.tmp/family1/73adfdf2cb654d7b823287f8fbe3c0a1 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/73adfdf2cb654d7b823287f8fbe3c0a1 2023-11-19 10:53:56,263 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/73adfdf2cb654d7b823287f8fbe3c0a1, entries=1, sequenceid=21, filesize=4.9 K 2023-11-19 10:53:56,264 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for bfe0e9384ea435498bea2232dc5c43aa in 831ms, sequenceid=21, compaction requested=true 2023-11-19 10:53:56,264 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for bfe0e9384ea435498bea2232dc5c43aa: 2023-11-19 10:53:56,264 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700391230188.bfe0e9384ea435498bea2232dc5c43aa. 2023-11-19 10:53:56,264 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-19 10:53:56,264 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-19 10:53:56,264 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:56,264 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-19 10:53:56,264 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-19 10:53:56,266 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:56,266 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:56,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:56,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:56,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:56,266 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:56,266 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:53:56,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:56,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:56,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:56,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:56,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:56,268 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-19 10:53:56,268 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@54837422[Count = 0] remaining members to acquire global barrier 2023-11-19 10:53:56,268 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-19 10:53:56,268 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:56,274 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:56,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:56,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:56,274 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-19 10:53:56,274 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-19 10:53:56,274 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:53:56,274 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:56,274 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:53:56,276 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-19 10:53:56,276 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:56,276 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:53:56,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:56,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:56,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:56,276 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-19 10:53:56,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:56,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:56,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:56,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:56,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:56,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:56,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:56,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:53:56,278 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-19 10:53:56,278 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-19 10:53:56,278 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:53:56,278 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:53:56,278 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:56,278 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:53:56,280 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:56,280 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:56,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:56,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:56,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:56,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:56,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:56,280 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:53:56,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:53:56,281 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:56,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:56,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:53:56,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:56,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:56,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:56,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:56,282 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:56,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:56,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:56,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:56,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:56,284 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:56,284 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:56,284 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:56,285 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:56,285 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:53:56,285 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:53:56,285 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-19 10:53:56,285 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:56,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:53:56,285 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:56,285 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-19 10:53:56,285 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:53:56,285 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:53:56,285 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:56,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:53:56,285 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-19 10:53:56,285 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:53:56,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:53:56,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:53:56,385 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:53:56,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:53:56,390 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:53:56,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-19 10:53:56,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:56,392 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-19 10:53:56,392 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:53:56,392 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-19 10:53:56,392 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-19 10:53:56,393 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:56,393 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:56,395 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:53:56,395 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:56,395 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:53:56,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:53:56,396 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:56,396 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:53:56,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:56,396 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:56,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:53:56,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:56,397 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:56,397 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-19 10:53:56,397 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:56,397 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-19 10:53:56,397 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:53:56,397 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-19 10:53:56,397 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-19 10:53:56,397 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:53:56,397 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700391230188.bfe0e9384ea435498bea2232dc5c43aa. 2023-11-19 10:53:56,397 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700391230188.bfe0e9384ea435498bea2232dc5c43aa. started... 2023-11-19 10:53:56,397 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing bfe0e9384ea435498bea2232dc5c43aa 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-19 10:53:56,811 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123169d80a69eaf445b08356548cd47a1186 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015123169d80a69eaf445b08356548cd47a1186 2023-11-19 10:53:56,873 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-19 10:53:57,217 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/.tmp/family1/021d6f575c784fe49455c07b1a20d970 2023-11-19 10:53:57,222 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/.tmp/family1/021d6f575c784fe49455c07b1a20d970 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/021d6f575c784fe49455c07b1a20d970 2023-11-19 10:53:57,227 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/021d6f575c784fe49455c07b1a20d970, entries=1, sequenceid=25, filesize=4.9 K 2023-11-19 10:53:57,227 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for bfe0e9384ea435498bea2232dc5c43aa in 830ms, sequenceid=25, compaction requested=true 2023-11-19 10:53:57,228 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for bfe0e9384ea435498bea2232dc5c43aa: 2023-11-19 10:53:57,228 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700391230188.bfe0e9384ea435498bea2232dc5c43aa. 2023-11-19 10:53:57,228 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-19 10:53:57,228 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-19 10:53:57,228 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:57,228 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-19 10:53:57,228 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-19 10:53:57,230 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:57,230 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:57,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:57,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:57,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:57,230 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:57,230 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:53:57,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:57,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:57,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:57,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:57,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:57,232 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-19 10:53:57,232 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7d040174[Count = 0] remaining members to acquire global barrier 2023-11-19 10:53:57,232 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-19 10:53:57,232 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:57,233 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:57,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:57,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:57,234 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-19 10:53:57,234 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-19 10:53:57,234 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:57,234 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:53:57,234 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:53:57,235 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:57,235 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-19 10:53:57,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:57,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:57,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:57,236 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:53:57,236 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-19 10:53:57,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:57,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:57,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:57,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:57,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:57,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:57,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:57,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:53:57,238 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-19 10:53:57,238 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-19 10:53:57,238 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:53:57,238 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:53:57,238 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:57,238 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:53:57,245 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:57,245 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:57,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:57,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:57,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:57,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:57,246 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:53:57,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:57,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:57,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:53:57,246 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:57,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:53:57,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:57,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:57,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:57,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:57,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:57,248 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:57,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:57,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:57,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:57,250 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:57,250 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:57,250 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:53:57,250 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:57,250 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:53:57,250 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-19 10:53:57,250 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:53:57,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:53:57,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:53:57,250 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:57,250 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:53:57,250 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-19 10:53:57,251 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:53:57,250 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:57,251 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:57,251 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:57,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:53:57,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:53:57,351 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:53:57,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:53:57,356 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:53:57,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-19 10:53:57,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:57,357 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-19 10:53:57,357 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:53:57,357 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-19 10:53:57,358 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-19 10:53:57,358 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:57,358 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:57,359 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:53:57,359 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:57,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:53:57,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:53:57,360 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:57,360 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:53:57,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:57,360 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:57,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:53:57,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:57,360 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:57,361 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-19 10:53:57,361 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:57,361 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-19 10:53:57,361 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:53:57,361 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-19 10:53:57,361 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-19 10:53:57,361 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:53:57,361 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700391230188.bfe0e9384ea435498bea2232dc5c43aa. 2023-11-19 10:53:57,361 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700391230188.bfe0e9384ea435498bea2232dc5c43aa. started... 2023-11-19 10:53:57,361 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing bfe0e9384ea435498bea2232dc5c43aa 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-19 10:53:57,775 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101617d64482ac04b3e96a8820ae041f9fe to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101617d64482ac04b3e96a8820ae041f9fe 2023-11-19 10:53:58,181 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/.tmp/family1/84b40ca7744e44e884d4b63d6bb32898 2023-11-19 10:53:58,187 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/.tmp/family1/84b40ca7744e44e884d4b63d6bb32898 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/84b40ca7744e44e884d4b63d6bb32898 2023-11-19 10:53:58,191 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/84b40ca7744e44e884d4b63d6bb32898, entries=1, sequenceid=29, filesize=4.9 K 2023-11-19 10:53:58,192 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for bfe0e9384ea435498bea2232dc5c43aa in 831ms, sequenceid=29, compaction requested=true 2023-11-19 10:53:58,192 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for bfe0e9384ea435498bea2232dc5c43aa: 2023-11-19 10:53:58,192 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700391230188.bfe0e9384ea435498bea2232dc5c43aa. 2023-11-19 10:53:58,192 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-19 10:53:58,192 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-19 10:53:58,192 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:58,192 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-19 10:53:58,192 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-19 10:53:58,194 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:58,194 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:58,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:58,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:58,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:58,195 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:58,195 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:53:58,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:58,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:58,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:58,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:58,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:58,196 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-19 10:53:58,196 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5bc843f8[Count = 0] remaining members to acquire global barrier 2023-11-19 10:53:58,196 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-19 10:53:58,196 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:58,197 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:58,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:58,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:58,197 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-19 10:53:58,197 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-19 10:53:58,197 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:53:58,198 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:58,198 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:53:58,199 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:58,199 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-19 10:53:58,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:58,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:58,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:58,200 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:53:58,200 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-19 10:53:58,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:58,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:58,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:58,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:58,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:58,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:58,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:58,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:53:58,202 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-19 10:53:58,202 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-19 10:53:58,202 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:53:58,202 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:53:58,202 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:58,202 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:53:58,206 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:58,207 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:58,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:58,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:58,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:58,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:58,207 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:53:58,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:58,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:58,207 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:58,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:53:58,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:53:58,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:58,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:58,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:58,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:58,208 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:58,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:58,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:58,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:58,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:58,211 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:58,211 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:58,211 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:53:58,211 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:58,211 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:53:58,211 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:58,211 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:53:58,211 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-19 10:53:58,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:53:58,211 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-19 10:53:58,211 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:53:58,211 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:58,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:53:58,211 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:58,211 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:58,211 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-19 10:53:58,211 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:53:58,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:53:58,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:53:58,312 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:53:58,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:53:58,317 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:53:58,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-19 10:53:58,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:58,318 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-19 10:53:58,318 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:53:58,318 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-19 10:53:58,318 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-19 10:53:58,319 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:58,319 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:58,320 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:58,320 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:53:58,320 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:53:58,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:53:58,321 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:58,321 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:53:58,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:58,321 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:58,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:53:58,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:58,321 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:58,322 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-19 10:53:58,322 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:58,322 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-19 10:53:58,322 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:53:58,322 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-19 10:53:58,322 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-19 10:53:58,322 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:53:58,322 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700391230188.bfe0e9384ea435498bea2232dc5c43aa. 2023-11-19 10:53:58,322 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700391230188.bfe0e9384ea435498bea2232dc5c43aa. started... 2023-11-19 10:53:58,322 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing bfe0e9384ea435498bea2232dc5c43aa 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-19 10:53:58,735 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103085779e75ded4b45859ba9172610dca6 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103085779e75ded4b45859ba9172610dca6 2023-11-19 10:53:59,140 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/.tmp/family1/9ada46865f784ff3bb5487e6d2868c2a 2023-11-19 10:53:59,146 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/.tmp/family1/9ada46865f784ff3bb5487e6d2868c2a as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/9ada46865f784ff3bb5487e6d2868c2a 2023-11-19 10:53:59,150 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/9ada46865f784ff3bb5487e6d2868c2a, entries=1, sequenceid=33, filesize=4.9 K 2023-11-19 10:53:59,151 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for bfe0e9384ea435498bea2232dc5c43aa in 829ms, sequenceid=33, compaction requested=true 2023-11-19 10:53:59,151 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for bfe0e9384ea435498bea2232dc5c43aa: 2023-11-19 10:53:59,151 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700391230188.bfe0e9384ea435498bea2232dc5c43aa. 2023-11-19 10:53:59,151 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-19 10:53:59,152 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-19 10:53:59,152 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:59,152 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-19 10:53:59,152 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-19 10:53:59,154 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:59,154 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:59,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:59,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:59,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:59,155 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:59,155 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:53:59,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:59,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:59,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:59,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:59,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:59,156 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-19 10:53:59,156 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5f90aa7e[Count = 0] remaining members to acquire global barrier 2023-11-19 10:53:59,156 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-19 10:53:59,156 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:59,157 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:59,157 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:59,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:59,157 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-19 10:53:59,158 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-19 10:53:59,158 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:53:59,158 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:59,158 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:53:59,159 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-19 10:53:59,159 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:53:59,159 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:59,159 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-19 10:53:59,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:59,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:59,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:59,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:59,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:59,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:59,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:59,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:59,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:59,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:59,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:53:59,162 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-19 10:53:59,162 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-19 10:53:59,162 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:53:59,162 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:53:59,162 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:59,162 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:53:59,163 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:59,163 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:59,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:59,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:59,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:53:59,164 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:53:59,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:53:59,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:59,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:53:59,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:53:59,164 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:59,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:53:59,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:59,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:59,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:53:59,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:59,165 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:59,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:59,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:53:59,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:59,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:59,168 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:59,168 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:59,168 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:53:59,168 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:59,168 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:53:59,168 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-19 10:53:59,169 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:53:59,168 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:59,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:53:59,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:53:59,168 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:53:59,169 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:59,169 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-19 10:53:59,169 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-19 10:53:59,169 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:59,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:53:59,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:53:59,169 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:59,169 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:53:59,269 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:53:59,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:53:59,274 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:53:59,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-19 10:53:59,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:59,276 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-19 10:53:59,276 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:53:59,276 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-19 10:53:59,276 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-19 10:53:59,276 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:59,276 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:59,278 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:53:59,278 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:59,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:53:59,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:53:59,278 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:53:59,278 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:53:59,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:59,279 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:59,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:53:59,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:59,279 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:59,279 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-19 10:53:59,279 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-19 10:53:59,279 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-19 10:53:59,279 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:53:59,279 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-19 10:53:59,279 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-19 10:53:59,280 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:53:59,280 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700391230188.bfe0e9384ea435498bea2232dc5c43aa. 2023-11-19 10:53:59,280 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700391230188.bfe0e9384ea435498bea2232dc5c43aa. started... 2023-11-19 10:53:59,280 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing bfe0e9384ea435498bea2232dc5c43aa 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-19 10:53:59,693 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509073adab2c921664375b12b524aeccb519c to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201509073adab2c921664375b12b524aeccb519c 2023-11-19 10:54:00,098 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/.tmp/family1/34b4f9fc95d3487d9094ad83b0fa589a 2023-11-19 10:54:00,104 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/.tmp/family1/34b4f9fc95d3487d9094ad83b0fa589a as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/34b4f9fc95d3487d9094ad83b0fa589a 2023-11-19 10:54:00,108 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/34b4f9fc95d3487d9094ad83b0fa589a, entries=1, sequenceid=37, filesize=4.9 K 2023-11-19 10:54:00,110 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for bfe0e9384ea435498bea2232dc5c43aa in 829ms, sequenceid=37, compaction requested=true 2023-11-19 10:54:00,110 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for bfe0e9384ea435498bea2232dc5c43aa: 2023-11-19 10:54:00,110 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700391230188.bfe0e9384ea435498bea2232dc5c43aa. 2023-11-19 10:54:00,110 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-19 10:54:00,110 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-19 10:54:00,110 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:00,110 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-19 10:54:00,110 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-19 10:54:00,112 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:00,112 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:54:00,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:00,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:00,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:00,112 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:54:00,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:00,112 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:54:00,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:00,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-19 10:54:00,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:00,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:00,114 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-19 10:54:00,114 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@10fdf7ca[Count = 0] remaining members to acquire global barrier 2023-11-19 10:54:00,114 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-19 10:54:00,114 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:54:00,115 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:54:00,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:54:00,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:54:00,115 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-19 10:54:00,115 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-19 10:54:00,115 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:54:00,115 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:00,115 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:54:00,117 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:00,117 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-19 10:54:00,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:00,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:00,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:00,117 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:54:00,117 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-19 10:54:00,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:00,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:00,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-19 10:54:00,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:00,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:00,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-19 10:54:00,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:00,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:54:00,120 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-19 10:54:00,120 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-19 10:54:00,120 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:54:00,120 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:54:00,120 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-19 10:54:00,120 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:54:00,122 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:54:00,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:54:00,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:00,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:00,122 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:54:00,122 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:54:00,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:54:00,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:54:00,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:00,123 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:00,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:54:00,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:54:00,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-19 10:54:00,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:54:00,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:00,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-19 10:54:00,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:00,124 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:00,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:00,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-19 10:54:00,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:00,127 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:00,127 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:54:00,127 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:54:00,127 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:54:00,127 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:54:00,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:54:00,127 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:54:00,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:54:00,127 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-19 10:54:00,127 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:54:00,127 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:00,127 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:54:00,127 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:54:00,127 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:54:00,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:54:00,127 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-19 10:54:00,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:54:00,127 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:54:00,228 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:54:00,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:54:00,233 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:54:00,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-19 10:54:00,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-19 10:54:00,234 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-19 10:54:00,234 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:54:00,234 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-19 10:54:00,234 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-19 10:54:00,235 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:54:00,235 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:54:00,236 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:00,236 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:54:00,236 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:54:00,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:54:00,236 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:00,236 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:54:00,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:54:00,237 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:54:00,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:54:00,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:54:00,237 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-19 10:54:00,237 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-19 10:54:00,237 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-19 10:54:00,238 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-19 10:54:00,238 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:54:00,238 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-19 10:54:00,238 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-19 10:54:00,238 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:54:00,238 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700391230188.bfe0e9384ea435498bea2232dc5c43aa. 2023-11-19 10:54:00,238 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700391230188.bfe0e9384ea435498bea2232dc5c43aa. started... 2023-11-19 10:54:00,238 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing bfe0e9384ea435498bea2232dc5c43aa 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-19 10:54:00,651 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112007b12d6aefec400699aaad780f2af037 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015112007b12d6aefec400699aaad780f2af037 2023-11-19 10:54:01,057 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/.tmp/family1/c6c2aedf939a47c9adfb11d4c148053c 2023-11-19 10:54:01,063 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/.tmp/family1/c6c2aedf939a47c9adfb11d4c148053c as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/c6c2aedf939a47c9adfb11d4c148053c 2023-11-19 10:54:01,067 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/c6c2aedf939a47c9adfb11d4c148053c, entries=1, sequenceid=41, filesize=4.9 K 2023-11-19 10:54:01,068 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for bfe0e9384ea435498bea2232dc5c43aa in 830ms, sequenceid=41, compaction requested=true 2023-11-19 10:54:01,068 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for bfe0e9384ea435498bea2232dc5c43aa: 2023-11-19 10:54:01,068 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700391230188.bfe0e9384ea435498bea2232dc5c43aa. 2023-11-19 10:54:01,068 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-19 10:54:01,068 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-19 10:54:01,068 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:01,068 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-19 10:54:01,068 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-19 10:54:01,071 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:01,071 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:54:01,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:01,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:01,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:01,071 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:54:01,071 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:54:01,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:01,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:01,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-19 10:54:01,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:01,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:01,072 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-19 10:54:01,072 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4daf4b00[Count = 0] remaining members to acquire global barrier 2023-11-19 10:54:01,072 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-19 10:54:01,073 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:54:01,076 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:54:01,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:54:01,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:54:01,077 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-19 10:54:01,077 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-19 10:54:01,077 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:54:01,077 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:01,077 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:54:01,078 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:01,078 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-19 10:54:01,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:01,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:01,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:01,078 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:54:01,078 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-19 10:54:01,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:01,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:01,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-19 10:54:01,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:01,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:01,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-19 10:54:01,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:01,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:54:01,080 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-19 10:54:01,080 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-19 10:54:01,081 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:54:01,081 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:54:01,081 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-19 10:54:01,081 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:54:01,082 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:54:01,082 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:54:01,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:54:01,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:01,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:01,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:54:01,082 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:54:01,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:54:01,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:01,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:54:01,083 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:01,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:54:01,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-19 10:54:01,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:54:01,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:01,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-19 10:54:01,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:01,084 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:01,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:01,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-19 10:54:01,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:01,087 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:01,087 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:54:01,087 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:54:01,087 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:54:01,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:54:01,087 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:01,087 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:54:01,087 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:54:01,087 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-19 10:54:01,088 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:54:01,087 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:54:01,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:54:01,088 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:54:01,088 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-19 10:54:01,088 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-19 10:54:01,088 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:54:01,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:54:01,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:54:01,188 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:54:01,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:54:01,191 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=33457] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMinorCompactionWithWeeklyPolicy 2023-11-19 10:54:01,192 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-19 10:54:01,193 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-19 10:54:01,194 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-19 10:54:01,194 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=26, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700391841194 2023-11-19 10:54:01,197 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-19 10:54:01,198 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 0 del files, 9 selected files, and 0 irrelevant files table 'testMinorCompactionWithWeeklyPolicy' and column 'family1' 2023-11-19 10:54:01,198 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-19 10:54:01,200 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] zookeeper.ReadOnlyZKClient(139): Connect 0x66bb0515 to 127.0.0.1:60497 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-19 10:54:01,204 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@64d9ea5b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-19 10:54:01,204 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-19 10:54:02,048 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010316a7902f12f6439fbb58f57588ac8569 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2016010316a7902f12f6439fbb58f57588ac8569 2023-11-19 10:54:02,049 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-19 10:54:02,063 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-19 10:54:02,064 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53436, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-19 10:54:02,071 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-19 10:54:02,072 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40702, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-19 10:54:02,082 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/e6135c8e42174a65b733ef56838c42ea first=Optional[r3] last=Optional[r6] 2023-11-19 10:54:02,083 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1700391230188.bfe0e9384ea435498bea2232dc5c43aa., hostname=jenkins-hbase4.apache.org,46035,1700391201579, seqNum=2 for row with hfile group [{family1,hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/e6135c8e42174a65b733ef56838c42ea}] 2023-11-19 10:54:02,087 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(763): Validating hfile at hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/e6135c8e42174a65b733ef56838c42ea for inclusion in bfe0e9384ea435498bea2232dc5c43aa/family1 2023-11-19 10:54:02,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-19 10:54:02,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(777): Region bounds: first= last= 2023-11-19 10:54:02,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegion(2446): Flush status journal for bfe0e9384ea435498bea2232dc5c43aa: 2023-11-19 10:54:02,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/e6135c8e42174a65b733ef56838c42ea to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMinorCompactionWithWeeklyPolicy__nlvl6486apglmk77f9d9n3m0ggle9fne4fvca9bsasablvm7sopm6dgmj9i9s6tr/family1/e6135c8e42174a65b733ef56838c42ea 2023-11-19 10:54:02,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMinorCompactionWithWeeklyPolicy__nlvl6486apglmk77f9d9n3m0ggle9fne4fvca9bsasablvm7sopm6dgmj9i9s6tr/family1/e6135c8e42174a65b733ef56838c42ea as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/2157ead5355d44d9997f998716753a06_SeqId_44_ 2023-11-19 10:54:02,095 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(849): Loaded HFile hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMinorCompactionWithWeeklyPolicy__nlvl6486apglmk77f9d9n3m0ggle9fne4fvca9bsasablvm7sopm6dgmj9i9s6tr/family1/e6135c8e42174a65b733ef56838c42ea into bfe0e9384ea435498bea2232dc5c43aa/family1 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/2157ead5355d44d9997f998716753a06_SeqId_44_ - updating store file list. 2023-11-19 10:54:02,100 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(882): Loaded HFile hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/2157ead5355d44d9997f998716753a06_SeqId_44_ into bfe0e9384ea435498bea2232dc5c43aa/family1 2023-11-19 10:54:02,100 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(855): Successfully loaded hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMinorCompactionWithWeeklyPolicy__nlvl6486apglmk77f9d9n3m0ggle9fne4fvca9bsasablvm7sopm6dgmj9i9s6tr/family1/e6135c8e42174a65b733ef56838c42ea into bfe0e9384ea435498bea2232dc5c43aa/family1 (new location: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/2157ead5355d44d9997f998716753a06_SeqId_44_) 2023-11-19 10:54:02,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMinorCompactionWithWeeklyPolicy__nlvl6486apglmk77f9d9n3m0ggle9fne4fvca9bsasablvm7sopm6dgmj9i9s6tr/family1/e6135c8e42174a65b733ef56838c42ea 2023-11-19 10:54:02,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-19 10:54:02,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-19 10:54:02,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(1912): bfe0e9384ea435498bea2232dc5c43aa/family1 is initiating minor compaction 2023-11-19 10:54:02,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@2d3e9d2a; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-19 10:54:02,105 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of bfe0e9384ea435498bea2232dc5c43aa/family1 in testMinorCompactionWithWeeklyPolicy,,1700391230188.bfe0e9384ea435498bea2232dc5c43aa. 2023-11-19 10:54:02,105 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/8cbc1e760364452caa52b9a60bca97b3, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/fb8be6933ba5463c9230fe46929e9cb3, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/39d8f80effe1485d8a3c9377811de99d, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/73adfdf2cb654d7b823287f8fbe3c0a1, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/021d6f575c784fe49455c07b1a20d970, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/84b40ca7744e44e884d4b63d6bb32898, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/9ada46865f784ff3bb5487e6d2868c2a, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/34b4f9fc95d3487d9094ad83b0fa589a, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/c6c2aedf939a47c9adfb11d4c148053c, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/2157ead5355d44d9997f998716753a06_SeqId_44_] into tmpdir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/.tmp, totalSize=50.0 K 2023-11-19 10:54:02,105 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting 8cbc1e760364452caa52b9a60bca97b3, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-19 10:54:02,105 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting fb8be6933ba5463c9230fe46929e9cb3, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-19 10:54:02,106 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting 39d8f80effe1485d8a3c9377811de99d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-19 10:54:02,106 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting 73adfdf2cb654d7b823287f8fbe3c0a1, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-19 10:54:02,106 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting 021d6f575c784fe49455c07b1a20d970, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-19 10:54:02,106 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting 84b40ca7744e44e884d4b63d6bb32898, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-19 10:54:02,106 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting 9ada46865f784ff3bb5487e6d2868c2a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-19 10:54:02,106 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting 34b4f9fc95d3487d9094ad83b0fa589a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-19 10:54:02,106 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting c6c2aedf939a47c9adfb11d4c148053c, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-19 10:54:02,106 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting 2157ead5355d44d9997f998716753a06_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-19 10:54:02,108 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-19 10:54:02,109 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:54:02,110 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228f8d4a9c47e7c426e8e6d43d9de023532 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228f8d4a9c47e7c426e8e6d43d9de023532 2023-11-19 10:54:02,112 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015123169d80a69eaf445b08356548cd47a1186 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015123169d80a69eaf445b08356548cd47a1186 2023-11-19 10:54:02,113 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101617d64482ac04b3e96a8820ae041f9fe to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101617d64482ac04b3e96a8820ae041f9fe 2023-11-19 10:54:02,114 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103085779e75ded4b45859ba9172610dca6 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103085779e75ded4b45859ba9172610dca6 2023-11-19 10:54:02,114 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-11-19 10:54:02,115 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-19 10:54:02,115 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-19 10:54:02,115 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-19 10:54:02,115 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-19 10:54:02,115 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-19 10:54:02,115 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-19 10:54:02,115 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-19 10:54:02,115 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-19 10:54:02,115 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-19 10:54:02,146 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] throttle.PressureAwareThroughputController(145): bfe0e9384ea435498bea2232dc5c43aa#family1#compaction#34 average throughput is 0.23 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-19 10:54:02,970 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205a5441b1239184fc4a2bb00641620f0e6 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205a5441b1239184fc4a2bb00641620f0e6 2023-11-19 10:54:02,970 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/.tmp/family1/a09ce26d69804fd19b722e6950c29d66 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/a09ce26d69804fd19b722e6950c29d66 2023-11-19 10:54:02,971 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-19 10:54:02,976 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in bfe0e9384ea435498bea2232dc5c43aa/family1 of bfe0e9384ea435498bea2232dc5c43aa into a09ce26d69804fd19b722e6950c29d66(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-19 10:54:02,976 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for bfe0e9384ea435498bea2232dc5c43aa: 2023-11-19 10:54:02,976 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1700391230188.bfe0e9384ea435498bea2232dc5c43aa., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1700391242105; duration=0sec 2023-11-19 10:54:02,977 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-19 10:54:02,996 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/111224190b6141009cad1c67af03b0d5 first=Optional[r1] last=Optional[r2] 2023-11-19 10:54:02,997 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1700391230188.bfe0e9384ea435498bea2232dc5c43aa., hostname=jenkins-hbase4.apache.org,46035,1700391201579, seqNum=2 for row with hfile group [{family1,hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/111224190b6141009cad1c67af03b0d5}] 2023-11-19 10:54:03,000 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(763): Validating hfile at hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/111224190b6141009cad1c67af03b0d5 for inclusion in bfe0e9384ea435498bea2232dc5c43aa/family1 2023-11-19 10:54:03,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-11-19 10:54:03,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(777): Region bounds: first= last= 2023-11-19 10:54:03,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegion(2446): Flush status journal for bfe0e9384ea435498bea2232dc5c43aa: 2023-11-19 10:54:03,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/111224190b6141009cad1c67af03b0d5 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMinorCompactionWithWeeklyPolicy__s8vq36dnbhf62h0i9a417eq51d7m2g13rgsuh8hc0d80b8kli76rrjq0v29vbhih/family1/111224190b6141009cad1c67af03b0d5 2023-11-19 10:54:03,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMinorCompactionWithWeeklyPolicy__s8vq36dnbhf62h0i9a417eq51d7m2g13rgsuh8hc0d80b8kli76rrjq0v29vbhih/family1/111224190b6141009cad1c67af03b0d5 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/af74116840544de1b0d2270361b451cf_SeqId_47_ 2023-11-19 10:54:03,007 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(849): Loaded HFile hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMinorCompactionWithWeeklyPolicy__s8vq36dnbhf62h0i9a417eq51d7m2g13rgsuh8hc0d80b8kli76rrjq0v29vbhih/family1/111224190b6141009cad1c67af03b0d5 into bfe0e9384ea435498bea2232dc5c43aa/family1 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/af74116840544de1b0d2270361b451cf_SeqId_47_ - updating store file list. 2023-11-19 10:54:03,011 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(882): Loaded HFile hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/af74116840544de1b0d2270361b451cf_SeqId_47_ into bfe0e9384ea435498bea2232dc5c43aa/family1 2023-11-19 10:54:03,011 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(855): Successfully loaded hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMinorCompactionWithWeeklyPolicy__s8vq36dnbhf62h0i9a417eq51d7m2g13rgsuh8hc0d80b8kli76rrjq0v29vbhih/family1/111224190b6141009cad1c67af03b0d5 into bfe0e9384ea435498bea2232dc5c43aa/family1 (new location: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/af74116840544de1b0d2270361b451cf_SeqId_47_) 2023-11-19 10:54:03,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMinorCompactionWithWeeklyPolicy__s8vq36dnbhf62h0i9a417eq51d7m2g13rgsuh8hc0d80b8kli76rrjq0v29vbhih/family1/111224190b6141009cad1c67af03b0d5 2023-11-19 10:54:03,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-19 10:54:03,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 181014 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-19 10:54:03,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(1912): bfe0e9384ea435498bea2232dc5c43aa/family1 is initiating minor compaction (all files) 2023-11-19 10:54:03,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@191162c6; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-19 10:54:03,013 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of bfe0e9384ea435498bea2232dc5c43aa/family1 in testMinorCompactionWithWeeklyPolicy,,1700391230188.bfe0e9384ea435498bea2232dc5c43aa. 2023-11-19 10:54:03,013 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/0c201f8d34e94d1d8167dec3e5795f90, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/a09ce26d69804fd19b722e6950c29d66, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/af74116840544de1b0d2270361b451cf_SeqId_47_] into tmpdir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/.tmp, totalSize=176.8 K 2023-11-19 10:54:03,013 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting 0c201f8d34e94d1d8167dec3e5795f90, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878825094 2023-11-19 10:54:03,014 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting a09ce26d69804fd19b722e6950c29d66, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621225094 2023-11-19 10:54:03,015 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting af74116840544de1b0d2270361b451cf_SeqId_47_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965225094 2023-11-19 10:54:03,015 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-19 10:54:03,015 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:54:03,017 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201cb57f045c5144039af9f025d1d07c986 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201cb57f045c5144039af9f025d1d07c986 2023-11-19 10:54:03,018 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205d1f3841033dd4923ae5cf81ca6b3fdf6 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205d1f3841033dd4923ae5cf81ca6b3fdf6 2023-11-19 10:54:03,018 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 2 expired mob files are deleted 2023-11-19 10:54:03,018 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-19 10:54:03,019 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-19 10:54:03,019 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-19 10:54:03,019 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-19 10:54:03,020 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=26, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-19 10:54:03,022 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.8290 sec 2023-11-19 10:54:03,037 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/8cbc1e760364452caa52b9a60bca97b3, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/fb8be6933ba5463c9230fe46929e9cb3, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/39d8f80effe1485d8a3c9377811de99d, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/73adfdf2cb654d7b823287f8fbe3c0a1, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/021d6f575c784fe49455c07b1a20d970, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/84b40ca7744e44e884d4b63d6bb32898, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/9ada46865f784ff3bb5487e6d2868c2a, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/34b4f9fc95d3487d9094ad83b0fa589a, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/c6c2aedf939a47c9adfb11d4c148053c, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/2157ead5355d44d9997f998716753a06_SeqId_44_] to archive 2023-11-19 10:54:03,038 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:54:03,041 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/8cbc1e760364452caa52b9a60bca97b3 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/8cbc1e760364452caa52b9a60bca97b3 2023-11-19 10:54:03,042 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] throttle.PressureAwareThroughputController(145): bfe0e9384ea435498bea2232dc5c43aa#family1#compaction#35 average throughput is 8.59 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-19 10:54:03,043 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/fb8be6933ba5463c9230fe46929e9cb3 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/fb8be6933ba5463c9230fe46929e9cb3 2023-11-19 10:54:03,044 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/39d8f80effe1485d8a3c9377811de99d to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/39d8f80effe1485d8a3c9377811de99d 2023-11-19 10:54:03,046 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/73adfdf2cb654d7b823287f8fbe3c0a1 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/73adfdf2cb654d7b823287f8fbe3c0a1 2023-11-19 10:54:03,048 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/021d6f575c784fe49455c07b1a20d970 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/021d6f575c784fe49455c07b1a20d970 2023-11-19 10:54:03,049 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/84b40ca7744e44e884d4b63d6bb32898 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/84b40ca7744e44e884d4b63d6bb32898 2023-11-19 10:54:03,052 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/9ada46865f784ff3bb5487e6d2868c2a to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/9ada46865f784ff3bb5487e6d2868c2a 2023-11-19 10:54:03,054 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/34b4f9fc95d3487d9094ad83b0fa589a to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/34b4f9fc95d3487d9094ad83b0fa589a 2023-11-19 10:54:03,056 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/c6c2aedf939a47c9adfb11d4c148053c to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/c6c2aedf939a47c9adfb11d4c148053c 2023-11-19 10:54:03,057 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/2157ead5355d44d9997f998716753a06_SeqId_44_ to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/2157ead5355d44d9997f998716753a06_SeqId_44_ 2023-11-19 10:54:03,060 DEBUG [hfile_cleaner-dir-scan-pool-1] cleaner.CleanerChore(483): Couldn't delete 'hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1' yet because it isn't empty w/exception. org.apache.hadoop.fs.PathIsNotEmptyDirectoryException: ``/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1 is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) ': Directory is not empty: `/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1 is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:1595) at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:881) at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:878) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.delete(DistributedFileSystem.java:878) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$null$4(CleanerChore.java:453) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.deleteAction(CleanerChore.java:478) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:453) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture.uniWhenCompleteStage(CompletableFuture.java:792) at java.util.concurrent.CompletableFuture.whenComplete(CompletableFuture.java:2153) at org.apache.hadoop.hbase.util.FutureUtils.addListener(FutureUtils.java:61) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.traverseAndDelete(CleanerChore.java:439) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$null$2(CleanerChore.java:432) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.fs.PathIsNotEmptyDirectoryException): `/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1 is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.delete(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.delete(ClientNamenodeProtocolTranslatorPB.java:572) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:1593) ... 17 more 2023-11-19 10:54:03,125 INFO [Listener at localhost/42675] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=265 (was 255) - Thread LEAK? -, OpenFileDescriptor=653 (was 633) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=229 (was 250), ProcessCount=172 (was 172), AvailableMemoryMB=15536 (was 15704) 2023-11-19 10:54:03,136 INFO [Listener at localhost/42675] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=265, OpenFileDescriptor=653, MaxFileDescriptor=60000, SystemLoadAverage=229, ProcessCount=172, AvailableMemoryMB=15536 2023-11-19 10:54:03,138 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-19 10:54:03,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles 2023-11-19 10:54:03,141 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_PRE_OPERATION 2023-11-19 10:54:03,141 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testScannerOnBulkLoadRefHFiles" procId is: 27 2023-11-19 10:54:03,142 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-19 10:54:03,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-19 10:54:03,144 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/default/testScannerOnBulkLoadRefHFiles/8e4a8273d1606c34f37fa9a48dbe4086 2023-11-19 10:54:03,144 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/default/testScannerOnBulkLoadRefHFiles/d0fd5365988a919676d862ed72444aed 2023-11-19 10:54:03,144 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/default/testScannerOnBulkLoadRefHFiles/cf60b3cd4f7a9228bda102f2a6171a3d 2023-11-19 10:54:03,144 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/default/testScannerOnBulkLoadRefHFiles/8e4a8273d1606c34f37fa9a48dbe4086 empty. 2023-11-19 10:54:03,144 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/default/testScannerOnBulkLoadRefHFiles/cf60b3cd4f7a9228bda102f2a6171a3d empty. 2023-11-19 10:54:03,144 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/default/testScannerOnBulkLoadRefHFiles/d0fd5365988a919676d862ed72444aed empty. 2023-11-19 10:54:03,145 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/default/testScannerOnBulkLoadRefHFiles/8e4a8273d1606c34f37fa9a48dbe4086 2023-11-19 10:54:03,145 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/default/testScannerOnBulkLoadRefHFiles/d0fd5365988a919676d862ed72444aed 2023-11-19 10:54:03,145 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/default/testScannerOnBulkLoadRefHFiles/cf60b3cd4f7a9228bda102f2a6171a3d 2023-11-19 10:54:03,145 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testScannerOnBulkLoadRefHFiles regions 2023-11-19 10:54:03,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-19 10:54:03,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-19 10:54:03,553 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/default/testScannerOnBulkLoadRefHFiles/.tabledesc/.tableinfo.0000000001 2023-11-19 10:54:03,555 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(7675): creating {ENCODED => cf60b3cd4f7a9228bda102f2a6171a3d, NAME => 'testScannerOnBulkLoadRefHFiles,2,1700391243138.cf60b3cd4f7a9228bda102f2a6171a3d.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp 2023-11-19 10:54:03,555 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(7675): creating {ENCODED => d0fd5365988a919676d862ed72444aed, NAME => 'testScannerOnBulkLoadRefHFiles,1,1700391243138.d0fd5365988a919676d862ed72444aed.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp 2023-11-19 10:54:03,555 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8e4a8273d1606c34f37fa9a48dbe4086, NAME => 'testScannerOnBulkLoadRefHFiles,,1700391243138.8e4a8273d1606c34f37fa9a48dbe4086.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp 2023-11-19 10:54:03,573 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1700391243138.8e4a8273d1606c34f37fa9a48dbe4086.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-19 10:54:03,573 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1604): Closing 8e4a8273d1606c34f37fa9a48dbe4086, disabling compactions & flushes 2023-11-19 10:54:03,573 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1700391243138.8e4a8273d1606c34f37fa9a48dbe4086. 2023-11-19 10:54:03,573 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1700391243138.8e4a8273d1606c34f37fa9a48dbe4086. 2023-11-19 10:54:03,573 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1700391243138.8e4a8273d1606c34f37fa9a48dbe4086. after waiting 0 ms 2023-11-19 10:54:03,573 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1700391243138.8e4a8273d1606c34f37fa9a48dbe4086. 2023-11-19 10:54:03,573 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1700391243138.8e4a8273d1606c34f37fa9a48dbe4086. 2023-11-19 10:54:03,573 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1558): Region close journal for 8e4a8273d1606c34f37fa9a48dbe4086: 2023-11-19 10:54:03,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-19 10:54:03,972 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1700391243138.d0fd5365988a919676d862ed72444aed.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-19 10:54:03,972 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1604): Closing d0fd5365988a919676d862ed72444aed, disabling compactions & flushes 2023-11-19 10:54:03,972 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1700391243138.d0fd5365988a919676d862ed72444aed. 2023-11-19 10:54:03,972 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1700391243138.d0fd5365988a919676d862ed72444aed. 2023-11-19 10:54:03,972 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1700391243138.d0fd5365988a919676d862ed72444aed. after waiting 0 ms 2023-11-19 10:54:03,972 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1700391243138.d0fd5365988a919676d862ed72444aed. 2023-11-19 10:54:03,972 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1700391243138.d0fd5365988a919676d862ed72444aed. 2023-11-19 10:54:03,972 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1700391243138.cf60b3cd4f7a9228bda102f2a6171a3d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-19 10:54:03,972 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1558): Region close journal for d0fd5365988a919676d862ed72444aed: 2023-11-19 10:54:03,972 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1604): Closing cf60b3cd4f7a9228bda102f2a6171a3d, disabling compactions & flushes 2023-11-19 10:54:03,972 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1700391243138.cf60b3cd4f7a9228bda102f2a6171a3d. 2023-11-19 10:54:03,972 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1700391243138.cf60b3cd4f7a9228bda102f2a6171a3d. 2023-11-19 10:54:03,972 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1700391243138.cf60b3cd4f7a9228bda102f2a6171a3d. after waiting 0 ms 2023-11-19 10:54:03,972 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1700391243138.cf60b3cd4f7a9228bda102f2a6171a3d. 2023-11-19 10:54:03,972 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1700391243138.cf60b3cd4f7a9228bda102f2a6171a3d. 2023-11-19 10:54:03,972 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1558): Region close journal for cf60b3cd4f7a9228bda102f2a6171a3d: 2023-11-19 10:54:03,975 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ADD_TO_META 2023-11-19 10:54:03,976 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,,1700391243138.8e4a8273d1606c34f37fa9a48dbe4086.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1700391243976"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700391243976"}]},"ts":"1700391243976"} 2023-11-19 10:54:03,976 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,1,1700391243138.d0fd5365988a919676d862ed72444aed.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1700391243976"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700391243976"}]},"ts":"1700391243976"} 2023-11-19 10:54:03,976 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,2,1700391243138.cf60b3cd4f7a9228bda102f2a6171a3d.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1700391243976"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700391243976"}]},"ts":"1700391243976"} 2023-11-19 10:54:03,979 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-19 10:54:03,980 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-19 10:54:03,980 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700391243980"}]},"ts":"1700391243980"} 2023-11-19 10:54:03,981 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLING in hbase:meta 2023-11-19 10:54:03,985 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=8e4a8273d1606c34f37fa9a48dbe4086, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=d0fd5365988a919676d862ed72444aed, ASSIGN}, {pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=cf60b3cd4f7a9228bda102f2a6171a3d, ASSIGN}] 2023-11-19 10:54:03,986 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=cf60b3cd4f7a9228bda102f2a6171a3d, ASSIGN 2023-11-19 10:54:03,987 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=d0fd5365988a919676d862ed72444aed, ASSIGN 2023-11-19 10:54:03,987 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=8e4a8273d1606c34f37fa9a48dbe4086, ASSIGN 2023-11-19 10:54:03,987 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=cf60b3cd4f7a9228bda102f2a6171a3d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46035,1700391201579; forceNewPlan=false, retain=false 2023-11-19 10:54:03,987 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=d0fd5365988a919676d862ed72444aed, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46035,1700391201579; forceNewPlan=false, retain=false 2023-11-19 10:54:03,987 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=8e4a8273d1606c34f37fa9a48dbe4086, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46035,1700391201579; forceNewPlan=false, retain=false 2023-11-19 10:54:04,139 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=8e4a8273d1606c34f37fa9a48dbe4086, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:04,139 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=cf60b3cd4f7a9228bda102f2a6171a3d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:04,139 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=d0fd5365988a919676d862ed72444aed, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:04,139 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,,1700391243138.8e4a8273d1606c34f37fa9a48dbe4086.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1700391244139"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700391244139"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700391244139"}]},"ts":"1700391244139"} 2023-11-19 10:54:04,139 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,2,1700391243138.cf60b3cd4f7a9228bda102f2a6171a3d.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1700391244139"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700391244139"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700391244139"}]},"ts":"1700391244139"} 2023-11-19 10:54:04,139 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,1,1700391243138.d0fd5365988a919676d862ed72444aed.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1700391244139"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700391244139"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700391244139"}]},"ts":"1700391244139"} 2023-11-19 10:54:04,141 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 8e4a8273d1606c34f37fa9a48dbe4086, server=jenkins-hbase4.apache.org,46035,1700391201579}] 2023-11-19 10:54:04,141 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=32, ppid=30, state=RUNNABLE; OpenRegionProcedure cf60b3cd4f7a9228bda102f2a6171a3d, server=jenkins-hbase4.apache.org,46035,1700391201579}] 2023-11-19 10:54:04,142 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=33, ppid=29, state=RUNNABLE; OpenRegionProcedure d0fd5365988a919676d862ed72444aed, server=jenkins-hbase4.apache.org,46035,1700391201579}] 2023-11-19 10:54:04,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-19 10:54:04,262 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/.tmp/family1/50c02657e12a42e8acbfedef52e1b2b3 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/50c02657e12a42e8acbfedef52e1b2b3 2023-11-19 10:54:04,267 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in bfe0e9384ea435498bea2232dc5c43aa/family1 of bfe0e9384ea435498bea2232dc5c43aa into 50c02657e12a42e8acbfedef52e1b2b3(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-19 10:54:04,267 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for bfe0e9384ea435498bea2232dc5c43aa: 2023-11-19 10:54:04,267 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1700391230188.bfe0e9384ea435498bea2232dc5c43aa., storeName=family1, fileCount=3, fileSize=176.8 K (165.1 K, 6.6 K, 5.2 K), priority=2, time=1700391243012; duration=1sec 2023-11-19 10:54:04,267 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-19 10:54:04,292 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:04,295 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,,1700391243138.8e4a8273d1606c34f37fa9a48dbe4086. 2023-11-19 10:54:04,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8e4a8273d1606c34f37fa9a48dbe4086, NAME => 'testScannerOnBulkLoadRefHFiles,,1700391243138.8e4a8273d1606c34f37fa9a48dbe4086.', STARTKEY => '', ENDKEY => '1'} 2023-11-19 10:54:04,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 8e4a8273d1606c34f37fa9a48dbe4086 2023-11-19 10:54:04,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1700391243138.8e4a8273d1606c34f37fa9a48dbe4086.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-19 10:54:04,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8e4a8273d1606c34f37fa9a48dbe4086 2023-11-19 10:54:04,296 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8e4a8273d1606c34f37fa9a48dbe4086 2023-11-19 10:54:04,297 INFO [StoreOpener-8e4a8273d1606c34f37fa9a48dbe4086-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 8e4a8273d1606c34f37fa9a48dbe4086 2023-11-19 10:54:04,298 DEBUG [StoreOpener-8e4a8273d1606c34f37fa9a48dbe4086-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testScannerOnBulkLoadRefHFiles/8e4a8273d1606c34f37fa9a48dbe4086/family1 2023-11-19 10:54:04,298 DEBUG [StoreOpener-8e4a8273d1606c34f37fa9a48dbe4086-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testScannerOnBulkLoadRefHFiles/8e4a8273d1606c34f37fa9a48dbe4086/family1 2023-11-19 10:54:04,299 INFO [StoreOpener-8e4a8273d1606c34f37fa9a48dbe4086-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8e4a8273d1606c34f37fa9a48dbe4086 columnFamilyName family1 2023-11-19 10:54:04,300 INFO [StoreOpener-8e4a8273d1606c34f37fa9a48dbe4086-1] regionserver.HStore(310): Store=8e4a8273d1606c34f37fa9a48dbe4086/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-19 10:54:04,300 INFO [StoreOpener-8e4a8273d1606c34f37fa9a48dbe4086-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 8e4a8273d1606c34f37fa9a48dbe4086 2023-11-19 10:54:04,301 DEBUG [StoreOpener-8e4a8273d1606c34f37fa9a48dbe4086-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testScannerOnBulkLoadRefHFiles/8e4a8273d1606c34f37fa9a48dbe4086/family2 2023-11-19 10:54:04,301 DEBUG [StoreOpener-8e4a8273d1606c34f37fa9a48dbe4086-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testScannerOnBulkLoadRefHFiles/8e4a8273d1606c34f37fa9a48dbe4086/family2 2023-11-19 10:54:04,302 INFO [StoreOpener-8e4a8273d1606c34f37fa9a48dbe4086-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8e4a8273d1606c34f37fa9a48dbe4086 columnFamilyName family2 2023-11-19 10:54:04,303 INFO [StoreOpener-8e4a8273d1606c34f37fa9a48dbe4086-1] regionserver.HStore(310): Store=8e4a8273d1606c34f37fa9a48dbe4086/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-19 10:54:04,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testScannerOnBulkLoadRefHFiles/8e4a8273d1606c34f37fa9a48dbe4086 2023-11-19 10:54:04,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testScannerOnBulkLoadRefHFiles/8e4a8273d1606c34f37fa9a48dbe4086 2023-11-19 10:54:04,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-19 10:54:04,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8e4a8273d1606c34f37fa9a48dbe4086 2023-11-19 10:54:04,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testScannerOnBulkLoadRefHFiles/8e4a8273d1606c34f37fa9a48dbe4086/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-19 10:54:04,309 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8e4a8273d1606c34f37fa9a48dbe4086; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71816918, jitterRate=0.07015547156333923}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-19 10:54:04,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8e4a8273d1606c34f37fa9a48dbe4086: 2023-11-19 10:54:04,310 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,,1700391243138.8e4a8273d1606c34f37fa9a48dbe4086., pid=31, masterSystemTime=1700391244292 2023-11-19 10:54:04,311 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,,1700391243138.8e4a8273d1606c34f37fa9a48dbe4086. 2023-11-19 10:54:04,311 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,,1700391243138.8e4a8273d1606c34f37fa9a48dbe4086. 2023-11-19 10:54:04,311 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,2,1700391243138.cf60b3cd4f7a9228bda102f2a6171a3d. 2023-11-19 10:54:04,311 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cf60b3cd4f7a9228bda102f2a6171a3d, NAME => 'testScannerOnBulkLoadRefHFiles,2,1700391243138.cf60b3cd4f7a9228bda102f2a6171a3d.', STARTKEY => '2', ENDKEY => ''} 2023-11-19 10:54:04,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles cf60b3cd4f7a9228bda102f2a6171a3d 2023-11-19 10:54:04,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1700391243138.cf60b3cd4f7a9228bda102f2a6171a3d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-19 10:54:04,312 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=8e4a8273d1606c34f37fa9a48dbe4086, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:04,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for cf60b3cd4f7a9228bda102f2a6171a3d 2023-11-19 10:54:04,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for cf60b3cd4f7a9228bda102f2a6171a3d 2023-11-19 10:54:04,312 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,,1700391243138.8e4a8273d1606c34f37fa9a48dbe4086.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1700391244312"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700391244312"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700391244312"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700391244312"}]},"ts":"1700391244312"} 2023-11-19 10:54:04,313 INFO [StoreOpener-cf60b3cd4f7a9228bda102f2a6171a3d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region cf60b3cd4f7a9228bda102f2a6171a3d 2023-11-19 10:54:04,314 DEBUG [StoreOpener-cf60b3cd4f7a9228bda102f2a6171a3d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testScannerOnBulkLoadRefHFiles/cf60b3cd4f7a9228bda102f2a6171a3d/family1 2023-11-19 10:54:04,314 DEBUG [StoreOpener-cf60b3cd4f7a9228bda102f2a6171a3d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testScannerOnBulkLoadRefHFiles/cf60b3cd4f7a9228bda102f2a6171a3d/family1 2023-11-19 10:54:04,315 INFO [StoreOpener-cf60b3cd4f7a9228bda102f2a6171a3d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cf60b3cd4f7a9228bda102f2a6171a3d columnFamilyName family1 2023-11-19 10:54:04,315 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=28 2023-11-19 10:54:04,315 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 8e4a8273d1606c34f37fa9a48dbe4086, server=jenkins-hbase4.apache.org,46035,1700391201579 in 172 msec 2023-11-19 10:54:04,316 INFO [StoreOpener-cf60b3cd4f7a9228bda102f2a6171a3d-1] regionserver.HStore(310): Store=cf60b3cd4f7a9228bda102f2a6171a3d/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-19 10:54:04,316 INFO [StoreOpener-cf60b3cd4f7a9228bda102f2a6171a3d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region cf60b3cd4f7a9228bda102f2a6171a3d 2023-11-19 10:54:04,317 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=8e4a8273d1606c34f37fa9a48dbe4086, ASSIGN in 330 msec 2023-11-19 10:54:04,318 DEBUG [StoreOpener-cf60b3cd4f7a9228bda102f2a6171a3d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testScannerOnBulkLoadRefHFiles/cf60b3cd4f7a9228bda102f2a6171a3d/family2 2023-11-19 10:54:04,318 DEBUG [StoreOpener-cf60b3cd4f7a9228bda102f2a6171a3d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testScannerOnBulkLoadRefHFiles/cf60b3cd4f7a9228bda102f2a6171a3d/family2 2023-11-19 10:54:04,319 INFO [StoreOpener-cf60b3cd4f7a9228bda102f2a6171a3d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cf60b3cd4f7a9228bda102f2a6171a3d columnFamilyName family2 2023-11-19 10:54:04,320 INFO [StoreOpener-cf60b3cd4f7a9228bda102f2a6171a3d-1] regionserver.HStore(310): Store=cf60b3cd4f7a9228bda102f2a6171a3d/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-19 10:54:04,321 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testScannerOnBulkLoadRefHFiles/cf60b3cd4f7a9228bda102f2a6171a3d 2023-11-19 10:54:04,321 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testScannerOnBulkLoadRefHFiles/cf60b3cd4f7a9228bda102f2a6171a3d 2023-11-19 10:54:04,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-19 10:54:04,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for cf60b3cd4f7a9228bda102f2a6171a3d 2023-11-19 10:54:04,325 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testScannerOnBulkLoadRefHFiles/cf60b3cd4f7a9228bda102f2a6171a3d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-19 10:54:04,326 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened cf60b3cd4f7a9228bda102f2a6171a3d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72423080, jitterRate=0.07918798923492432}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-19 10:54:04,326 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for cf60b3cd4f7a9228bda102f2a6171a3d: 2023-11-19 10:54:04,327 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,2,1700391243138.cf60b3cd4f7a9228bda102f2a6171a3d., pid=32, masterSystemTime=1700391244292 2023-11-19 10:54:04,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,2,1700391243138.cf60b3cd4f7a9228bda102f2a6171a3d. 2023-11-19 10:54:04,328 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,2,1700391243138.cf60b3cd4f7a9228bda102f2a6171a3d. 2023-11-19 10:54:04,328 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,1,1700391243138.d0fd5365988a919676d862ed72444aed. 2023-11-19 10:54:04,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d0fd5365988a919676d862ed72444aed, NAME => 'testScannerOnBulkLoadRefHFiles,1,1700391243138.d0fd5365988a919676d862ed72444aed.', STARTKEY => '1', ENDKEY => '2'} 2023-11-19 10:54:04,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles d0fd5365988a919676d862ed72444aed 2023-11-19 10:54:04,328 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=cf60b3cd4f7a9228bda102f2a6171a3d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:04,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1700391243138.d0fd5365988a919676d862ed72444aed.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-19 10:54:04,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d0fd5365988a919676d862ed72444aed 2023-11-19 10:54:04,329 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,2,1700391243138.cf60b3cd4f7a9228bda102f2a6171a3d.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1700391244328"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700391244328"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700391244328"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700391244328"}]},"ts":"1700391244328"} 2023-11-19 10:54:04,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d0fd5365988a919676d862ed72444aed 2023-11-19 10:54:04,330 INFO [StoreOpener-d0fd5365988a919676d862ed72444aed-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region d0fd5365988a919676d862ed72444aed 2023-11-19 10:54:04,334 DEBUG [StoreOpener-d0fd5365988a919676d862ed72444aed-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testScannerOnBulkLoadRefHFiles/d0fd5365988a919676d862ed72444aed/family1 2023-11-19 10:54:04,334 DEBUG [StoreOpener-d0fd5365988a919676d862ed72444aed-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testScannerOnBulkLoadRefHFiles/d0fd5365988a919676d862ed72444aed/family1 2023-11-19 10:54:04,334 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/0c201f8d34e94d1d8167dec3e5795f90, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/a09ce26d69804fd19b722e6950c29d66, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/af74116840544de1b0d2270361b451cf_SeqId_47_] to archive 2023-11-19 10:54:04,335 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=32, resume processing ppid=30 2023-11-19 10:54:04,335 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=32, ppid=30, state=SUCCESS; OpenRegionProcedure cf60b3cd4f7a9228bda102f2a6171a3d, server=jenkins-hbase4.apache.org,46035,1700391201579 in 189 msec 2023-11-19 10:54:04,335 INFO [StoreOpener-d0fd5365988a919676d862ed72444aed-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d0fd5365988a919676d862ed72444aed columnFamilyName family1 2023-11-19 10:54:04,335 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:54:04,336 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=cf60b3cd4f7a9228bda102f2a6171a3d, ASSIGN in 350 msec 2023-11-19 10:54:04,336 INFO [StoreOpener-d0fd5365988a919676d862ed72444aed-1] regionserver.HStore(310): Store=d0fd5365988a919676d862ed72444aed/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-19 10:54:04,336 INFO [StoreOpener-d0fd5365988a919676d862ed72444aed-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region d0fd5365988a919676d862ed72444aed 2023-11-19 10:54:04,337 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/0c201f8d34e94d1d8167dec3e5795f90 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/0c201f8d34e94d1d8167dec3e5795f90 2023-11-19 10:54:04,338 DEBUG [StoreOpener-d0fd5365988a919676d862ed72444aed-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testScannerOnBulkLoadRefHFiles/d0fd5365988a919676d862ed72444aed/family2 2023-11-19 10:54:04,338 DEBUG [StoreOpener-d0fd5365988a919676d862ed72444aed-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testScannerOnBulkLoadRefHFiles/d0fd5365988a919676d862ed72444aed/family2 2023-11-19 10:54:04,338 INFO [StoreOpener-d0fd5365988a919676d862ed72444aed-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d0fd5365988a919676d862ed72444aed columnFamilyName family2 2023-11-19 10:54:04,338 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/a09ce26d69804fd19b722e6950c29d66 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/a09ce26d69804fd19b722e6950c29d66 2023-11-19 10:54:04,339 INFO [StoreOpener-d0fd5365988a919676d862ed72444aed-1] regionserver.HStore(310): Store=d0fd5365988a919676d862ed72444aed/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-19 10:54:04,340 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/af74116840544de1b0d2270361b451cf_SeqId_47_ to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/family1/af74116840544de1b0d2270361b451cf_SeqId_47_ 2023-11-19 10:54:04,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testScannerOnBulkLoadRefHFiles/d0fd5365988a919676d862ed72444aed 2023-11-19 10:54:04,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testScannerOnBulkLoadRefHFiles/d0fd5365988a919676d862ed72444aed 2023-11-19 10:54:04,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-19 10:54:04,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d0fd5365988a919676d862ed72444aed 2023-11-19 10:54:04,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testScannerOnBulkLoadRefHFiles/d0fd5365988a919676d862ed72444aed/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-19 10:54:04,347 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d0fd5365988a919676d862ed72444aed; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62175170, jitterRate=-0.07351776957511902}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-19 10:54:04,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d0fd5365988a919676d862ed72444aed: 2023-11-19 10:54:04,347 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,1,1700391243138.d0fd5365988a919676d862ed72444aed., pid=33, masterSystemTime=1700391244292 2023-11-19 10:54:04,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,1,1700391243138.d0fd5365988a919676d862ed72444aed. 2023-11-19 10:54:04,349 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,1,1700391243138.d0fd5365988a919676d862ed72444aed. 2023-11-19 10:54:04,349 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=d0fd5365988a919676d862ed72444aed, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:04,349 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,1,1700391243138.d0fd5365988a919676d862ed72444aed.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1700391244349"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700391244349"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700391244349"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700391244349"}]},"ts":"1700391244349"} 2023-11-19 10:54:04,353 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=33, resume processing ppid=29 2023-11-19 10:54:04,353 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=33, ppid=29, state=SUCCESS; OpenRegionProcedure d0fd5365988a919676d862ed72444aed, server=jenkins-hbase4.apache.org,46035,1700391201579 in 209 msec 2023-11-19 10:54:04,354 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=29, resume processing ppid=27 2023-11-19 10:54:04,355 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=d0fd5365988a919676d862ed72444aed, ASSIGN in 368 msec 2023-11-19 10:54:04,355 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-19 10:54:04,355 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700391244355"}]},"ts":"1700391244355"} 2023-11-19 10:54:04,356 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLED in hbase:meta 2023-11-19 10:54:04,364 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_POST_OPERATION 2023-11-19 10:54:04,365 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles in 1.2260 sec 2023-11-19 10:54:05,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-19 10:54:05,247 INFO [Listener at localhost/42675] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testScannerOnBulkLoadRefHFiles, procId: 27 completed 2023-11-19 10:54:05,254 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:54:05,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-11-19 10:54:05,256 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-11-19 10:54:05,256 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:54:05,256 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-11-19 10:54:05,256 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-11-19 10:54:05,256 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-19 10:54:05,256 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-19 10:54:05,258 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:54:05,258 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:05,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:54:05,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:54:05,258 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:05,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-19 10:54:05,258 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:54:05,258 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-19 10:54:05,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:54:05,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-19 10:54:05,259 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-11-19 10:54:05,259 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-11-19 10:54:05,259 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-11-19 10:54:05,259 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:54:05,259 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-11-19 10:54:05,259 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1700391243138.cf60b3cd4f7a9228bda102f2a6171a3d. 2023-11-19 10:54:05,259 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1700391243138.cf60b3cd4f7a9228bda102f2a6171a3d. started... 2023-11-19 10:54:05,259 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1700391243138.d0fd5365988a919676d862ed72444aed. 2023-11-19 10:54:05,260 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1700391243138.d0fd5365988a919676d862ed72444aed. started... 2023-11-19 10:54:05,261 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-19 10:54:05,261 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1700391243138.8e4a8273d1606c34f37fa9a48dbe4086. 2023-11-19 10:54:05,261 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:54:05,261 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1700391243138.8e4a8273d1606c34f37fa9a48dbe4086. started... 2023-11-19 10:54:05,261 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for d0fd5365988a919676d862ed72444aed: 2023-11-19 10:54:05,261 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 8e4a8273d1606c34f37fa9a48dbe4086: 2023-11-19 10:54:05,261 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing cf60b3cd4f7a9228bda102f2a6171a3d 2/2 column families, dataSize=48 B heapSize=632 B 2023-11-19 10:54:05,261 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1700391243138.8e4a8273d1606c34f37fa9a48dbe4086. 2023-11-19 10:54:05,261 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1700391243138.d0fd5365988a919676d862ed72444aed. 2023-11-19 10:54:05,262 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-19 10:54:05,262 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-19 10:54:05,313 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testScannerOnBulkLoadRefHFiles' 2023-11-19 10:54:05,677 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231119fc4d8665673f4a2a9b943a0b6dae7ecc to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231119fc4d8665673f4a2a9b943a0b6dae7ecc 2023-11-19 10:54:06,083 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=48, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testScannerOnBulkLoadRefHFiles/cf60b3cd4f7a9228bda102f2a6171a3d/.tmp/family1/8cebbc0977834c31908f2696f3ce2266 2023-11-19 10:54:06,088 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testScannerOnBulkLoadRefHFiles/cf60b3cd4f7a9228bda102f2a6171a3d/.tmp/family1/8cebbc0977834c31908f2696f3ce2266 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testScannerOnBulkLoadRefHFiles/cf60b3cd4f7a9228bda102f2a6171a3d/family1/8cebbc0977834c31908f2696f3ce2266 2023-11-19 10:54:06,092 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testScannerOnBulkLoadRefHFiles/cf60b3cd4f7a9228bda102f2a6171a3d/family1/8cebbc0977834c31908f2696f3ce2266, entries=1, sequenceid=5, filesize=4.9 K 2023-11-19 10:54:06,093 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~48 B/48, heapSize ~360 B/360, currentSize=0 B/0 for cf60b3cd4f7a9228bda102f2a6171a3d in 832ms, sequenceid=5, compaction requested=false 2023-11-19 10:54:06,094 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for cf60b3cd4f7a9228bda102f2a6171a3d: 2023-11-19 10:54:06,094 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1700391243138.cf60b3cd4f7a9228bda102f2a6171a3d. 2023-11-19 10:54:06,094 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-19 10:54:06,094 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-19 10:54:06,094 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:06,094 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-11-19 10:54:06,094 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-11-19 10:54:06,096 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:06,096 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-19 10:54:06,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:06,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:06,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:06,097 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-19 10:54:06,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:06,097 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:54:06,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:06,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-19 10:54:06,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:06,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:06,099 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-11-19 10:54:06,099 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-11-19 10:54:06,099 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@546106ce[Count = 0] remaining members to acquire global barrier 2023-11-19 10:54:06,099 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-19 10:54:06,100 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-19 10:54:06,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-19 10:54:06,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-19 10:54:06,100 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-11-19 10:54:06,100 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-11-19 10:54:06,100 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:54:06,100 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:06,100 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:54:06,103 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-11-19 10:54:06,103 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:06,103 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:54:06,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:06,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:06,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:06,103 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-11-19 10:54:06,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:06,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:06,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-19 10:54:06,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:06,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:06,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-19 10:54:06,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:06,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:54:06,106 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-11-19 10:54:06,106 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-11-19 10:54:06,106 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:54:06,106 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:54:06,106 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-11-19 10:54:06,106 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:54:06,107 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-19 10:54:06,107 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-19 10:54:06,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-19 10:54:06,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:06,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:06,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-19 10:54:06,107 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:54:06,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-19 10:54:06,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:06,108 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:06,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:54:06,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:54:06,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-19 10:54:06,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-19 10:54:06,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:06,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-19 10:54:06,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:06,110 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:06,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:06,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-19 10:54:06,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:06,112 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:06,112 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:54:06,112 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-19 10:54:06,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:54:06,112 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-19 10:54:06,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:54:06,113 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-11-19 10:54:06,113 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:54:06,112 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:06,113 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:54:06,112 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:54:06,113 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-19 10:54:06,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:54:06,113 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-19 10:54:06,113 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-11-19 10:54:06,113 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-19 10:54:06,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:54:06,113 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:54:06,214 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:54:06,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:54:06,218 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:54:06,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testScannerOnBulkLoadRefHFiles was in running list but was completed. Accepting new attempt. 2023-11-19 10:54:06,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-11-19 10:54:06,220 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-11-19 10:54:06,220 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:54:06,220 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-11-19 10:54:06,220 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-11-19 10:54:06,221 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-19 10:54:06,221 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-19 10:54:06,222 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:06,222 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:54:06,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:54:06,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:54:06,223 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:06,223 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:54:06,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-19 10:54:06,223 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-19 10:54:06,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:54:06,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-19 10:54:06,224 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-11-19 10:54:06,224 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testScannerOnBulkLoadRefHFiles is still present, removing 2023-11-19 10:54:06,224 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-11-19 10:54:06,224 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-11-19 10:54:06,224 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:54:06,224 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-11-19 10:54:06,224 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1700391243138.cf60b3cd4f7a9228bda102f2a6171a3d. 2023-11-19 10:54:06,224 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1700391243138.cf60b3cd4f7a9228bda102f2a6171a3d. started... 2023-11-19 10:54:06,224 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1700391243138.d0fd5365988a919676d862ed72444aed. 2023-11-19 10:54:06,224 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing cf60b3cd4f7a9228bda102f2a6171a3d 2/2 column families, dataSize=90 B heapSize=752 B 2023-11-19 10:54:06,224 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1700391243138.d0fd5365988a919676d862ed72444aed. started... 2023-11-19 10:54:06,224 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1700391243138.8e4a8273d1606c34f37fa9a48dbe4086. 2023-11-19 10:54:06,224 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-19 10:54:06,225 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:54:06,225 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for d0fd5365988a919676d862ed72444aed: 2023-11-19 10:54:06,225 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1700391243138.8e4a8273d1606c34f37fa9a48dbe4086. started... 2023-11-19 10:54:06,225 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1700391243138.d0fd5365988a919676d862ed72444aed. 2023-11-19 10:54:06,225 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 8e4a8273d1606c34f37fa9a48dbe4086: 2023-11-19 10:54:06,225 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-19 10:54:06,225 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1700391243138.8e4a8273d1606c34f37fa9a48dbe4086. 2023-11-19 10:54:06,225 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-19 10:54:06,637 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231119edc35b3d98d64c3c9ea47c65de2f3f4d to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231119edc35b3d98d64c3c9ea47c65de2f3f4d 2023-11-19 10:54:07,043 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=90, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testScannerOnBulkLoadRefHFiles/cf60b3cd4f7a9228bda102f2a6171a3d/.tmp/family1/edf7a8662cc84a2782967aee022c813e 2023-11-19 10:54:07,049 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testScannerOnBulkLoadRefHFiles/cf60b3cd4f7a9228bda102f2a6171a3d/.tmp/family1/edf7a8662cc84a2782967aee022c813e as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testScannerOnBulkLoadRefHFiles/cf60b3cd4f7a9228bda102f2a6171a3d/family1/edf7a8662cc84a2782967aee022c813e 2023-11-19 10:54:07,054 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testScannerOnBulkLoadRefHFiles/cf60b3cd4f7a9228bda102f2a6171a3d/family1/edf7a8662cc84a2782967aee022c813e, entries=2, sequenceid=9, filesize=5.0 K 2023-11-19 10:54:07,054 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~90 B/90, heapSize ~480 B/480, currentSize=0 B/0 for cf60b3cd4f7a9228bda102f2a6171a3d in 830ms, sequenceid=9, compaction requested=false 2023-11-19 10:54:07,055 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for cf60b3cd4f7a9228bda102f2a6171a3d: 2023-11-19 10:54:07,055 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1700391243138.cf60b3cd4f7a9228bda102f2a6171a3d. 2023-11-19 10:54:07,055 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-19 10:54:07,055 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-19 10:54:07,055 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:07,055 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-11-19 10:54:07,055 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-11-19 10:54:07,058 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:07,058 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-19 10:54:07,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:07,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:07,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:07,058 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-19 10:54:07,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:07,058 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:54:07,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:07,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-19 10:54:07,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:07,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:07,060 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-11-19 10:54:07,060 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@ef88566[Count = 0] remaining members to acquire global barrier 2023-11-19 10:54:07,060 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-11-19 10:54:07,060 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-19 10:54:07,061 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-19 10:54:07,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-19 10:54:07,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-19 10:54:07,061 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-11-19 10:54:07,061 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-11-19 10:54:07,061 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:54:07,061 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:07,061 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:54:07,062 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-11-19 10:54:07,062 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:07,062 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:54:07,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:07,062 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-11-19 10:54:07,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:07,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:07,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:07,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:07,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-19 10:54:07,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:07,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:07,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-19 10:54:07,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:07,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:54:07,065 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-11-19 10:54:07,065 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-11-19 10:54:07,065 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:54:07,065 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:54:07,065 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-11-19 10:54:07,065 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:54:07,067 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-19 10:54:07,067 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-19 10:54:07,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-19 10:54:07,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-19 10:54:07,067 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:54:07,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-19 10:54:07,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:07,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:07,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:54:07,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:54:07,067 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:07,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:07,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-19 10:54:07,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-19 10:54:07,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:07,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-19 10:54:07,069 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:07,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:07,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:07,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-19 10:54:07,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:07,075 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:07,075 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:54:07,075 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-19 10:54:07,076 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:54:07,076 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-11-19 10:54:07,076 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:54:07,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:54:07,076 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:54:07,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:54:07,076 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-19 10:54:07,076 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-11-19 10:54:07,076 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-11-19 10:54:07,076 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:07,076 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:54:07,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:54:07,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:54:07,076 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-19 10:54:07,076 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-19 10:54:07,076 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-19 10:54:07,176 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:54:07,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:54:07,183 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=33457] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testScannerOnBulkLoadRefHFiles 2023-11-19 10:54:07,186 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-11-19 10:54:07,186 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-11-19 10:54:07,187 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] mob.MobUtils(833): start MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-19 10:54:07,187 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700391847187 2023-11-19 10:54:07,188 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-19 10:54:07,188 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testScannerOnBulkLoadRefHFiles' and column 'family1' 2023-11-19 10:54:07,188 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-19 10:54:07,189 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] zookeeper.ReadOnlyZKClient(139): Connect 0x61edd822 to 127.0.0.1:60497 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-19 10:54:07,193 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4a4d7d76, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-19 10:54:07,193 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231119 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-11-19 10:54:07,628 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-19 10:54:07,628 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x289eafe1 to 127.0.0.1:60497 2023-11-19 10:54:07,628 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-19 10:54:07,629 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-19 10:54:07,629 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x66bb0515 to 127.0.0.1:60497 2023-11-19 10:54:07,629 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-19 10:54:07,630 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-19 10:54:07,630 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2e3461f0 to 127.0.0.1:60497 2023-11-19 10:54:07,630 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-19 10:54:07,630 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-19 10:54:07,630 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1dbc392a to 127.0.0.1:60497 2023-11-19 10:54:07,630 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-19 10:54:08,039 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311192ae02dc8d45a4630a63a0cc494a41a8f to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202311192ae02dc8d45a4630a63a0cc494a41a8f 2023-11-19 10:54:08,040 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231119 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-19 10:54:08,053 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-19 10:54:08,054 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49938, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-19 10:54:08,061 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-19 10:54:08,063 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58630, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-19 10:54:08,072 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231119/family1/e3b5a640250749ffbb8df60de0fbe921 first=Optional[k0] last=Optional[k1] 2023-11-19 10:54:08,072 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testScannerOnBulkLoadRefHFiles,2,1700391243138.cf60b3cd4f7a9228bda102f2a6171a3d., hostname=jenkins-hbase4.apache.org,46035,1700391201579, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231119/family1/e3b5a640250749ffbb8df60de0fbe921}] 2023-11-19 10:54:08,077 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(763): Validating hfile at hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231119/family1/e3b5a640250749ffbb8df60de0fbe921 for inclusion in cf60b3cd4f7a9228bda102f2a6171a3d/family1 2023-11-19 10:54:08,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(775): HFile bounds: first=k0 last=k1 2023-11-19 10:54:08,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-19 10:54:08,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegion(2446): Flush status journal for cf60b3cd4f7a9228bda102f2a6171a3d: 2023-11-19 10:54:08,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231119/family1/e3b5a640250749ffbb8df60de0fbe921 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testScannerOnBulkLoadRefHFiles__oo98jfgqgh42vcksjd5s68ph5bsu7vthjpmmqitp12uk963lk7h4bth25668rl4r/family1/e3b5a640250749ffbb8df60de0fbe921 2023-11-19 10:54:08,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testScannerOnBulkLoadRefHFiles__oo98jfgqgh42vcksjd5s68ph5bsu7vthjpmmqitp12uk963lk7h4bth25668rl4r/family1/e3b5a640250749ffbb8df60de0fbe921 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testScannerOnBulkLoadRefHFiles/cf60b3cd4f7a9228bda102f2a6171a3d/family1/de075168f0524eaca44ac025c3c8c24a_SeqId_12_ 2023-11-19 10:54:08,083 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(849): Loaded HFile hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testScannerOnBulkLoadRefHFiles__oo98jfgqgh42vcksjd5s68ph5bsu7vthjpmmqitp12uk963lk7h4bth25668rl4r/family1/e3b5a640250749ffbb8df60de0fbe921 into cf60b3cd4f7a9228bda102f2a6171a3d/family1 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testScannerOnBulkLoadRefHFiles/cf60b3cd4f7a9228bda102f2a6171a3d/family1/de075168f0524eaca44ac025c3c8c24a_SeqId_12_ - updating store file list. 2023-11-19 10:54:08,087 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(882): Loaded HFile hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testScannerOnBulkLoadRefHFiles/cf60b3cd4f7a9228bda102f2a6171a3d/family1/de075168f0524eaca44ac025c3c8c24a_SeqId_12_ into cf60b3cd4f7a9228bda102f2a6171a3d/family1 2023-11-19 10:54:08,087 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(855): Successfully loaded hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testScannerOnBulkLoadRefHFiles__oo98jfgqgh42vcksjd5s68ph5bsu7vthjpmmqitp12uk963lk7h4bth25668rl4r/family1/e3b5a640250749ffbb8df60de0fbe921 into cf60b3cd4f7a9228bda102f2a6171a3d/family1 (new location: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testScannerOnBulkLoadRefHFiles/cf60b3cd4f7a9228bda102f2a6171a3d/family1/de075168f0524eaca44ac025c3c8c24a_SeqId_12_) 2023-11-19 10:54:08,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testScannerOnBulkLoadRefHFiles__oo98jfgqgh42vcksjd5s68ph5bsu7vthjpmmqitp12uk963lk7h4bth25668rl4r/family1/e3b5a640250749ffbb8df60de0fbe921 2023-11-19 10:54:08,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-19 10:54:08,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 15445 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-19 10:54:08,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(1912): cf60b3cd4f7a9228bda102f2a6171a3d/family1 is initiating minor compaction (all files) 2023-11-19 10:54:08,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@3c945e7d; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-19 10:54:08,089 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of cf60b3cd4f7a9228bda102f2a6171a3d/family1 in testScannerOnBulkLoadRefHFiles,2,1700391243138.cf60b3cd4f7a9228bda102f2a6171a3d. 2023-11-19 10:54:08,089 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testScannerOnBulkLoadRefHFiles/cf60b3cd4f7a9228bda102f2a6171a3d/family1/8cebbc0977834c31908f2696f3ce2266, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testScannerOnBulkLoadRefHFiles/cf60b3cd4f7a9228bda102f2a6171a3d/family1/edf7a8662cc84a2782967aee022c813e, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testScannerOnBulkLoadRefHFiles/cf60b3cd4f7a9228bda102f2a6171a3d/family1/de075168f0524eaca44ac025c3c8c24a_SeqId_12_] into tmpdir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testScannerOnBulkLoadRefHFiles/cf60b3cd4f7a9228bda102f2a6171a3d/.tmp, totalSize=15.1 K 2023-11-19 10:54:08,089 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting 8cebbc0977834c31908f2696f3ce2266, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700391245247 2023-11-19 10:54:08,090 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting edf7a8662cc84a2782967aee022c813e, keycount=2, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700391245247 2023-11-19 10:54:08,090 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting de075168f0524eaca44ac025c3c8c24a_SeqId_12_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700391245247 2023-11-19 10:54:08,092 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231119 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-19 10:54:08,092 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:54:08,094 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231119edc35b3d98d64c3c9ea47c65de2f3f4d to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231119edc35b3d98d64c3c9ea47c65de2f3f4d 2023-11-19 10:54:08,096 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231119fc4d8665673f4a2a9b943a0b6dae7ecc to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231119fc4d8665673f4a2a9b943a0b6dae7ecc 2023-11-19 10:54:08,096 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testScannerOnBulkLoadRefHFiles 2 expired mob files are deleted 2023-11-19 10:54:08,096 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231119' 2023-11-19 10:54:08,096 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231119 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-11-19 10:54:08,096 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-19 10:54:08,096 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] mob.MobUtils(840): end MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-19 10:54:08,097 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-11-19 10:54:08,098 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE in 912 msec 2023-11-19 10:54:08,101 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] throttle.PressureAwareThroughputController(145): cf60b3cd4f7a9228bda102f2a6171a3d#family1#compaction#38 average throughput is 0.09 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-19 10:54:08,133 INFO [Listener at localhost/42675] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=252 (was 265), OpenFileDescriptor=627 (was 653), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=211 (was 229), ProcessCount=172 (was 172), AvailableMemoryMB=15472 (was 15536) 2023-11-19 10:54:08,147 INFO [Listener at localhost/42675] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=252, OpenFileDescriptor=627, MaxFileDescriptor=60000, SystemLoadAverage=211, ProcessCount=172, AvailableMemoryMB=15471 2023-11-19 10:54:08,149 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-19 10:54:08,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:08,151 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-19 10:54:08,152 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyPolicy" procId is: 35 2023-11-19 10:54:08,152 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-19 10:54:08,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-19 10:54:08,153 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973 2023-11-19 10:54:08,154 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973 empty. 2023-11-19 10:54:08,154 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973 2023-11-19 10:54:08,154 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyPolicy regions 2023-11-19 10:54:08,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-19 10:54:08,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-19 10:54:08,562 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-19 10:54:08,563 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 94897ac05c23e41d94b8f8d3dcd0e973, NAME => 'testMajorCompactionWithWeeklyPolicy,,1700391248149.94897ac05c23e41d94b8f8d3dcd0e973.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp 2023-11-19 10:54:08,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-19 10:54:08,969 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1700391248149.94897ac05c23e41d94b8f8d3dcd0e973.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-19 10:54:08,969 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing 94897ac05c23e41d94b8f8d3dcd0e973, disabling compactions & flushes 2023-11-19 10:54:08,969 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1700391248149.94897ac05c23e41d94b8f8d3dcd0e973. 2023-11-19 10:54:08,969 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1700391248149.94897ac05c23e41d94b8f8d3dcd0e973. 2023-11-19 10:54:08,969 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1700391248149.94897ac05c23e41d94b8f8d3dcd0e973. after waiting 0 ms 2023-11-19 10:54:08,969 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1700391248149.94897ac05c23e41d94b8f8d3dcd0e973. 2023-11-19 10:54:08,969 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1700391248149.94897ac05c23e41d94b8f8d3dcd0e973. 2023-11-19 10:54:08,969 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 94897ac05c23e41d94b8f8d3dcd0e973: 2023-11-19 10:54:08,971 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-19 10:54:08,973 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyPolicy,,1700391248149.94897ac05c23e41d94b8f8d3dcd0e973.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1700391248972"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700391248972"}]},"ts":"1700391248972"} 2023-11-19 10:54:08,974 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-19 10:54:08,975 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-19 10:54:08,975 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700391248975"}]},"ts":"1700391248975"} 2023-11-19 10:54:08,976 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-11-19 10:54:08,980 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=94897ac05c23e41d94b8f8d3dcd0e973, ASSIGN}] 2023-11-19 10:54:08,981 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=94897ac05c23e41d94b8f8d3dcd0e973, ASSIGN 2023-11-19 10:54:08,981 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=94897ac05c23e41d94b8f8d3dcd0e973, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46035,1700391201579; forceNewPlan=false, retain=false 2023-11-19 10:54:09,132 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=94897ac05c23e41d94b8f8d3dcd0e973, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:09,133 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyPolicy,,1700391248149.94897ac05c23e41d94b8f8d3dcd0e973.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1700391249132"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700391249132"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700391249132"}]},"ts":"1700391249132"} 2023-11-19 10:54:09,134 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; OpenRegionProcedure 94897ac05c23e41d94b8f8d3dcd0e973, server=jenkins-hbase4.apache.org,46035,1700391201579}] 2023-11-19 10:54:09,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-19 10:54:09,285 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:09,288 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyPolicy,,1700391248149.94897ac05c23e41d94b8f8d3dcd0e973. 2023-11-19 10:54:09,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 94897ac05c23e41d94b8f8d3dcd0e973, NAME => 'testMajorCompactionWithWeeklyPolicy,,1700391248149.94897ac05c23e41d94b8f8d3dcd0e973.', STARTKEY => '', ENDKEY => ''} 2023-11-19 10:54:09,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyPolicy 94897ac05c23e41d94b8f8d3dcd0e973 2023-11-19 10:54:09,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1700391248149.94897ac05c23e41d94b8f8d3dcd0e973.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-19 10:54:09,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 94897ac05c23e41d94b8f8d3dcd0e973 2023-11-19 10:54:09,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 94897ac05c23e41d94b8f8d3dcd0e973 2023-11-19 10:54:09,290 INFO [StoreOpener-94897ac05c23e41d94b8f8d3dcd0e973-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 94897ac05c23e41d94b8f8d3dcd0e973 2023-11-19 10:54:09,291 DEBUG [StoreOpener-94897ac05c23e41d94b8f8d3dcd0e973-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1 2023-11-19 10:54:09,292 DEBUG [StoreOpener-94897ac05c23e41d94b8f8d3dcd0e973-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1 2023-11-19 10:54:09,292 INFO [StoreOpener-94897ac05c23e41d94b8f8d3dcd0e973-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 94897ac05c23e41d94b8f8d3dcd0e973 columnFamilyName family1 2023-11-19 10:54:09,293 INFO [StoreOpener-94897ac05c23e41d94b8f8d3dcd0e973-1] regionserver.HStore(310): Store=94897ac05c23e41d94b8f8d3dcd0e973/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-19 10:54:09,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973 2023-11-19 10:54:09,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973 2023-11-19 10:54:09,297 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 94897ac05c23e41d94b8f8d3dcd0e973 2023-11-19 10:54:09,300 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-19 10:54:09,301 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 94897ac05c23e41d94b8f8d3dcd0e973; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63934579, jitterRate=-0.04730053246021271}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-19 10:54:09,301 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 94897ac05c23e41d94b8f8d3dcd0e973: 2023-11-19 10:54:09,302 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyPolicy,,1700391248149.94897ac05c23e41d94b8f8d3dcd0e973., pid=37, masterSystemTime=1700391249285 2023-11-19 10:54:09,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyPolicy,,1700391248149.94897ac05c23e41d94b8f8d3dcd0e973. 2023-11-19 10:54:09,304 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyPolicy,,1700391248149.94897ac05c23e41d94b8f8d3dcd0e973. 2023-11-19 10:54:09,304 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=94897ac05c23e41d94b8f8d3dcd0e973, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:09,304 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyPolicy,,1700391248149.94897ac05c23e41d94b8f8d3dcd0e973.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1700391249304"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700391249304"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700391249304"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700391249304"}]},"ts":"1700391249304"} 2023-11-19 10:54:09,307 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=37, resume processing ppid=36 2023-11-19 10:54:09,307 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; OpenRegionProcedure 94897ac05c23e41d94b8f8d3dcd0e973, server=jenkins-hbase4.apache.org,46035,1700391201579 in 172 msec 2023-11-19 10:54:09,309 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=36, resume processing ppid=35 2023-11-19 10:54:09,309 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=94897ac05c23e41d94b8f8d3dcd0e973, ASSIGN in 327 msec 2023-11-19 10:54:09,310 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-19 10:54:09,310 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700391249310"}]},"ts":"1700391249310"} 2023-11-19 10:54:09,311 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-11-19 10:54:09,314 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-19 10:54:09,315 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy in 1.1650 sec 2023-11-19 10:54:09,323 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testScannerOnBulkLoadRefHFiles/cf60b3cd4f7a9228bda102f2a6171a3d/.tmp/family1/0b1222b14dac4a3e8ddb122d92e4de90 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testScannerOnBulkLoadRefHFiles/cf60b3cd4f7a9228bda102f2a6171a3d/family1/0b1222b14dac4a3e8ddb122d92e4de90 2023-11-19 10:54:09,328 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in cf60b3cd4f7a9228bda102f2a6171a3d/family1 of cf60b3cd4f7a9228bda102f2a6171a3d into 0b1222b14dac4a3e8ddb122d92e4de90(size=5.1 K), total size for store is 5.1 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-19 10:54:09,328 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for cf60b3cd4f7a9228bda102f2a6171a3d: 2023-11-19 10:54:09,328 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testScannerOnBulkLoadRefHFiles,2,1700391243138.cf60b3cd4f7a9228bda102f2a6171a3d., storeName=family1, fileCount=3, fileSize=15.1 K (4.9 K, 5.0 K, 5.2 K), priority=2, time=1700391248089; duration=1sec 2023-11-19 10:54:09,329 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-19 10:54:09,435 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testScannerOnBulkLoadRefHFiles/cf60b3cd4f7a9228bda102f2a6171a3d/family1/8cebbc0977834c31908f2696f3ce2266, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testScannerOnBulkLoadRefHFiles/cf60b3cd4f7a9228bda102f2a6171a3d/family1/edf7a8662cc84a2782967aee022c813e, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testScannerOnBulkLoadRefHFiles/cf60b3cd4f7a9228bda102f2a6171a3d/family1/de075168f0524eaca44ac025c3c8c24a_SeqId_12_] to archive 2023-11-19 10:54:09,436 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:54:09,437 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testScannerOnBulkLoadRefHFiles/cf60b3cd4f7a9228bda102f2a6171a3d/family1/8cebbc0977834c31908f2696f3ce2266 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testScannerOnBulkLoadRefHFiles/cf60b3cd4f7a9228bda102f2a6171a3d/family1/8cebbc0977834c31908f2696f3ce2266 2023-11-19 10:54:09,438 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testScannerOnBulkLoadRefHFiles/cf60b3cd4f7a9228bda102f2a6171a3d/family1/edf7a8662cc84a2782967aee022c813e to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testScannerOnBulkLoadRefHFiles/cf60b3cd4f7a9228bda102f2a6171a3d/family1/edf7a8662cc84a2782967aee022c813e 2023-11-19 10:54:09,440 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testScannerOnBulkLoadRefHFiles/cf60b3cd4f7a9228bda102f2a6171a3d/family1/de075168f0524eaca44ac025c3c8c24a_SeqId_12_ to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testScannerOnBulkLoadRefHFiles/cf60b3cd4f7a9228bda102f2a6171a3d/family1/de075168f0524eaca44ac025c3c8c24a_SeqId_12_ 2023-11-19 10:54:09,827 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-19 10:54:10,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-19 10:54:10,257 INFO [Listener at localhost/42675] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyPolicy, procId: 35 completed 2023-11-19 10:54:10,277 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:54:10,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:10,278 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-19 10:54:10,279 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:54:10,279 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-19 10:54:10,279 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-19 10:54:10,279 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:10,279 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:10,280 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:10,280 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:54:10,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:54:10,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:54:10,281 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:10,281 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:54:10,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:10,281 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:10,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:54:10,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:10,282 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:10,282 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:10,282 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-19 10:54:10,282 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:54:10,282 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-19 10:54:10,282 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-19 10:54:10,282 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:54:10,282 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700391248149.94897ac05c23e41d94b8f8d3dcd0e973. 2023-11-19 10:54:10,282 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700391248149.94897ac05c23e41d94b8f8d3dcd0e973. started... 2023-11-19 10:54:10,283 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 94897ac05c23e41d94b8f8d3dcd0e973 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-19 10:54:10,702 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130b10ce06bcf9c40459f879a825ebe5026 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130b10ce06bcf9c40459f879a825ebe5026 2023-11-19 10:54:11,106 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/.tmp/family1/7d7a694713884e9aa497a72b9433eb28 2023-11-19 10:54:11,111 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/.tmp/family1/7d7a694713884e9aa497a72b9433eb28 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/7d7a694713884e9aa497a72b9433eb28 2023-11-19 10:54:11,114 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/7d7a694713884e9aa497a72b9433eb28, entries=1000, sequenceid=5, filesize=165.1 K 2023-11-19 10:54:11,115 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 94897ac05c23e41d94b8f8d3dcd0e973 in 832ms, sequenceid=5, compaction requested=false 2023-11-19 10:54:11,115 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyPolicy' 2023-11-19 10:54:11,116 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 94897ac05c23e41d94b8f8d3dcd0e973: 2023-11-19 10:54:11,116 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700391248149.94897ac05c23e41d94b8f8d3dcd0e973. 2023-11-19 10:54:11,116 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-19 10:54:11,116 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-19 10:54:11,116 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:11,116 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-19 10:54:11,116 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-19 10:54:11,118 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:11,118 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:11,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:11,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:11,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:11,118 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:11,118 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:54:11,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:11,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:11,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:11,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:11,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:11,119 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-19 10:54:11,119 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@71c470d4[Count = 0] remaining members to acquire global barrier 2023-11-19 10:54:11,119 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-19 10:54:11,120 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:11,122 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:11,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:11,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:11,122 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-19 10:54:11,122 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-19 10:54:11,122 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:54:11,122 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:11,122 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:54:11,123 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-19 10:54:11,123 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:11,123 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:54:11,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:11,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:11,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:11,123 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-19 10:54:11,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:11,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:11,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:11,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:11,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:11,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:11,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:11,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:54:11,126 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-19 10:54:11,126 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-19 10:54:11,126 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:54:11,126 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:54:11,126 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:11,126 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:54:11,127 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:11,127 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:11,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:11,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:11,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:11,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:11,127 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:54:11,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:11,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:11,128 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:11,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:54:11,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:54:11,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:11,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:11,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:11,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:11,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:11,130 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:11,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:11,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:11,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:11,132 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:11,132 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:11,132 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:54:11,132 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:11,133 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:54:11,133 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:11,133 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-19 10:54:11,133 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:54:11,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:54:11,133 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:54:11,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:54:11,133 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:11,133 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:11,133 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:11,133 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-19 10:54:11,133 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:54:11,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:54:11,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:54:11,233 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:54:11,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:54:11,238 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:54:11,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-19 10:54:11,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:11,240 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-19 10:54:11,240 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:54:11,240 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-19 10:54:11,240 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-19 10:54:11,240 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:11,240 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:11,242 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:11,242 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:54:11,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:54:11,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:54:11,242 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:11,242 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:54:11,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:11,242 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:11,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:54:11,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:11,243 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:11,243 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-19 10:54:11,243 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:11,243 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-19 10:54:11,243 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:54:11,243 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-19 10:54:11,243 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-19 10:54:11,243 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:54:11,243 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700391248149.94897ac05c23e41d94b8f8d3dcd0e973. 2023-11-19 10:54:11,243 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700391248149.94897ac05c23e41d94b8f8d3dcd0e973. started... 2023-11-19 10:54:11,244 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 94897ac05c23e41d94b8f8d3dcd0e973 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-19 10:54:11,656 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511284214e0a16e1846eab54815038faa76a1 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511284214e0a16e1846eab54815038faa76a1 2023-11-19 10:54:12,062 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/.tmp/family1/24fc65f96d804069961e352db7406ed6 2023-11-19 10:54:12,067 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/.tmp/family1/24fc65f96d804069961e352db7406ed6 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/24fc65f96d804069961e352db7406ed6 2023-11-19 10:54:12,071 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/24fc65f96d804069961e352db7406ed6, entries=1, sequenceid=9, filesize=5.0 K 2023-11-19 10:54:12,072 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 94897ac05c23e41d94b8f8d3dcd0e973 in 828ms, sequenceid=9, compaction requested=false 2023-11-19 10:54:12,072 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 94897ac05c23e41d94b8f8d3dcd0e973: 2023-11-19 10:54:12,072 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700391248149.94897ac05c23e41d94b8f8d3dcd0e973. 2023-11-19 10:54:12,072 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-19 10:54:12,072 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-19 10:54:12,072 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:12,072 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-19 10:54:12,072 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-19 10:54:12,074 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:12,074 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:12,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:12,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:12,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:12,074 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:12,074 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:54:12,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:12,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:12,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:12,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:12,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:12,075 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-19 10:54:12,075 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4684d2a7[Count = 0] remaining members to acquire global barrier 2023-11-19 10:54:12,075 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-19 10:54:12,076 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:12,077 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:12,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:12,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:12,077 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-19 10:54:12,077 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-19 10:54:12,077 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:54:12,077 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:12,077 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:54:12,078 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-19 10:54:12,078 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:12,078 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:54:12,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:12,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:12,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:12,078 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-19 10:54:12,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:12,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:12,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:12,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:12,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:12,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:12,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:12,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:54:12,080 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-19 10:54:12,080 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-19 10:54:12,080 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:54:12,080 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:54:12,080 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:12,081 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:54:12,083 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:12,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:12,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:12,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:12,083 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:12,083 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:54:12,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:12,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:12,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:12,083 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:12,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:54:12,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:54:12,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:12,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:12,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:12,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:12,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:12,084 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:12,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:12,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:12,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:12,090 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:12,090 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:54:12,090 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:12,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:54:12,090 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:54:12,090 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:54:12,090 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-19 10:54:12,090 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:54:12,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:54:12,090 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:12,090 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:12,090 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:12,090 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:12,090 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:12,090 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-19 10:54:12,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:54:12,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:54:12,090 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:54:12,191 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:54:12,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:54:12,195 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:54:12,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-19 10:54:12,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:12,197 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-19 10:54:12,197 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:54:12,197 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-19 10:54:12,197 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-19 10:54:12,197 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:12,197 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:12,198 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:12,199 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:54:12,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:54:12,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:54:12,199 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:12,199 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:54:12,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:12,199 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:12,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:54:12,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:12,200 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:12,200 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-19 10:54:12,200 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:12,200 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-19 10:54:12,200 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:54:12,200 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-19 10:54:12,200 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-19 10:54:12,200 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:54:12,200 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700391248149.94897ac05c23e41d94b8f8d3dcd0e973. 2023-11-19 10:54:12,200 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700391248149.94897ac05c23e41d94b8f8d3dcd0e973. started... 2023-11-19 10:54:12,200 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 94897ac05c23e41d94b8f8d3dcd0e973 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-19 10:54:12,612 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201f82d07b6d73f49ffb69aa013ce748145 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201f82d07b6d73f49ffb69aa013ce748145 2023-11-19 10:54:13,018 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/.tmp/family1/e1408858e6594c8ca10d3505970c89c0 2023-11-19 10:54:13,022 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/.tmp/family1/e1408858e6594c8ca10d3505970c89c0 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/e1408858e6594c8ca10d3505970c89c0 2023-11-19 10:54:13,027 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/e1408858e6594c8ca10d3505970c89c0, entries=1, sequenceid=13, filesize=4.9 K 2023-11-19 10:54:13,027 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 94897ac05c23e41d94b8f8d3dcd0e973 in 827ms, sequenceid=13, compaction requested=true 2023-11-19 10:54:13,028 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 94897ac05c23e41d94b8f8d3dcd0e973: 2023-11-19 10:54:13,028 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700391248149.94897ac05c23e41d94b8f8d3dcd0e973. 2023-11-19 10:54:13,028 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-19 10:54:13,028 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-19 10:54:13,028 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:13,028 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-19 10:54:13,028 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-19 10:54:13,030 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:13,030 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:13,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:13,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:13,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:13,031 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:13,031 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:54:13,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:13,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:13,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:13,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:13,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:13,032 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-19 10:54:13,032 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1a0ffbcf[Count = 0] remaining members to acquire global barrier 2023-11-19 10:54:13,032 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-19 10:54:13,032 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:13,033 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:13,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:13,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:13,033 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-19 10:54:13,033 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-19 10:54:13,033 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:54:13,033 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:13,033 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:54:13,035 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-19 10:54:13,035 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:54:13,035 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:13,035 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-19 10:54:13,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:13,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:13,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:13,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:13,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:13,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:13,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:13,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:13,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:13,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:13,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:54:13,037 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-19 10:54:13,037 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-19 10:54:13,037 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:54:13,037 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:54:13,037 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:13,037 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:54:13,041 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:13,041 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:13,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:13,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:13,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:13,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:13,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:13,041 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:54:13,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:13,041 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:13,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:54:13,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:54:13,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:13,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:13,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:13,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:13,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:13,043 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:13,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:13,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:13,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:13,045 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:13,045 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:54:13,045 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:13,045 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:54:13,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:54:13,045 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-19 10:54:13,045 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:54:13,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:54:13,045 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:54:13,045 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:13,045 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:13,045 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:13,046 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:13,046 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:13,046 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-19 10:54:13,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:54:13,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:54:13,046 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:54:13,146 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:54:13,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:54:13,150 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:54:13,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-19 10:54:13,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:13,152 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-19 10:54:13,152 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:54:13,152 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-19 10:54:13,152 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-19 10:54:13,152 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:13,152 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:13,153 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:13,153 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:54:13,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:54:13,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:54:13,154 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:13,154 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:54:13,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:13,154 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:13,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:54:13,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:13,154 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:13,155 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-19 10:54:13,155 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:13,155 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-19 10:54:13,155 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:54:13,155 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-19 10:54:13,155 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-19 10:54:13,155 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:54:13,155 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700391248149.94897ac05c23e41d94b8f8d3dcd0e973. 2023-11-19 10:54:13,155 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700391248149.94897ac05c23e41d94b8f8d3dcd0e973. started... 2023-11-19 10:54:13,155 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 94897ac05c23e41d94b8f8d3dcd0e973 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-19 10:54:13,568 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512057d2d12c62dd64314bfef1768bcbf6cd5 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512057d2d12c62dd64314bfef1768bcbf6cd5 2023-11-19 10:54:13,974 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/.tmp/family1/71cc38396ae8475ca0a5f35bfc035e33 2023-11-19 10:54:13,979 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/.tmp/family1/71cc38396ae8475ca0a5f35bfc035e33 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/71cc38396ae8475ca0a5f35bfc035e33 2023-11-19 10:54:13,983 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/71cc38396ae8475ca0a5f35bfc035e33, entries=1, sequenceid=17, filesize=4.9 K 2023-11-19 10:54:13,984 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 94897ac05c23e41d94b8f8d3dcd0e973 in 829ms, sequenceid=17, compaction requested=true 2023-11-19 10:54:13,984 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 94897ac05c23e41d94b8f8d3dcd0e973: 2023-11-19 10:54:13,984 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700391248149.94897ac05c23e41d94b8f8d3dcd0e973. 2023-11-19 10:54:13,984 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-19 10:54:13,984 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-19 10:54:13,984 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:13,984 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-19 10:54:13,984 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-19 10:54:13,986 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:13,986 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:13,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:13,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:13,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:13,986 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:13,986 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:54:13,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:13,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:13,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:13,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:13,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:13,988 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-19 10:54:13,988 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@50968e5d[Count = 0] remaining members to acquire global barrier 2023-11-19 10:54:13,988 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-19 10:54:13,988 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:13,990 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:13,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:13,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:13,990 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-19 10:54:13,990 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-19 10:54:13,990 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:54:13,990 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:13,990 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:54:13,991 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-19 10:54:13,991 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:13,991 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:54:13,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:13,992 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-19 10:54:13,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:13,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:13,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:13,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:13,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:13,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:13,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:13,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:13,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:13,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:54:13,994 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-19 10:54:13,994 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-19 10:54:13,994 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:54:13,994 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:54:13,994 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:13,994 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:54:13,996 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:13,996 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:13,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:13,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:13,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:13,996 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:13,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:13,996 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:54:13,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:13,996 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:54:13,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:54:13,996 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:13,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:13,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:13,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:13,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:13,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:13,998 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:13,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:13,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:13,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:14,000 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:14,000 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:54:14,000 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:14,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:54:14,000 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:14,000 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-19 10:54:14,000 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:54:14,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:54:14,000 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:54:14,000 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:54:14,000 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:14,001 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:14,001 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:14,001 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-19 10:54:14,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:54:14,001 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:54:14,001 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:14,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:54:14,101 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:54:14,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:54:14,106 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:54:14,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-19 10:54:14,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:14,107 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-19 10:54:14,107 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:54:14,107 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-19 10:54:14,107 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-19 10:54:14,108 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:14,108 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:14,110 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:54:14,110 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:14,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:54:14,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:54:14,110 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:14,111 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:54:14,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:14,111 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:14,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:54:14,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:14,111 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:14,111 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-19 10:54:14,111 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:14,112 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-19 10:54:14,112 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:54:14,112 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-19 10:54:14,112 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-19 10:54:14,112 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:54:14,112 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700391248149.94897ac05c23e41d94b8f8d3dcd0e973. 2023-11-19 10:54:14,112 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700391248149.94897ac05c23e41d94b8f8d3dcd0e973. started... 2023-11-19 10:54:14,112 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 94897ac05c23e41d94b8f8d3dcd0e973 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-19 10:54:14,524 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122899fd238c7fe54249a59edfbf0b6ad97a to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015122899fd238c7fe54249a59edfbf0b6ad97a 2023-11-19 10:54:14,791 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-19 10:54:14,929 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/.tmp/family1/7ec1a1ee296f4cd4902e752154b38bf8 2023-11-19 10:54:14,934 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/.tmp/family1/7ec1a1ee296f4cd4902e752154b38bf8 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/7ec1a1ee296f4cd4902e752154b38bf8 2023-11-19 10:54:14,938 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/7ec1a1ee296f4cd4902e752154b38bf8, entries=1, sequenceid=21, filesize=4.9 K 2023-11-19 10:54:14,939 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 94897ac05c23e41d94b8f8d3dcd0e973 in 827ms, sequenceid=21, compaction requested=true 2023-11-19 10:54:14,939 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 94897ac05c23e41d94b8f8d3dcd0e973: 2023-11-19 10:54:14,939 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700391248149.94897ac05c23e41d94b8f8d3dcd0e973. 2023-11-19 10:54:14,939 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-19 10:54:14,939 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-19 10:54:14,939 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:14,939 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-19 10:54:14,939 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-19 10:54:14,941 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:14,941 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:14,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:14,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:14,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:14,941 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:14,941 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:54:14,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:14,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:14,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:14,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:14,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:14,943 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-19 10:54:14,943 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@206064b[Count = 0] remaining members to acquire global barrier 2023-11-19 10:54:14,943 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-19 10:54:14,943 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:14,944 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:14,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:14,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:14,944 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-19 10:54:14,944 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-19 10:54:14,944 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:54:14,944 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:14,944 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:54:14,946 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-19 10:54:14,946 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:14,946 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:54:14,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:14,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:14,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:14,946 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-19 10:54:14,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:14,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:14,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:14,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:14,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:14,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:14,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:14,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:54:14,948 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-19 10:54:14,948 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-19 10:54:14,948 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:54:14,948 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:54:14,948 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:14,948 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:54:14,953 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:14,953 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:14,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:14,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:14,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:14,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:14,953 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:54:14,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:14,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:14,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:54:14,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:54:14,953 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:14,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:14,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:14,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:14,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:14,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:14,955 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:14,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:14,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:14,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:14,958 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:14,958 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:54:14,958 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:14,958 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:54:14,958 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:14,958 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:54:14,958 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-19 10:54:14,958 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:54:14,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:54:14,958 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:14,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:54:14,958 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:14,958 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:14,958 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-19 10:54:14,958 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:54:14,958 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:14,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:54:14,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:54:15,058 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:54:15,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:54:15,063 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:54:15,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-19 10:54:15,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:15,064 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-19 10:54:15,065 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:54:15,065 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-19 10:54:15,065 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-19 10:54:15,065 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:15,065 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:15,066 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:15,066 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:54:15,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:54:15,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:54:15,067 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:15,067 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:54:15,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:15,067 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:15,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:54:15,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:15,067 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:15,068 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-19 10:54:15,068 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:15,068 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-19 10:54:15,068 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:54:15,068 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-19 10:54:15,068 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-19 10:54:15,068 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:54:15,068 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700391248149.94897ac05c23e41d94b8f8d3dcd0e973. 2023-11-19 10:54:15,068 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700391248149.94897ac05c23e41d94b8f8d3dcd0e973. started... 2023-11-19 10:54:15,068 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 94897ac05c23e41d94b8f8d3dcd0e973 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-19 10:54:15,483 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231d3acfd2a30f043d699e0d0e8ff9bea12 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231d3acfd2a30f043d699e0d0e8ff9bea12 2023-11-19 10:54:15,888 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/.tmp/family1/acb7940634834a788d005ee63286712a 2023-11-19 10:54:15,893 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/.tmp/family1/acb7940634834a788d005ee63286712a as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/acb7940634834a788d005ee63286712a 2023-11-19 10:54:15,898 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/acb7940634834a788d005ee63286712a, entries=1, sequenceid=25, filesize=4.9 K 2023-11-19 10:54:15,898 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 94897ac05c23e41d94b8f8d3dcd0e973 in 830ms, sequenceid=25, compaction requested=true 2023-11-19 10:54:15,898 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 94897ac05c23e41d94b8f8d3dcd0e973: 2023-11-19 10:54:15,899 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700391248149.94897ac05c23e41d94b8f8d3dcd0e973. 2023-11-19 10:54:15,899 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-19 10:54:15,899 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-19 10:54:15,899 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:15,899 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-19 10:54:15,899 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-19 10:54:15,900 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:15,900 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:15,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:15,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:15,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:15,901 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:15,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:15,901 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:54:15,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:15,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:15,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:15,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:15,902 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-19 10:54:15,902 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6277fd46[Count = 0] remaining members to acquire global barrier 2023-11-19 10:54:15,902 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-19 10:54:15,902 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:15,904 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:15,904 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:15,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:15,904 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-19 10:54:15,905 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-19 10:54:15,905 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:54:15,905 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:15,905 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:54:15,906 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-19 10:54:15,906 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:15,906 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:54:15,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:15,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:15,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:15,906 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-19 10:54:15,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:15,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:15,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:15,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:15,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:15,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:15,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:15,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:54:15,908 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-19 10:54:15,908 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-19 10:54:15,908 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:54:15,909 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:54:15,909 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:15,909 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:54:15,910 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:15,910 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:15,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:15,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:15,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:15,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:15,910 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:54:15,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:15,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:15,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:54:15,911 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:15,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:54:15,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:15,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:15,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:15,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:15,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:15,912 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:15,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:15,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:15,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:15,914 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:15,914 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:15,914 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:54:15,914 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:15,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:54:15,914 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-19 10:54:15,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:54:15,914 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-19 10:54:15,914 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:54:15,914 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:15,914 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:54:15,914 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:54:15,914 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:15,915 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:15,915 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-19 10:54:15,915 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:15,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:54:15,915 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:54:15,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:54:16,015 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:54:16,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:54:16,019 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:54:16,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-19 10:54:16,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:16,021 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-19 10:54:16,021 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:54:16,021 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-19 10:54:16,021 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-19 10:54:16,022 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:16,022 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:16,024 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:54:16,024 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:16,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:54:16,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:54:16,025 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:16,025 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:54:16,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:16,025 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:16,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:54:16,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:16,025 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:16,025 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-19 10:54:16,025 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:16,026 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-19 10:54:16,026 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:54:16,026 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-19 10:54:16,026 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-19 10:54:16,026 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:54:16,026 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700391248149.94897ac05c23e41d94b8f8d3dcd0e973. 2023-11-19 10:54:16,026 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700391248149.94897ac05c23e41d94b8f8d3dcd0e973. started... 2023-11-19 10:54:16,026 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 94897ac05c23e41d94b8f8d3dcd0e973 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-19 10:54:16,438 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601012f5278c1a2e54dadb85aae43a68dea56 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601012f5278c1a2e54dadb85aae43a68dea56 2023-11-19 10:54:16,844 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/.tmp/family1/c4caaec5716c412bad3e31085caf1e0f 2023-11-19 10:54:16,848 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/.tmp/family1/c4caaec5716c412bad3e31085caf1e0f as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/c4caaec5716c412bad3e31085caf1e0f 2023-11-19 10:54:16,852 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/c4caaec5716c412bad3e31085caf1e0f, entries=1, sequenceid=29, filesize=4.9 K 2023-11-19 10:54:16,853 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 94897ac05c23e41d94b8f8d3dcd0e973 in 827ms, sequenceid=29, compaction requested=true 2023-11-19 10:54:16,853 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 94897ac05c23e41d94b8f8d3dcd0e973: 2023-11-19 10:54:16,853 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700391248149.94897ac05c23e41d94b8f8d3dcd0e973. 2023-11-19 10:54:16,853 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-19 10:54:16,853 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-19 10:54:16,853 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:16,853 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-19 10:54:16,853 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-19 10:54:16,855 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:16,855 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:16,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:16,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:16,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:16,855 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:16,855 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:54:16,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:16,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:16,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:16,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:16,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:16,857 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-19 10:54:16,857 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@743a344[Count = 0] remaining members to acquire global barrier 2023-11-19 10:54:16,857 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-19 10:54:16,857 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:16,858 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:16,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:16,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:16,858 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-19 10:54:16,858 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-19 10:54:16,858 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:54:16,858 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:16,858 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:54:16,859 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-19 10:54:16,859 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:16,859 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:54:16,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:16,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:16,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:16,860 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-19 10:54:16,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:16,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:16,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:16,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:16,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:16,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:16,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:16,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:54:16,862 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-19 10:54:16,862 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-19 10:54:16,862 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:54:16,862 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:54:16,862 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:16,862 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:54:16,868 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:16,868 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:16,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:16,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:16,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:16,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:16,868 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:54:16,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:16,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:16,869 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:16,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:54:16,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:16,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:54:16,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:16,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:16,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:16,870 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:16,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:16,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:16,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:16,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:16,872 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:16,872 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:54:16,872 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:16,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:54:16,872 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:54:16,872 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-19 10:54:16,872 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-19 10:54:16,872 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:54:16,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:54:16,872 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:54:16,872 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:16,872 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:16,872 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:16,872 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:16,872 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-19 10:54:16,873 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:54:16,872 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:16,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:54:16,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:54:16,973 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:54:16,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:54:16,978 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:54:16,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-19 10:54:16,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:16,980 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-19 10:54:16,980 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:54:16,980 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-19 10:54:16,980 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-19 10:54:16,980 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:16,980 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:16,982 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:16,982 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:54:16,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:54:16,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:54:16,982 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:16,982 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:54:16,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:16,983 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:16,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:54:16,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:16,983 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:16,984 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-19 10:54:16,984 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:16,984 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-19 10:54:16,984 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:54:16,984 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-19 10:54:16,984 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-19 10:54:16,984 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:54:16,984 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700391248149.94897ac05c23e41d94b8f8d3dcd0e973. 2023-11-19 10:54:16,984 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700391248149.94897ac05c23e41d94b8f8d3dcd0e973. started... 2023-11-19 10:54:16,984 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 94897ac05c23e41d94b8f8d3dcd0e973 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-19 10:54:17,399 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010320530837789c42e49af832f2d4609c91 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010320530837789c42e49af832f2d4609c91 2023-11-19 10:54:17,804 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/.tmp/family1/543de5766d744e6897fd3534b3ba7a1f 2023-11-19 10:54:17,809 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/.tmp/family1/543de5766d744e6897fd3534b3ba7a1f as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/543de5766d744e6897fd3534b3ba7a1f 2023-11-19 10:54:17,813 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/543de5766d744e6897fd3534b3ba7a1f, entries=1, sequenceid=33, filesize=4.9 K 2023-11-19 10:54:17,813 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 94897ac05c23e41d94b8f8d3dcd0e973 in 829ms, sequenceid=33, compaction requested=true 2023-11-19 10:54:17,814 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 94897ac05c23e41d94b8f8d3dcd0e973: 2023-11-19 10:54:17,814 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700391248149.94897ac05c23e41d94b8f8d3dcd0e973. 2023-11-19 10:54:17,814 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-19 10:54:17,814 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-19 10:54:17,814 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:17,814 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-19 10:54:17,814 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-19 10:54:17,815 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:17,815 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:17,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:17,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:17,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:17,816 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:17,816 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:54:17,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:17,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:17,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:17,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:17,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:17,817 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-19 10:54:17,817 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@63c33197[Count = 0] remaining members to acquire global barrier 2023-11-19 10:54:17,817 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-19 10:54:17,817 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:17,821 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:17,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:17,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:17,821 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-19 10:54:17,821 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-19 10:54:17,821 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:54:17,821 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:17,821 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:54:17,823 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-19 10:54:17,823 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:17,823 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:54:17,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:17,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:17,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:17,823 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-19 10:54:17,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:17,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:17,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:17,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:17,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:17,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:17,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:17,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:54:17,825 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-19 10:54:17,825 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-19 10:54:17,825 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:54:17,825 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:54:17,826 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:17,826 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:54:17,827 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:17,827 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:17,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:17,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:17,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:17,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:17,827 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:54:17,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:17,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:17,828 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:54:17,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:54:17,828 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:17,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:17,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:17,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:17,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:17,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:17,829 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:17,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:17,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:17,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:17,832 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:17,832 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:54:17,832 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:54:17,832 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:17,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:54:17,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:54:17,832 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:54:17,832 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-19 10:54:17,832 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:54:17,832 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:17,832 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:17,832 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:17,832 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:17,832 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:17,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:54:17,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:54:17,833 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-19 10:54:17,833 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:54:17,933 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:54:17,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:54:17,937 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:54:17,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-19 10:54:17,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:17,939 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-19 10:54:17,939 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:54:17,939 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-19 10:54:17,939 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-19 10:54:17,939 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:17,940 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:17,941 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:17,941 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:54:17,941 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:54:17,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:54:17,941 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:17,941 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:54:17,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:17,941 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:17,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:54:17,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:17,942 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:17,942 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-19 10:54:17,942 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:17,942 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-19 10:54:17,942 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:54:17,942 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-19 10:54:17,942 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-19 10:54:17,942 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:54:17,942 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700391248149.94897ac05c23e41d94b8f8d3dcd0e973. 2023-11-19 10:54:17,942 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700391248149.94897ac05c23e41d94b8f8d3dcd0e973. started... 2023-11-19 10:54:17,942 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 94897ac05c23e41d94b8f8d3dcd0e973 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-19 10:54:18,355 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907aa2d5189eac9411db43c73c88fe0bb36 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20150907aa2d5189eac9411db43c73c88fe0bb36 2023-11-19 10:54:18,760 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/.tmp/family1/ec2224045d304863acb7709ce09aad90 2023-11-19 10:54:18,765 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/.tmp/family1/ec2224045d304863acb7709ce09aad90 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/ec2224045d304863acb7709ce09aad90 2023-11-19 10:54:18,769 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/ec2224045d304863acb7709ce09aad90, entries=1, sequenceid=37, filesize=4.9 K 2023-11-19 10:54:18,770 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 94897ac05c23e41d94b8f8d3dcd0e973 in 828ms, sequenceid=37, compaction requested=true 2023-11-19 10:54:18,770 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 94897ac05c23e41d94b8f8d3dcd0e973: 2023-11-19 10:54:18,770 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700391248149.94897ac05c23e41d94b8f8d3dcd0e973. 2023-11-19 10:54:18,770 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-19 10:54:18,770 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-19 10:54:18,770 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:18,770 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-19 10:54:18,770 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-19 10:54:18,772 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:18,772 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:18,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:18,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:18,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:18,773 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:18,773 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:54:18,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:18,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:18,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:18,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:18,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:18,774 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-19 10:54:18,774 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@51c547fa[Count = 0] remaining members to acquire global barrier 2023-11-19 10:54:18,774 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-19 10:54:18,774 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:18,775 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:18,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:18,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:18,775 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-19 10:54:18,775 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-19 10:54:18,775 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:54:18,775 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:18,775 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:54:18,777 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-19 10:54:18,777 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:54:18,777 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:18,777 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-19 10:54:18,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:18,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:18,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:18,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:18,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:18,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:18,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:18,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:18,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:18,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:18,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:54:18,780 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-19 10:54:18,780 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-19 10:54:18,780 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:54:18,780 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:54:18,780 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:18,780 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:54:18,781 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:18,781 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:18,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:18,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:18,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:18,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:18,781 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:54:18,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:18,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:18,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:54:18,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:54:18,782 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:18,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:18,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:18,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:18,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:18,783 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:18,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:18,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:18,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:18,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:18,786 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:18,786 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:54:18,786 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:18,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:54:18,787 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-19 10:54:18,786 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-19 10:54:18,787 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:54:18,786 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:18,786 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:54:18,786 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:54:18,787 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:18,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:54:18,787 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-19 10:54:18,787 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:54:18,787 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:18,787 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:18,787 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:18,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:54:18,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:54:18,887 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:54:18,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:54:18,891 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:54:18,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-19 10:54:18,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:18,893 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-19 10:54:18,893 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:54:18,893 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-19 10:54:18,893 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-19 10:54:18,894 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:18,894 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:18,895 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:18,895 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:54:18,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:54:18,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:54:18,895 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:18,895 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:54:18,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:18,895 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:18,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:54:18,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:18,896 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:18,896 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-19 10:54:18,896 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:18,896 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-19 10:54:18,896 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:54:18,896 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-19 10:54:18,896 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-19 10:54:18,896 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:54:18,896 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700391248149.94897ac05c23e41d94b8f8d3dcd0e973. 2023-11-19 10:54:18,896 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700391248149.94897ac05c23e41d94b8f8d3dcd0e973. started... 2023-11-19 10:54:18,896 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 94897ac05c23e41d94b8f8d3dcd0e973 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-19 10:54:19,308 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120c1a0b4cadb634fa9a0c6804192dd08f4 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151120c1a0b4cadb634fa9a0c6804192dd08f4 2023-11-19 10:54:19,714 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/.tmp/family1/2af7a496bba0412f802e68b9f71ad909 2023-11-19 10:54:19,718 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/.tmp/family1/2af7a496bba0412f802e68b9f71ad909 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/2af7a496bba0412f802e68b9f71ad909 2023-11-19 10:54:19,722 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/2af7a496bba0412f802e68b9f71ad909, entries=1, sequenceid=41, filesize=4.9 K 2023-11-19 10:54:19,723 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 94897ac05c23e41d94b8f8d3dcd0e973 in 827ms, sequenceid=41, compaction requested=true 2023-11-19 10:54:19,723 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 94897ac05c23e41d94b8f8d3dcd0e973: 2023-11-19 10:54:19,723 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700391248149.94897ac05c23e41d94b8f8d3dcd0e973. 2023-11-19 10:54:19,723 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-19 10:54:19,723 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-19 10:54:19,723 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:19,723 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-19 10:54:19,723 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-19 10:54:19,725 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:19,725 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:19,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:19,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:19,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:19,725 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:19,725 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:54:19,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:19,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:19,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:19,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:19,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:19,727 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-19 10:54:19,727 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-19 10:54:19,727 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@c850d49[Count = 0] remaining members to acquire global barrier 2023-11-19 10:54:19,727 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:19,728 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:19,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:19,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:19,728 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-19 10:54:19,728 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-19 10:54:19,728 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:54:19,728 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:19,728 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:54:19,730 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-19 10:54:19,730 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:19,730 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:54:19,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:19,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:19,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:19,730 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-19 10:54:19,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:19,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:19,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:19,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:19,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:19,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:19,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:19,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:54:19,733 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-19 10:54:19,733 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-19 10:54:19,733 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:54:19,733 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:54:19,733 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:19,733 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:54:19,734 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:19,734 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:19,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:19,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:19,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:19,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:19,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:19,734 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:54:19,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:54:19,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:54:19,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:19,735 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:19,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:19,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:19,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:19,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:19,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:19,736 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:19,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:19,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:19,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:19,741 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:19,741 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:19,741 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:54:19,741 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:19,741 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:54:19,741 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:19,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:54:19,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:54:19,741 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:54:19,741 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:19,741 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-19 10:54:19,741 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:54:19,741 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:19,741 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:19,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:54:19,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:54:19,741 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-19 10:54:19,741 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:54:19,841 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:54:19,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:54:19,843 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=33457] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyPolicy 2023-11-19 10:54:19,845 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] procedure2.ProcedureExecutor(1028): Stored pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-19 10:54:19,846 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-19 10:54:19,846 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-19 10:54:19,846 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=38, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700391859846 2023-11-19 10:54:19,848 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-19 10:54:19,850 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyPolicy' and column 'family1' 2023-11-19 10:54:19,850 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-19 10:54:19,851 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] zookeeper.ReadOnlyZKClient(139): Connect 0x6ef2d67e to 127.0.0.1:60497 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-19 10:54:19,856 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4ff5a01b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-19 10:54:19,856 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-19 10:54:20,694 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010395419bd6f04443e785f282bad08c921f to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010395419bd6f04443e785f282bad08c921f 2023-11-19 10:54:20,695 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-19 10:54:20,708 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-19 10:54:20,709 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58054, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-19 10:54:20,715 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-19 10:54:20,716 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60742, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-19 10:54:20,726 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/133560652e514d8e8ab2754394b9c77f first=Optional[r3] last=Optional[r6] 2023-11-19 10:54:20,726 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1700391248149.94897ac05c23e41d94b8f8d3dcd0e973., hostname=jenkins-hbase4.apache.org,46035,1700391201579, seqNum=2 for row with hfile group [{family1,hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/133560652e514d8e8ab2754394b9c77f}] 2023-11-19 10:54:20,731 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(763): Validating hfile at hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/133560652e514d8e8ab2754394b9c77f for inclusion in 94897ac05c23e41d94b8f8d3dcd0e973/family1 2023-11-19 10:54:20,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-19 10:54:20,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(777): Region bounds: first= last= 2023-11-19 10:54:20,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegion(2446): Flush status journal for 94897ac05c23e41d94b8f8d3dcd0e973: 2023-11-19 10:54:20,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/133560652e514d8e8ab2754394b9c77f to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionWithWeeklyPolicy__46hrcrjvke5bv3fb879klcvp1vkptlc5hkc21cn793pv3lvrj6936r2sb888qckg/family1/133560652e514d8e8ab2754394b9c77f 2023-11-19 10:54:20,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionWithWeeklyPolicy__46hrcrjvke5bv3fb879klcvp1vkptlc5hkc21cn793pv3lvrj6936r2sb888qckg/family1/133560652e514d8e8ab2754394b9c77f as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/fd016356c660480d906d20f9cebb88f8_SeqId_44_ 2023-11-19 10:54:20,738 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(849): Loaded HFile hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionWithWeeklyPolicy__46hrcrjvke5bv3fb879klcvp1vkptlc5hkc21cn793pv3lvrj6936r2sb888qckg/family1/133560652e514d8e8ab2754394b9c77f into 94897ac05c23e41d94b8f8d3dcd0e973/family1 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/fd016356c660480d906d20f9cebb88f8_SeqId_44_ - updating store file list. 2023-11-19 10:54:20,741 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(882): Loaded HFile hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/fd016356c660480d906d20f9cebb88f8_SeqId_44_ into 94897ac05c23e41d94b8f8d3dcd0e973/family1 2023-11-19 10:54:20,741 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(855): Successfully loaded hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionWithWeeklyPolicy__46hrcrjvke5bv3fb879klcvp1vkptlc5hkc21cn793pv3lvrj6936r2sb888qckg/family1/133560652e514d8e8ab2754394b9c77f into 94897ac05c23e41d94b8f8d3dcd0e973/family1 (new location: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/fd016356c660480d906d20f9cebb88f8_SeqId_44_) 2023-11-19 10:54:20,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionWithWeeklyPolicy__46hrcrjvke5bv3fb879klcvp1vkptlc5hkc21cn793pv3lvrj6936r2sb888qckg/family1/133560652e514d8e8ab2754394b9c77f 2023-11-19 10:54:20,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-19 10:54:20,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-19 10:54:20,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(1912): 94897ac05c23e41d94b8f8d3dcd0e973/family1 is initiating minor compaction 2023-11-19 10:54:20,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@4a3e4cc7; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-19 10:54:20,745 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 94897ac05c23e41d94b8f8d3dcd0e973/family1 in testMajorCompactionWithWeeklyPolicy,,1700391248149.94897ac05c23e41d94b8f8d3dcd0e973. 2023-11-19 10:54:20,745 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/24fc65f96d804069961e352db7406ed6, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/e1408858e6594c8ca10d3505970c89c0, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/71cc38396ae8475ca0a5f35bfc035e33, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/7ec1a1ee296f4cd4902e752154b38bf8, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/acb7940634834a788d005ee63286712a, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/c4caaec5716c412bad3e31085caf1e0f, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/543de5766d744e6897fd3534b3ba7a1f, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/ec2224045d304863acb7709ce09aad90, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/2af7a496bba0412f802e68b9f71ad909, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/fd016356c660480d906d20f9cebb88f8_SeqId_44_] into tmpdir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/.tmp, totalSize=50.0 K 2023-11-19 10:54:20,745 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting 24fc65f96d804069961e352db7406ed6, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-19 10:54:20,745 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting e1408858e6594c8ca10d3505970c89c0, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-19 10:54:20,746 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting 71cc38396ae8475ca0a5f35bfc035e33, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-19 10:54:20,746 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting 7ec1a1ee296f4cd4902e752154b38bf8, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-19 10:54:20,746 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting acb7940634834a788d005ee63286712a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-19 10:54:20,746 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting c4caaec5716c412bad3e31085caf1e0f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-19 10:54:20,746 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting 543de5766d744e6897fd3534b3ba7a1f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-19 10:54:20,746 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting ec2224045d304863acb7709ce09aad90, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-19 10:54:20,746 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting 2af7a496bba0412f802e68b9f71ad909, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-19 10:54:20,746 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting fd016356c660480d906d20f9cebb88f8_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-19 10:54:20,747 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-19 10:54:20,748 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:54:20,749 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015122899fd238c7fe54249a59edfbf0b6ad97a to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015122899fd238c7fe54249a59edfbf0b6ad97a 2023-11-19 10:54:20,750 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231d3acfd2a30f043d699e0d0e8ff9bea12 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231d3acfd2a30f043d699e0d0e8ff9bea12 2023-11-19 10:54:20,752 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601012f5278c1a2e54dadb85aae43a68dea56 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601012f5278c1a2e54dadb85aae43a68dea56 2023-11-19 10:54:20,753 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010320530837789c42e49af832f2d4609c91 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010320530837789c42e49af832f2d4609c91 2023-11-19 10:54:20,753 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-11-19 10:54:20,753 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-19 10:54:20,753 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-19 10:54:20,754 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-19 10:54:20,754 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-19 10:54:20,754 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-19 10:54:20,754 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-19 10:54:20,754 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-19 10:54:20,754 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-19 10:54:20,754 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-19 10:54:20,783 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] throttle.PressureAwareThroughputController(145): 94897ac05c23e41d94b8f8d3dcd0e973#family1#compaction#49 average throughput is 1.36 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-19 10:54:20,815 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/.tmp/family1/d18398cbf5d1400fa7e82d0f250f4137 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/d18398cbf5d1400fa7e82d0f250f4137 2023-11-19 10:54:20,820 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 94897ac05c23e41d94b8f8d3dcd0e973/family1 of 94897ac05c23e41d94b8f8d3dcd0e973 into d18398cbf5d1400fa7e82d0f250f4137(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-19 10:54:20,820 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 94897ac05c23e41d94b8f8d3dcd0e973: 2023-11-19 10:54:20,820 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1700391248149.94897ac05c23e41d94b8f8d3dcd0e973., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1700391260745; duration=0sec 2023-11-19 10:54:20,820 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-19 10:54:20,834 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/24fc65f96d804069961e352db7406ed6, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/e1408858e6594c8ca10d3505970c89c0, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/71cc38396ae8475ca0a5f35bfc035e33, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/7ec1a1ee296f4cd4902e752154b38bf8, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/acb7940634834a788d005ee63286712a, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/c4caaec5716c412bad3e31085caf1e0f, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/543de5766d744e6897fd3534b3ba7a1f, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/ec2224045d304863acb7709ce09aad90, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/2af7a496bba0412f802e68b9f71ad909, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/fd016356c660480d906d20f9cebb88f8_SeqId_44_] to archive 2023-11-19 10:54:20,834 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:54:20,836 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/24fc65f96d804069961e352db7406ed6 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/24fc65f96d804069961e352db7406ed6 2023-11-19 10:54:20,837 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/e1408858e6594c8ca10d3505970c89c0 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/e1408858e6594c8ca10d3505970c89c0 2023-11-19 10:54:20,838 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/71cc38396ae8475ca0a5f35bfc035e33 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/71cc38396ae8475ca0a5f35bfc035e33 2023-11-19 10:54:20,839 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/7ec1a1ee296f4cd4902e752154b38bf8 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/7ec1a1ee296f4cd4902e752154b38bf8 2023-11-19 10:54:20,840 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/acb7940634834a788d005ee63286712a to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/acb7940634834a788d005ee63286712a 2023-11-19 10:54:20,841 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/c4caaec5716c412bad3e31085caf1e0f to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/c4caaec5716c412bad3e31085caf1e0f 2023-11-19 10:54:20,843 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/543de5766d744e6897fd3534b3ba7a1f to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/543de5766d744e6897fd3534b3ba7a1f 2023-11-19 10:54:20,844 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/ec2224045d304863acb7709ce09aad90 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/ec2224045d304863acb7709ce09aad90 2023-11-19 10:54:20,845 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/2af7a496bba0412f802e68b9f71ad909 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/2af7a496bba0412f802e68b9f71ad909 2023-11-19 10:54:20,846 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/fd016356c660480d906d20f9cebb88f8_SeqId_44_ to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/fd016356c660480d906d20f9cebb88f8_SeqId_44_ 2023-11-19 10:54:21,218 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205bc452c49cb3241869ea0013afc2c2210 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205bc452c49cb3241869ea0013afc2c2210 2023-11-19 10:54:21,219 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-19 10:54:21,250 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/b4cf027e73854a34b7942fa2aea989b5 first=Optional[r00] last=Optional[r2] 2023-11-19 10:54:21,250 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1700391248149.94897ac05c23e41d94b8f8d3dcd0e973., hostname=jenkins-hbase4.apache.org,46035,1700391201579, seqNum=2 for row with hfile group [{family1,hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/b4cf027e73854a34b7942fa2aea989b5}] 2023-11-19 10:54:21,252 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(763): Validating hfile at hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/b4cf027e73854a34b7942fa2aea989b5 for inclusion in 94897ac05c23e41d94b8f8d3dcd0e973/family1 2023-11-19 10:54:21,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-19 10:54:21,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(777): Region bounds: first= last= 2023-11-19 10:54:21,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegion(2446): Flush status journal for 94897ac05c23e41d94b8f8d3dcd0e973: 2023-11-19 10:54:21,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/b4cf027e73854a34b7942fa2aea989b5 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionWithWeeklyPolicy__2h8fjtff7pdbno2q2l19gqo63ouiq20n9sf0cuueim758o1optht5m8mju6mn35u/family1/b4cf027e73854a34b7942fa2aea989b5 2023-11-19 10:54:21,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionWithWeeklyPolicy__2h8fjtff7pdbno2q2l19gqo63ouiq20n9sf0cuueim758o1optht5m8mju6mn35u/family1/b4cf027e73854a34b7942fa2aea989b5 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/bb6505bfe70442bc94d20beb57360625_SeqId_47_ 2023-11-19 10:54:21,259 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(849): Loaded HFile hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionWithWeeklyPolicy__2h8fjtff7pdbno2q2l19gqo63ouiq20n9sf0cuueim758o1optht5m8mju6mn35u/family1/b4cf027e73854a34b7942fa2aea989b5 into 94897ac05c23e41d94b8f8d3dcd0e973/family1 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/bb6505bfe70442bc94d20beb57360625_SeqId_47_ - updating store file list. 2023-11-19 10:54:21,263 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(882): Loaded HFile hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/bb6505bfe70442bc94d20beb57360625_SeqId_47_ into 94897ac05c23e41d94b8f8d3dcd0e973/family1 2023-11-19 10:54:21,263 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(855): Successfully loaded hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionWithWeeklyPolicy__2h8fjtff7pdbno2q2l19gqo63ouiq20n9sf0cuueim758o1optht5m8mju6mn35u/family1/b4cf027e73854a34b7942fa2aea989b5 into 94897ac05c23e41d94b8f8d3dcd0e973/family1 (new location: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/bb6505bfe70442bc94d20beb57360625_SeqId_47_) 2023-11-19 10:54:21,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionWithWeeklyPolicy__2h8fjtff7pdbno2q2l19gqo63ouiq20n9sf0cuueim758o1optht5m8mju6mn35u/family1/b4cf027e73854a34b7942fa2aea989b5 2023-11-19 10:54:21,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-19 10:54:21,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 345120 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-19 10:54:21,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(1912): 94897ac05c23e41d94b8f8d3dcd0e973/family1 is initiating minor compaction (all files) 2023-11-19 10:54:21,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@1c93c97f; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-19 10:54:21,264 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 94897ac05c23e41d94b8f8d3dcd0e973/family1 in testMajorCompactionWithWeeklyPolicy,,1700391248149.94897ac05c23e41d94b8f8d3dcd0e973. 2023-11-19 10:54:21,264 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/7d7a694713884e9aa497a72b9433eb28, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/d18398cbf5d1400fa7e82d0f250f4137, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/bb6505bfe70442bc94d20beb57360625_SeqId_47_] into tmpdir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/.tmp, totalSize=337.0 K 2023-11-19 10:54:21,265 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting 7d7a694713884e9aa497a72b9433eb28, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878825094 2023-11-19 10:54:21,265 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting d18398cbf5d1400fa7e82d0f250f4137, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621225094 2023-11-19 10:54:21,266 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting bb6505bfe70442bc94d20beb57360625_SeqId_47_, keycount=1002, bloomtype=ROW, size=165.4 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878825094 2023-11-19 10:54:21,266 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-19 10:54:21,266 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:54:21,268 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130b10ce06bcf9c40459f879a825ebe5026 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130b10ce06bcf9c40459f879a825ebe5026 2023-11-19 10:54:21,269 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201f82d07b6d73f49ffb69aa013ce748145 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201f82d07b6d73f49ffb69aa013ce748145 2023-11-19 10:54:21,270 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512057d2d12c62dd64314bfef1768bcbf6cd5 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512057d2d12c62dd64314bfef1768bcbf6cd5 2023-11-19 10:54:21,270 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 3 expired mob files are deleted 2023-11-19 10:54:21,270 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-19 10:54:21,270 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-19 10:54:21,270 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-19 10:54:21,271 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-19 10:54:21,271 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=38, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-19 10:54:21,273 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=38, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.4270 sec 2023-11-19 10:54:21,283 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] throttle.PressureAwareThroughputController(145): 94897ac05c23e41d94b8f8d3dcd0e973#family1#compaction#50 average throughput is 17.18 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-19 10:54:21,378 INFO [Listener at localhost/42675] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=252 (was 252), OpenFileDescriptor=645 (was 627) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=179 (was 211), ProcessCount=172 (was 172), AvailableMemoryMB=15467 (was 15471) 2023-11-19 10:54:21,391 INFO [Listener at localhost/42675] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=252, OpenFileDescriptor=645, MaxFileDescriptor=60000, SystemLoadAverage=179, ProcessCount=172, AvailableMemoryMB=15466 2023-11-19 10:54:21,393 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-19 10:54:21,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure2.ProcedureExecutor(1028): Stored pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:21,395 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_PRE_OPERATION 2023-11-19 10:54:21,395 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly" procId is: 39 2023-11-19 10:54:21,396 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-19 10:54:21,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-19 10:54:21,397 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a 2023-11-19 10:54:21,398 DEBUG [HFileArchiver-9] backup.HFileArchiver(153): Directory hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a empty. 2023-11-19 10:54:21,398 DEBUG [HFileArchiver-9] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a 2023-11-19 10:54:21,398 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly regions 2023-11-19 10:54:21,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-19 10:54:21,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-19 10:54:21,731 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/.tmp/family1/6c794881158341a19bc3a40070813e0a as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/6c794881158341a19bc3a40070813e0a 2023-11-19 10:54:21,736 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 94897ac05c23e41d94b8f8d3dcd0e973/family1 of 94897ac05c23e41d94b8f8d3dcd0e973 into 6c794881158341a19bc3a40070813e0a(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-19 10:54:21,736 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 94897ac05c23e41d94b8f8d3dcd0e973: 2023-11-19 10:54:21,736 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1700391248149.94897ac05c23e41d94b8f8d3dcd0e973., storeName=family1, fileCount=3, fileSize=337.0 K (165.1 K, 6.6 K, 165.4 K), priority=2, time=1700391261264; duration=0sec 2023-11-19 10:54:21,736 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-19 10:54:21,807 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-11-19 10:54:21,809 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(7675): creating {ENCODED => 81401826ca044bcce6b358200c9c2f2a, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp 2023-11-19 10:54:21,828 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/7d7a694713884e9aa497a72b9433eb28, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/d18398cbf5d1400fa7e82d0f250f4137, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/bb6505bfe70442bc94d20beb57360625_SeqId_47_] to archive 2023-11-19 10:54:21,828 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:54:21,830 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/7d7a694713884e9aa497a72b9433eb28 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/7d7a694713884e9aa497a72b9433eb28 2023-11-19 10:54:21,831 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/d18398cbf5d1400fa7e82d0f250f4137 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/d18398cbf5d1400fa7e82d0f250f4137 2023-11-19 10:54:21,832 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/bb6505bfe70442bc94d20beb57360625_SeqId_47_ to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/family1/bb6505bfe70442bc94d20beb57360625_SeqId_47_ 2023-11-19 10:54:21,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-19 10:54:22,214 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-19 10:54:22,215 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1604): Closing 81401826ca044bcce6b358200c9c2f2a, disabling compactions & flushes 2023-11-19 10:54:22,215 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a. 2023-11-19 10:54:22,215 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a. 2023-11-19 10:54:22,215 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a. after waiting 0 ms 2023-11-19 10:54:22,215 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a. 2023-11-19 10:54:22,215 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a. 2023-11-19 10:54:22,215 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1558): Region close journal for 81401826ca044bcce6b358200c9c2f2a: 2023-11-19 10:54:22,218 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ADD_TO_META 2023-11-19 10:54:22,219 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700391262218"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700391262218"}]},"ts":"1700391262218"} 2023-11-19 10:54:22,220 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-19 10:54:22,221 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-19 10:54:22,221 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700391262221"}]},"ts":"1700391262221"} 2023-11-19 10:54:22,222 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLING in hbase:meta 2023-11-19 10:54:22,225 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=81401826ca044bcce6b358200c9c2f2a, ASSIGN}] 2023-11-19 10:54:22,226 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=81401826ca044bcce6b358200c9c2f2a, ASSIGN 2023-11-19 10:54:22,227 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=81401826ca044bcce6b358200c9c2f2a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46035,1700391201579; forceNewPlan=false, retain=false 2023-11-19 10:54:22,378 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=81401826ca044bcce6b358200c9c2f2a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:22,378 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700391262378"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700391262378"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700391262378"}]},"ts":"1700391262378"} 2023-11-19 10:54:22,380 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=41, ppid=40, state=RUNNABLE; OpenRegionProcedure 81401826ca044bcce6b358200c9c2f2a, server=jenkins-hbase4.apache.org,46035,1700391201579}] 2023-11-19 10:54:22,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-19 10:54:22,531 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:22,534 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a. 2023-11-19 10:54:22,534 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 81401826ca044bcce6b358200c9c2f2a, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a.', STARTKEY => '', ENDKEY => ''} 2023-11-19 10:54:22,534 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 81401826ca044bcce6b358200c9c2f2a 2023-11-19 10:54:22,534 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-19 10:54:22,534 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 81401826ca044bcce6b358200c9c2f2a 2023-11-19 10:54:22,534 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 81401826ca044bcce6b358200c9c2f2a 2023-11-19 10:54:22,536 INFO [StoreOpener-81401826ca044bcce6b358200c9c2f2a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 81401826ca044bcce6b358200c9c2f2a 2023-11-19 10:54:22,537 DEBUG [StoreOpener-81401826ca044bcce6b358200c9c2f2a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1 2023-11-19 10:54:22,537 DEBUG [StoreOpener-81401826ca044bcce6b358200c9c2f2a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1 2023-11-19 10:54:22,537 INFO [StoreOpener-81401826ca044bcce6b358200c9c2f2a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 81401826ca044bcce6b358200c9c2f2a columnFamilyName family1 2023-11-19 10:54:22,538 INFO [StoreOpener-81401826ca044bcce6b358200c9c2f2a-1] regionserver.HStore(310): Store=81401826ca044bcce6b358200c9c2f2a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-19 10:54:22,539 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a 2023-11-19 10:54:22,540 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a 2023-11-19 10:54:22,542 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 81401826ca044bcce6b358200c9c2f2a 2023-11-19 10:54:22,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-19 10:54:22,544 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 81401826ca044bcce6b358200c9c2f2a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72113739, jitterRate=0.07457844913005829}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-19 10:54:22,544 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 81401826ca044bcce6b358200c9c2f2a: 2023-11-19 10:54:22,545 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a., pid=41, masterSystemTime=1700391262531 2023-11-19 10:54:22,546 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a. 2023-11-19 10:54:22,546 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a. 2023-11-19 10:54:22,546 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=81401826ca044bcce6b358200c9c2f2a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:22,546 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700391262546"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700391262546"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700391262546"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700391262546"}]},"ts":"1700391262546"} 2023-11-19 10:54:22,549 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=41, resume processing ppid=40 2023-11-19 10:54:22,549 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=41, ppid=40, state=SUCCESS; OpenRegionProcedure 81401826ca044bcce6b358200c9c2f2a, server=jenkins-hbase4.apache.org,46035,1700391201579 in 168 msec 2023-11-19 10:54:22,550 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=39 2023-11-19 10:54:22,551 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=81401826ca044bcce6b358200c9c2f2a, ASSIGN in 324 msec 2023-11-19 10:54:22,551 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-19 10:54:22,551 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700391262551"}]},"ts":"1700391262551"} 2023-11-19 10:54:22,552 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLED in hbase:meta 2023-11-19 10:54:22,554 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_POST_OPERATION 2023-11-19 10:54:22,555 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=39, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.1610 sec 2023-11-19 10:54:23,315 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-19 10:54:23,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-19 10:54:23,501 INFO [Listener at localhost/42675] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, procId: 39 completed 2023-11-19 10:54:23,522 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:54:23,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:23,524 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-19 10:54:23,524 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:54:23,524 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-19 10:54:23,524 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-19 10:54:23,525 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:23,525 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:23,526 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:54:23,526 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:23,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:54:23,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:54:23,527 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:23,527 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:54:23,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:23,527 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:23,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:54:23,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:23,527 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:23,528 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:23,528 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-19 10:54:23,528 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:54:23,528 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-19 10:54:23,528 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-19 10:54:23,528 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:54:23,528 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a. 2023-11-19 10:54:23,528 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a. started... 2023-11-19 10:54:23,529 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 81401826ca044bcce6b358200c9c2f2a 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-19 10:54:23,949 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113006641bb9f2c94b38a1734f9e4c6fd2f4 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015113006641bb9f2c94b38a1734f9e4c6fd2f4 2023-11-19 10:54:24,353 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/.tmp/family1/bf6b90987d29473aadd0847ba73e0564 2023-11-19 10:54:24,358 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/.tmp/family1/bf6b90987d29473aadd0847ba73e0564 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/bf6b90987d29473aadd0847ba73e0564 2023-11-19 10:54:24,362 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/bf6b90987d29473aadd0847ba73e0564, entries=1000, sequenceid=5, filesize=191.4 K 2023-11-19 10:54:24,363 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 81401826ca044bcce6b358200c9c2f2a in 834ms, sequenceid=5, compaction requested=false 2023-11-19 10:54:24,364 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 81401826ca044bcce6b358200c9c2f2a: 2023-11-19 10:54:24,364 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a. 2023-11-19 10:54:24,364 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-19 10:54:24,364 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-19 10:54:24,364 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:24,364 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-19 10:54:24,364 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-19 10:54:24,366 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:24,366 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:24,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:24,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:24,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:24,367 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:24,367 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:54:24,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:24,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:24,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:24,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:24,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:24,368 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-19 10:54:24,368 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1646d61e[Count = 0] remaining members to acquire global barrier 2023-11-19 10:54:24,368 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-19 10:54:24,369 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:24,370 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:24,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:24,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:24,370 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-19 10:54:24,370 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-19 10:54:24,370 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:54:24,370 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:24,370 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:54:24,371 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:24,371 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-19 10:54:24,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:24,371 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:54:24,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:24,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:24,371 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-19 10:54:24,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:24,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:24,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:24,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:24,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:24,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:24,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:24,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:54:24,374 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-19 10:54:24,374 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-19 10:54:24,374 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:54:24,374 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:54:24,374 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:24,374 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:54:24,376 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:24,376 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:24,376 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:54:24,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:24,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:24,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:24,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:24,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:24,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:24,376 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:24,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:54:24,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:54:24,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:24,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:24,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:24,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:24,377 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:24,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:24,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:24,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:24,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:24,381 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:24,381 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:24,381 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:54:24,381 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:24,381 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:54:24,381 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-19 10:54:24,381 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:24,381 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-19 10:54:24,381 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:54:24,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:54:24,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:54:24,381 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:54:24,381 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:24,382 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:24,382 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:24,382 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-19 10:54:24,382 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:54:24,382 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:54:24,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:54:24,482 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:54:24,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:54:24,486 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:54:24,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-19 10:54:24,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:24,488 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-19 10:54:24,488 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:54:24,488 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-19 10:54:24,488 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-19 10:54:24,489 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:24,489 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:24,490 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:54:24,490 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:24,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:54:24,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:54:24,491 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:24,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:24,491 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:54:24,491 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:24,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:54:24,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:24,491 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:24,491 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-19 10:54:24,492 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:24,492 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-19 10:54:24,492 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:54:24,492 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-19 10:54:24,492 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-19 10:54:24,492 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:54:24,492 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a. 2023-11-19 10:54:24,492 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a. started... 2023-11-19 10:54:24,492 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 81401826ca044bcce6b358200c9c2f2a 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-19 10:54:24,906 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112887d67cc081a24394a5180af60252ee5c to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112887d67cc081a24394a5180af60252ee5c 2023-11-19 10:54:25,312 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/.tmp/family1/7641d4cd1e7e4f9fb430160ba81ca56a 2023-11-19 10:54:25,317 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/.tmp/family1/7641d4cd1e7e4f9fb430160ba81ca56a as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/7641d4cd1e7e4f9fb430160ba81ca56a 2023-11-19 10:54:25,321 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/7641d4cd1e7e4f9fb430160ba81ca56a, entries=1, sequenceid=9, filesize=5.0 K 2023-11-19 10:54:25,321 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 81401826ca044bcce6b358200c9c2f2a in 829ms, sequenceid=9, compaction requested=false 2023-11-19 10:54:25,322 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 81401826ca044bcce6b358200c9c2f2a: 2023-11-19 10:54:25,322 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a. 2023-11-19 10:54:25,322 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-19 10:54:25,322 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-19 10:54:25,322 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:25,322 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-19 10:54:25,322 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-19 10:54:25,323 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:25,323 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:25,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:25,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:25,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:25,324 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:25,324 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:54:25,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:25,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:25,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:25,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:25,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:25,326 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-19 10:54:25,326 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6cf302c8[Count = 0] remaining members to acquire global barrier 2023-11-19 10:54:25,326 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-19 10:54:25,326 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:25,328 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:25,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:25,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:25,328 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-19 10:54:25,328 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-19 10:54:25,328 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:54:25,328 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:25,328 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:54:25,329 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-19 10:54:25,329 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:25,329 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:54:25,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:25,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:25,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:25,329 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-19 10:54:25,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:25,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:25,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:25,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:25,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:25,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:25,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:25,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:54:25,332 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-19 10:54:25,332 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-19 10:54:25,332 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:54:25,332 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:54:25,332 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:25,332 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:54:25,333 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:25,333 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:25,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:25,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:25,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:25,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:25,333 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:54:25,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:25,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:25,334 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:25,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:54:25,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:54:25,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:25,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:25,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:25,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:25,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:25,335 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:25,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:25,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:25,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:25,341 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:25,341 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:54:25,341 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:25,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:54:25,341 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:54:25,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:54:25,342 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-19 10:54:25,342 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:54:25,341 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:25,341 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:54:25,342 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:25,342 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:25,342 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:25,342 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:25,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:54:25,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:54:25,342 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-19 10:54:25,342 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:54:25,442 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:54:25,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:54:25,447 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:54:25,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-19 10:54:25,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:25,449 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-19 10:54:25,449 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:54:25,449 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-19 10:54:25,449 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-19 10:54:25,449 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:25,449 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:25,450 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:25,450 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:54:25,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:54:25,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:54:25,451 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:25,451 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:54:25,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:25,451 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:25,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:54:25,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:25,452 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:25,452 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-19 10:54:25,452 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:25,452 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-19 10:54:25,452 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:54:25,452 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-19 10:54:25,452 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-19 10:54:25,452 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:54:25,452 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a. 2023-11-19 10:54:25,452 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a. started... 2023-11-19 10:54:25,452 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 81401826ca044bcce6b358200c9c2f2a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-19 10:54:25,864 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512011e6814374321407594bf3ee145b1bccf to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512011e6814374321407594bf3ee145b1bccf 2023-11-19 10:54:26,269 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/.tmp/family1/20910f8bc77e4bbe948b30bfcc6e12cf 2023-11-19 10:54:26,274 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/.tmp/family1/20910f8bc77e4bbe948b30bfcc6e12cf as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/20910f8bc77e4bbe948b30bfcc6e12cf 2023-11-19 10:54:26,278 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/20910f8bc77e4bbe948b30bfcc6e12cf, entries=1, sequenceid=13, filesize=5.0 K 2023-11-19 10:54:26,278 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 81401826ca044bcce6b358200c9c2f2a in 826ms, sequenceid=13, compaction requested=true 2023-11-19 10:54:26,278 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 81401826ca044bcce6b358200c9c2f2a: 2023-11-19 10:54:26,279 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a. 2023-11-19 10:54:26,279 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-19 10:54:26,279 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-19 10:54:26,279 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:26,279 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-19 10:54:26,279 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-19 10:54:26,280 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:26,280 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:26,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:26,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:26,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:26,281 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:26,281 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:54:26,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:26,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:26,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:26,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:26,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:26,282 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-19 10:54:26,282 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@17f2623b[Count = 0] remaining members to acquire global barrier 2023-11-19 10:54:26,282 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-19 10:54:26,282 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:26,283 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:26,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:26,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:26,283 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-19 10:54:26,283 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-19 10:54:26,283 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:54:26,283 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:26,284 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:54:26,286 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-19 10:54:26,286 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:26,286 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:54:26,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:26,286 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-19 10:54:26,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:26,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:26,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:26,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:26,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:26,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:26,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:26,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:26,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:26,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:54:26,288 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-19 10:54:26,288 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-19 10:54:26,288 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:54:26,288 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:54:26,288 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:26,289 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:54:26,290 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:26,290 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:26,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:26,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:26,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:26,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:26,290 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:54:26,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:26,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:26,291 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:26,291 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:54:26,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:54:26,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:26,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:26,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:26,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:26,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:26,292 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:26,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:26,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:26,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:26,294 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:26,294 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:54:26,294 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:26,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:54:26,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:54:26,294 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:54:26,294 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-19 10:54:26,294 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:54:26,294 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:54:26,294 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:26,294 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:26,294 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:26,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:54:26,294 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-19 10:54:26,294 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:26,294 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:54:26,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:54:26,294 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:26,395 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:54:26,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:54:26,399 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:54:26,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-19 10:54:26,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:26,400 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-19 10:54:26,400 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:54:26,400 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-19 10:54:26,400 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-19 10:54:26,401 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:26,401 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:26,403 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:26,403 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:54:26,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:54:26,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:54:26,403 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:26,403 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:54:26,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:26,404 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:26,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:54:26,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:26,404 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:26,404 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-19 10:54:26,404 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:26,404 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-19 10:54:26,404 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:54:26,404 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-19 10:54:26,404 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-19 10:54:26,405 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:54:26,405 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a. 2023-11-19 10:54:26,405 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a. started... 2023-11-19 10:54:26,405 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 81401826ca044bcce6b358200c9c2f2a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-19 10:54:26,817 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120508dbef502a4b483ea90cef24f366efd8 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120508dbef502a4b483ea90cef24f366efd8 2023-11-19 10:54:27,222 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/.tmp/family1/0372416d5e154b2c8846df1641f90991 2023-11-19 10:54:27,227 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/.tmp/family1/0372416d5e154b2c8846df1641f90991 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/0372416d5e154b2c8846df1641f90991 2023-11-19 10:54:27,231 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/0372416d5e154b2c8846df1641f90991, entries=1, sequenceid=17, filesize=5.0 K 2023-11-19 10:54:27,232 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 81401826ca044bcce6b358200c9c2f2a in 827ms, sequenceid=17, compaction requested=true 2023-11-19 10:54:27,232 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 81401826ca044bcce6b358200c9c2f2a: 2023-11-19 10:54:27,232 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a. 2023-11-19 10:54:27,232 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-19 10:54:27,232 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-19 10:54:27,232 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:27,232 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-19 10:54:27,232 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-19 10:54:27,234 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:27,234 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:27,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:27,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:27,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:27,234 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:27,234 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:54:27,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:27,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:27,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:27,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:27,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:27,236 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-19 10:54:27,236 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3339dac9[Count = 0] remaining members to acquire global barrier 2023-11-19 10:54:27,236 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-19 10:54:27,236 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:27,237 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:27,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:27,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:27,237 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-19 10:54:27,237 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-19 10:54:27,237 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:54:27,237 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:27,237 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:54:27,238 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-19 10:54:27,238 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:27,238 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:54:27,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:27,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:27,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:27,239 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-19 10:54:27,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:27,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:27,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:27,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:27,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:27,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:27,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:27,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:54:27,241 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-19 10:54:27,241 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-19 10:54:27,241 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:54:27,241 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:54:27,241 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:27,241 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:54:27,245 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:27,245 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:27,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:27,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:27,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:27,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:27,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:27,245 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:54:27,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:27,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:54:27,245 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:27,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:54:27,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:27,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:27,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:27,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:27,246 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:27,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:27,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:27,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:27,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:27,249 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:54:27,249 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:27,249 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:54:27,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:54:27,249 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:54:27,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:54:27,249 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-19 10:54:27,249 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:27,249 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-19 10:54:27,249 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:54:27,249 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:27,249 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:27,249 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:27,249 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:27,249 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:27,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:54:27,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:54:27,249 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-19 10:54:27,249 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:54:27,349 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:54:27,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:54:27,354 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:54:27,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-19 10:54:27,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:27,356 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-19 10:54:27,356 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:54:27,356 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-19 10:54:27,356 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-19 10:54:27,356 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:27,356 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:27,361 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:27,361 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:54:27,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:54:27,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:54:27,362 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:27,362 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:54:27,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:27,362 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:27,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:54:27,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:27,363 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:27,363 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-19 10:54:27,363 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:27,363 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-19 10:54:27,363 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:54:27,363 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-19 10:54:27,363 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-19 10:54:27,363 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:54:27,363 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a. 2023-11-19 10:54:27,363 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a. started... 2023-11-19 10:54:27,363 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 81401826ca044bcce6b358200c9c2f2a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-19 10:54:27,775 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228d6cc1ec2729d48f7821887e90d066f2f to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228d6cc1ec2729d48f7821887e90d066f2f 2023-11-19 10:54:28,063 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-19 10:54:28,180 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/.tmp/family1/68181ea596414227894b598f51cb0a70 2023-11-19 10:54:28,185 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/.tmp/family1/68181ea596414227894b598f51cb0a70 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/68181ea596414227894b598f51cb0a70 2023-11-19 10:54:28,189 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/68181ea596414227894b598f51cb0a70, entries=1, sequenceid=21, filesize=5.0 K 2023-11-19 10:54:28,190 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 81401826ca044bcce6b358200c9c2f2a in 827ms, sequenceid=21, compaction requested=true 2023-11-19 10:54:28,190 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 81401826ca044bcce6b358200c9c2f2a: 2023-11-19 10:54:28,190 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a. 2023-11-19 10:54:28,190 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-19 10:54:28,190 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-19 10:54:28,190 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:28,190 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-19 10:54:28,190 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-19 10:54:28,193 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:28,193 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:28,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:28,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:28,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:28,193 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:28,193 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:54:28,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:28,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:28,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:28,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:28,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:28,194 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-19 10:54:28,194 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@136f1c96[Count = 0] remaining members to acquire global barrier 2023-11-19 10:54:28,194 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-19 10:54:28,194 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:28,195 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:28,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:28,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:28,195 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-19 10:54:28,196 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-19 10:54:28,196 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:54:28,196 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:28,196 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:54:28,197 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-19 10:54:28,197 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:28,197 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:54:28,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:28,197 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-19 10:54:28,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:28,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:28,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:28,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:28,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:28,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:28,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:28,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:28,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:28,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:54:28,199 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-19 10:54:28,199 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-19 10:54:28,199 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:54:28,199 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:54:28,199 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:28,199 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:54:28,201 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:28,201 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:28,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:28,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:28,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:28,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:28,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:28,201 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:54:28,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:28,201 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:28,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:54:28,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:54:28,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:28,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:28,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:28,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:28,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:28,203 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:28,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:28,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:28,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:28,206 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:28,206 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:28,206 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:54:28,206 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:28,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:54:28,206 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:54:28,206 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:28,206 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:54:28,206 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:28,206 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-19 10:54:28,206 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:54:28,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:54:28,206 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:28,206 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:28,206 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-19 10:54:28,207 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:54:28,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:54:28,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:54:28,307 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:54:28,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:54:28,311 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:54:28,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-19 10:54:28,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:28,313 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-19 10:54:28,313 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:54:28,313 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-19 10:54:28,313 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-19 10:54:28,313 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:28,313 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:28,314 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:28,314 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:54:28,315 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:54:28,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:54:28,315 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:28,315 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:54:28,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:28,315 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:28,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:54:28,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:28,316 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:28,316 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-19 10:54:28,316 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:28,316 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-19 10:54:28,316 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:54:28,316 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-19 10:54:28,316 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-19 10:54:28,316 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:54:28,316 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a. 2023-11-19 10:54:28,316 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a. started... 2023-11-19 10:54:28,316 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 81401826ca044bcce6b358200c9c2f2a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-19 10:54:28,729 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123199103a36e1134774ac46d9e2a91742e5 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015123199103a36e1134774ac46d9e2a91742e5 2023-11-19 10:54:29,134 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/.tmp/family1/364235cb371d4cbebe591342b7592751 2023-11-19 10:54:29,139 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/.tmp/family1/364235cb371d4cbebe591342b7592751 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/364235cb371d4cbebe591342b7592751 2023-11-19 10:54:29,142 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/364235cb371d4cbebe591342b7592751, entries=1, sequenceid=25, filesize=5.0 K 2023-11-19 10:54:29,143 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 81401826ca044bcce6b358200c9c2f2a in 827ms, sequenceid=25, compaction requested=true 2023-11-19 10:54:29,143 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 81401826ca044bcce6b358200c9c2f2a: 2023-11-19 10:54:29,143 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a. 2023-11-19 10:54:29,143 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-19 10:54:29,143 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-19 10:54:29,143 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:29,143 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-19 10:54:29,143 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-19 10:54:29,145 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:29,145 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:29,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:29,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:29,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:29,145 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:29,145 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:54:29,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:29,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:29,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:29,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:29,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:29,146 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-19 10:54:29,147 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@677eb971[Count = 0] remaining members to acquire global barrier 2023-11-19 10:54:29,147 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-19 10:54:29,147 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:29,148 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:29,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:29,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:29,148 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-19 10:54:29,148 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-19 10:54:29,148 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:54:29,148 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:29,148 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:54:29,152 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:29,152 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-19 10:54:29,152 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:54:29,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:29,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:29,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:29,152 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-19 10:54:29,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:29,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:29,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:29,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:29,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:29,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:29,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:29,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:54:29,154 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-19 10:54:29,154 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-19 10:54:29,155 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:54:29,155 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:54:29,155 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:29,155 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:54:29,156 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:29,156 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:29,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:29,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:29,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:29,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:29,156 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:54:29,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:29,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:29,157 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:54:29,157 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:29,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:54:29,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:29,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:29,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:29,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:29,158 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:29,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:29,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:29,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:29,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:29,160 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:29,160 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:29,160 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:29,160 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:54:29,160 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:29,160 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:54:29,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:54:29,160 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:29,160 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:29,160 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-19 10:54:29,160 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-19 10:54:29,160 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:54:29,160 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:29,160 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:54:29,160 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:54:29,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:54:29,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:54:29,161 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-19 10:54:29,161 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:54:29,261 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:54:29,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:54:29,265 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:54:29,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-19 10:54:29,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:29,266 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-19 10:54:29,266 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:54:29,266 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-19 10:54:29,266 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-19 10:54:29,267 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:29,267 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:29,268 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:54:29,268 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:29,268 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:54:29,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:54:29,268 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:29,268 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:54:29,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:29,269 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:29,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:54:29,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:29,269 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:29,269 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-19 10:54:29,269 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:29,269 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-19 10:54:29,269 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:54:29,269 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-19 10:54:29,270 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-19 10:54:29,270 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:54:29,270 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a. 2023-11-19 10:54:29,270 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a. started... 2023-11-19 10:54:29,270 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 81401826ca044bcce6b358200c9c2f2a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-19 10:54:29,682 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101a39715698d524d51a01d3f3f63f081c0 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101a39715698d524d51a01d3f3f63f081c0 2023-11-19 10:54:30,087 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/.tmp/family1/1c7ea13572b4451a904c6f801267a5d7 2023-11-19 10:54:30,092 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/.tmp/family1/1c7ea13572b4451a904c6f801267a5d7 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/1c7ea13572b4451a904c6f801267a5d7 2023-11-19 10:54:30,095 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/1c7ea13572b4451a904c6f801267a5d7, entries=1, sequenceid=29, filesize=5.0 K 2023-11-19 10:54:30,096 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 81401826ca044bcce6b358200c9c2f2a in 826ms, sequenceid=29, compaction requested=true 2023-11-19 10:54:30,096 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 81401826ca044bcce6b358200c9c2f2a: 2023-11-19 10:54:30,096 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a. 2023-11-19 10:54:30,096 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-19 10:54:30,096 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-19 10:54:30,096 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:30,096 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-19 10:54:30,096 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-19 10:54:30,099 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:30,099 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:30,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:30,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:30,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:30,099 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:30,099 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:54:30,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:30,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:30,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:30,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:30,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:30,101 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-19 10:54:30,101 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6399fc1f[Count = 0] remaining members to acquire global barrier 2023-11-19 10:54:30,101 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-19 10:54:30,101 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:30,102 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:30,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:30,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:30,102 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-19 10:54:30,102 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-19 10:54:30,102 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:54:30,102 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:30,102 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:54:30,107 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:30,107 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-19 10:54:30,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:30,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:30,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:30,107 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:54:30,107 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-19 10:54:30,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:30,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:30,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:30,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:30,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:30,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:30,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:30,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:54:30,109 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-19 10:54:30,109 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-19 10:54:30,109 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:54:30,109 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:54:30,109 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:30,109 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:54:30,111 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:30,111 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:30,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:30,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:30,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:30,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:30,111 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:54:30,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:30,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:30,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:54:30,112 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:30,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:54:30,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:30,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:30,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:30,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:30,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:30,113 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:30,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:30,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:30,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:30,115 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:30,116 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:30,116 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:54:30,116 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:30,116 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:54:30,116 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:30,116 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-19 10:54:30,116 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:54:30,116 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:54:30,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:54:30,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:54:30,116 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:30,116 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:30,116 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:30,116 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-19 10:54:30,116 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:54:30,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:54:30,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:54:30,216 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:54:30,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:54:30,220 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:54:30,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-19 10:54:30,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:30,222 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-19 10:54:30,222 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:54:30,222 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-19 10:54:30,222 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-19 10:54:30,222 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:30,222 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:30,226 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:30,226 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:54:30,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:54:30,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:54:30,226 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:30,226 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:54:30,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:30,226 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:30,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:54:30,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:30,227 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:30,227 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-19 10:54:30,227 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:30,227 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-19 10:54:30,227 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:54:30,227 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-19 10:54:30,227 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-19 10:54:30,227 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:54:30,227 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a. 2023-11-19 10:54:30,227 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a. started... 2023-11-19 10:54:30,227 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 81401826ca044bcce6b358200c9c2f2a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-19 10:54:30,639 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601030ca5fc2fe0fc4a91b3039598d4670a7f to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601030ca5fc2fe0fc4a91b3039598d4670a7f 2023-11-19 10:54:31,045 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/.tmp/family1/fc1cf4a5a1c541b092cef7754794588c 2023-11-19 10:54:31,049 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/.tmp/family1/fc1cf4a5a1c541b092cef7754794588c as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/fc1cf4a5a1c541b092cef7754794588c 2023-11-19 10:54:31,053 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/fc1cf4a5a1c541b092cef7754794588c, entries=1, sequenceid=33, filesize=5.0 K 2023-11-19 10:54:31,054 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 81401826ca044bcce6b358200c9c2f2a in 827ms, sequenceid=33, compaction requested=true 2023-11-19 10:54:31,054 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 81401826ca044bcce6b358200c9c2f2a: 2023-11-19 10:54:31,054 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a. 2023-11-19 10:54:31,054 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-19 10:54:31,054 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-19 10:54:31,054 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:31,054 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-19 10:54:31,054 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-19 10:54:31,056 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:31,056 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:31,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:31,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:31,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:31,057 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:31,057 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:54:31,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:31,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:31,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:31,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:31,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:31,058 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-19 10:54:31,058 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e0b9d37[Count = 0] remaining members to acquire global barrier 2023-11-19 10:54:31,058 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-19 10:54:31,058 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:31,060 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:31,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:31,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:31,060 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-19 10:54:31,060 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-19 10:54:31,060 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:54:31,061 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:31,061 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:54:31,062 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:31,062 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-19 10:54:31,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:31,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:31,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:31,062 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:54:31,062 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-19 10:54:31,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:31,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:31,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:31,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:31,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:31,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:31,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:31,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:54:31,064 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-19 10:54:31,064 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-19 10:54:31,064 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:54:31,065 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:54:31,065 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:31,065 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:54:31,066 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:31,066 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:31,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:31,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:31,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:31,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:31,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:31,066 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:54:31,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:54:31,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:54:31,067 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:31,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:31,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:31,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:31,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:31,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:31,068 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:31,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:31,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:31,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:31,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:31,071 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:31,071 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:54:31,071 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:31,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:54:31,071 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:54:31,071 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-19 10:54:31,071 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-19 10:54:31,071 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:54:31,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:54:31,071 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:54:31,071 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:31,071 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:31,071 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:31,071 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-19 10:54:31,071 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:54:31,071 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:31,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:54:31,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:54:31,071 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:31,171 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:54:31,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:54:31,176 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:54:31,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-19 10:54:31,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:31,177 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-19 10:54:31,177 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:54:31,177 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-19 10:54:31,177 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-19 10:54:31,178 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:31,178 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:31,180 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:31,180 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:54:31,180 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:54:31,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:54:31,180 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:31,180 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:54:31,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:31,181 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:31,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:54:31,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:31,181 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:31,181 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-19 10:54:31,181 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:31,181 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-19 10:54:31,181 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:54:31,181 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-19 10:54:31,181 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-19 10:54:31,181 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:54:31,181 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a. 2023-11-19 10:54:31,181 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a. started... 2023-11-19 10:54:31,182 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 81401826ca044bcce6b358200c9c2f2a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-19 10:54:31,593 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090747eccc64aa01468da2860874622cf3d3 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015090747eccc64aa01468da2860874622cf3d3 2023-11-19 10:54:31,998 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/.tmp/family1/df33b23412f543399a3f4f4e242d0b33 2023-11-19 10:54:32,003 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/.tmp/family1/df33b23412f543399a3f4f4e242d0b33 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/df33b23412f543399a3f4f4e242d0b33 2023-11-19 10:54:32,007 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/df33b23412f543399a3f4f4e242d0b33, entries=1, sequenceid=37, filesize=5.0 K 2023-11-19 10:54:32,008 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 81401826ca044bcce6b358200c9c2f2a in 826ms, sequenceid=37, compaction requested=true 2023-11-19 10:54:32,008 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 81401826ca044bcce6b358200c9c2f2a: 2023-11-19 10:54:32,008 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a. 2023-11-19 10:54:32,008 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-19 10:54:32,008 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-19 10:54:32,008 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:32,008 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-19 10:54:32,008 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-19 10:54:32,010 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:32,010 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:32,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:32,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:32,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:32,010 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:32,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:32,010 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:54:32,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:32,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:32,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:32,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:32,011 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-19 10:54:32,011 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@75eba9cc[Count = 0] remaining members to acquire global barrier 2023-11-19 10:54:32,011 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-19 10:54:32,011 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:32,012 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:32,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:32,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:32,013 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-19 10:54:32,013 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-19 10:54:32,013 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:54:32,013 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:32,013 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:54:32,014 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-19 10:54:32,014 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:54:32,014 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:32,014 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-19 10:54:32,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:32,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:32,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:32,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:32,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:32,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:32,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:32,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:32,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:32,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:32,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:54:32,016 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-19 10:54:32,016 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-19 10:54:32,017 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:54:32,017 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:54:32,017 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:32,017 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:54:32,019 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:32,020 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:54:32,020 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:32,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:32,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:32,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:32,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:32,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:32,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:54:32,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:32,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:54:32,020 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:32,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:32,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:32,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:32,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:32,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:32,022 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:32,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:32,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:32,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:32,027 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:32,027 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:54:32,027 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:32,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:54:32,027 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-19 10:54:32,027 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:54:32,027 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:54:32,027 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:32,027 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:54:32,027 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:32,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:54:32,028 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:32,028 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:32,028 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-19 10:54:32,028 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:32,028 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:54:32,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:54:32,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:54:32,128 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:54:32,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:54:32,132 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:54:32,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-19 10:54:32,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:32,134 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-19 10:54:32,134 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:54:32,134 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-19 10:54:32,134 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-19 10:54:32,134 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:32,134 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:32,136 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:54:32,136 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:32,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:54:32,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:54:32,136 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:32,136 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:54:32,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:32,136 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:32,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:54:32,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:32,137 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:32,137 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-19 10:54:32,137 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:32,137 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-19 10:54:32,137 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:54:32,137 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-19 10:54:32,137 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-19 10:54:32,137 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:54:32,137 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a. 2023-11-19 10:54:32,137 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a. started... 2023-11-19 10:54:32,138 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 81401826ca044bcce6b358200c9c2f2a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-19 10:54:32,549 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112053bd8c071d644eb786c513397e8f479a to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112053bd8c071d644eb786c513397e8f479a 2023-11-19 10:54:32,955 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/.tmp/family1/b80d4418345c437b9daba728cfd26f2f 2023-11-19 10:54:32,959 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/.tmp/family1/b80d4418345c437b9daba728cfd26f2f as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/b80d4418345c437b9daba728cfd26f2f 2023-11-19 10:54:32,963 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/b80d4418345c437b9daba728cfd26f2f, entries=1, sequenceid=41, filesize=5.0 K 2023-11-19 10:54:32,964 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 81401826ca044bcce6b358200c9c2f2a in 826ms, sequenceid=41, compaction requested=true 2023-11-19 10:54:32,964 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 81401826ca044bcce6b358200c9c2f2a: 2023-11-19 10:54:32,964 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a. 2023-11-19 10:54:32,964 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-19 10:54:32,964 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-19 10:54:32,964 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:32,964 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-19 10:54:32,964 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-19 10:54:32,967 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:32,967 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:32,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:32,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:32,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:32,967 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:32,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:32,967 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:54:32,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:32,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:32,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:32,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:32,969 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-19 10:54:32,969 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@674c3331[Count = 0] remaining members to acquire global barrier 2023-11-19 10:54:32,969 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-19 10:54:32,969 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:32,970 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:32,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:32,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:32,970 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-19 10:54:32,970 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-19 10:54:32,970 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:54:32,970 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:32,970 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:54:32,971 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:32,971 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-19 10:54:32,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:32,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:32,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:32,972 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:54:32,972 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-19 10:54:32,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:32,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:32,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:32,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:32,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:32,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:32,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:32,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:54:32,974 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-19 10:54:32,974 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-19 10:54:32,974 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:54:32,974 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:54:32,974 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:32,974 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:54:32,976 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:32,976 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:32,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:32,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:32,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:32,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:32,976 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:54:32,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:32,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:32,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:54:32,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:54:32,976 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:32,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:32,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:32,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:32,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:32,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:32,978 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:32,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:32,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:32,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:32,984 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:32,984 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:32,984 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:32,984 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:32,984 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:32,984 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:54:32,985 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-19 10:54:32,985 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:54:32,984 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:54:32,984 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:32,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:54:32,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:54:32,985 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:54:32,985 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:32,985 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-19 10:54:32,985 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:54:32,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:54:32,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:54:33,085 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:54:33,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:54:33,087 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=33457] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:33,088 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-19 10:54:33,089 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-19 10:54:33,089 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-19 10:54:33,089 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=42, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700391873089 2023-11-19 10:54:33,092 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-19 10:54:33,093 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-11-19 10:54:33,093 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-19 10:54:33,094 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] zookeeper.ReadOnlyZKClient(139): Connect 0x1367a3cb to 127.0.0.1:60497 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-19 10:54:33,097 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5b2f3908, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-19 10:54:33,098 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-19 10:54:33,931 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601030f7a4d5d832d4168836d879671cce1d5 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601030f7a4d5d832d4168836d879671cce1d5 2023-11-19 10:54:33,932 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-19 10:54:33,945 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-19 10:54:33,946 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47542, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-19 10:54:33,951 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-19 10:54:33,953 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44916, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-19 10:54:33,960 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/84483efc347a4aa8b62f0e797b56e5e7 first=Optional[r3] last=Optional[r6] 2023-11-19 10:54:33,961 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a., hostname=jenkins-hbase4.apache.org,46035,1700391201579, seqNum=2 for row with hfile group [{family1,hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/84483efc347a4aa8b62f0e797b56e5e7}] 2023-11-19 10:54:33,965 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(763): Validating hfile at hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/84483efc347a4aa8b62f0e797b56e5e7 for inclusion in 81401826ca044bcce6b358200c9c2f2a/family1 2023-11-19 10:54:33,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-19 10:54:33,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(777): Region bounds: first= last= 2023-11-19 10:54:33,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegion(2446): Flush status journal for 81401826ca044bcce6b358200c9c2f2a: 2023-11-19 10:54:33,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/84483efc347a4aa8b62f0e797b56e5e7 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__724f9q03ncr1fjqrqbil2jiqu1p3vt9bir1uid0vlrprdmmi27ltbcq7lf5mas4e/family1/84483efc347a4aa8b62f0e797b56e5e7 2023-11-19 10:54:33,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__724f9q03ncr1fjqrqbil2jiqu1p3vt9bir1uid0vlrprdmmi27ltbcq7lf5mas4e/family1/84483efc347a4aa8b62f0e797b56e5e7 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/9e10bd03a27a461eb5c8ec25a75ddec1_SeqId_44_ 2023-11-19 10:54:33,970 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(849): Loaded HFile hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__724f9q03ncr1fjqrqbil2jiqu1p3vt9bir1uid0vlrprdmmi27ltbcq7lf5mas4e/family1/84483efc347a4aa8b62f0e797b56e5e7 into 81401826ca044bcce6b358200c9c2f2a/family1 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/9e10bd03a27a461eb5c8ec25a75ddec1_SeqId_44_ - updating store file list. 2023-11-19 10:54:33,973 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(882): Loaded HFile hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/9e10bd03a27a461eb5c8ec25a75ddec1_SeqId_44_ into 81401826ca044bcce6b358200c9c2f2a/family1 2023-11-19 10:54:33,973 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(855): Successfully loaded hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__724f9q03ncr1fjqrqbil2jiqu1p3vt9bir1uid0vlrprdmmi27ltbcq7lf5mas4e/family1/84483efc347a4aa8b62f0e797b56e5e7 into 81401826ca044bcce6b358200c9c2f2a/family1 (new location: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/9e10bd03a27a461eb5c8ec25a75ddec1_SeqId_44_) 2023-11-19 10:54:33,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__724f9q03ncr1fjqrqbil2jiqu1p3vt9bir1uid0vlrprdmmi27ltbcq7lf5mas4e/family1/84483efc347a4aa8b62f0e797b56e5e7 2023-11-19 10:54:33,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-19 10:54:33,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51565 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-19 10:54:33,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(1912): 81401826ca044bcce6b358200c9c2f2a/family1 is initiating minor compaction 2023-11-19 10:54:33,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@2610fc94; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-19 10:54:33,977 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 81401826ca044bcce6b358200c9c2f2a/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a. 2023-11-19 10:54:33,977 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/7641d4cd1e7e4f9fb430160ba81ca56a, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/20910f8bc77e4bbe948b30bfcc6e12cf, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/0372416d5e154b2c8846df1641f90991, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/68181ea596414227894b598f51cb0a70, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/364235cb371d4cbebe591342b7592751, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/1c7ea13572b4451a904c6f801267a5d7, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/fc1cf4a5a1c541b092cef7754794588c, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/df33b23412f543399a3f4f4e242d0b33, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/b80d4418345c437b9daba728cfd26f2f, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/9e10bd03a27a461eb5c8ec25a75ddec1_SeqId_44_] into tmpdir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/.tmp, totalSize=50.4 K 2023-11-19 10:54:33,977 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting 7641d4cd1e7e4f9fb430160ba81ca56a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-19 10:54:33,977 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting 20910f8bc77e4bbe948b30bfcc6e12cf, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-19 10:54:33,977 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting 0372416d5e154b2c8846df1641f90991, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-19 10:54:33,977 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting 68181ea596414227894b598f51cb0a70, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-19 10:54:33,977 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting 364235cb371d4cbebe591342b7592751, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-19 10:54:33,977 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting 1c7ea13572b4451a904c6f801267a5d7, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-19 10:54:33,978 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting fc1cf4a5a1c541b092cef7754794588c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-19 10:54:33,978 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting df33b23412f543399a3f4f4e242d0b33, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-19 10:54:33,978 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting b80d4418345c437b9daba728cfd26f2f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-19 10:54:33,978 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting 9e10bd03a27a461eb5c8ec25a75ddec1_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-19 10:54:33,979 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-19 10:54:33,979 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:54:33,981 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228d6cc1ec2729d48f7821887e90d066f2f to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228d6cc1ec2729d48f7821887e90d066f2f 2023-11-19 10:54:33,982 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015123199103a36e1134774ac46d9e2a91742e5 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015123199103a36e1134774ac46d9e2a91742e5 2023-11-19 10:54:33,983 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101a39715698d524d51a01d3f3f63f081c0 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101a39715698d524d51a01d3f3f63f081c0 2023-11-19 10:54:33,985 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601030ca5fc2fe0fc4a91b3039598d4670a7f to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601030ca5fc2fe0fc4a91b3039598d4670a7f 2023-11-19 10:54:33,985 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 4 expired mob files are deleted 2023-11-19 10:54:33,985 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-19 10:54:33,985 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-19 10:54:33,985 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-19 10:54:33,985 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-19 10:54:33,985 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-19 10:54:33,985 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-19 10:54:33,985 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-19 10:54:33,986 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-19 10:54:33,986 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-19 10:54:34,025 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] throttle.PressureAwareThroughputController(145): 81401826ca044bcce6b358200c9c2f2a#family1#compaction#61 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-19 10:54:34,843 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205f7aaaef2463e46aab6d6c62ebda476f0 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205f7aaaef2463e46aab6d6c62ebda476f0 2023-11-19 10:54:34,844 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-19 10:54:34,845 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/.tmp/family1/53b6f1e835b6485cacd98c00f1c0ed04 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/53b6f1e835b6485cacd98c00f1c0ed04 2023-11-19 10:54:34,849 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 81401826ca044bcce6b358200c9c2f2a/family1 of 81401826ca044bcce6b358200c9c2f2a into 53b6f1e835b6485cacd98c00f1c0ed04(size=6.8 K), total size for store is 198.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-19 10:54:34,849 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 81401826ca044bcce6b358200c9c2f2a: 2023-11-19 10:54:34,849 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a., storeName=family1, fileCount=10, fileSize=50.4 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1700391273977; duration=0sec 2023-11-19 10:54:34,849 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-19 10:54:34,873 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/9c1c4282b46944968585aa2177ec3daa first=Optional[r00] last=Optional[r2] 2023-11-19 10:54:34,874 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a., hostname=jenkins-hbase4.apache.org,46035,1700391201579, seqNum=2 for row with hfile group [{family1,hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/9c1c4282b46944968585aa2177ec3daa}] 2023-11-19 10:54:34,876 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(763): Validating hfile at hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/9c1c4282b46944968585aa2177ec3daa for inclusion in 81401826ca044bcce6b358200c9c2f2a/family1 2023-11-19 10:54:34,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-19 10:54:34,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(777): Region bounds: first= last= 2023-11-19 10:54:34,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegion(2446): Flush status journal for 81401826ca044bcce6b358200c9c2f2a: 2023-11-19 10:54:34,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/9c1c4282b46944968585aa2177ec3daa to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__7jvj39hcpdtbj92gb38dilnvotu31cbv19idqv0kq3s3llipecc7npn6i9s3a1ie/family1/9c1c4282b46944968585aa2177ec3daa 2023-11-19 10:54:34,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__7jvj39hcpdtbj92gb38dilnvotu31cbv19idqv0kq3s3llipecc7npn6i9s3a1ie/family1/9c1c4282b46944968585aa2177ec3daa as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/adb57a2c0d114494bed268fe6fa29589_SeqId_47_ 2023-11-19 10:54:34,882 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(849): Loaded HFile hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__7jvj39hcpdtbj92gb38dilnvotu31cbv19idqv0kq3s3llipecc7npn6i9s3a1ie/family1/9c1c4282b46944968585aa2177ec3daa into 81401826ca044bcce6b358200c9c2f2a/family1 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/adb57a2c0d114494bed268fe6fa29589_SeqId_47_ - updating store file list. 2023-11-19 10:54:34,885 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(882): Loaded HFile hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/adb57a2c0d114494bed268fe6fa29589_SeqId_47_ into 81401826ca044bcce6b358200c9c2f2a/family1 2023-11-19 10:54:34,885 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(855): Successfully loaded hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__7jvj39hcpdtbj92gb38dilnvotu31cbv19idqv0kq3s3llipecc7npn6i9s3a1ie/family1/9c1c4282b46944968585aa2177ec3daa into 81401826ca044bcce6b358200c9c2f2a/family1 (new location: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/adb57a2c0d114494bed268fe6fa29589_SeqId_47_) 2023-11-19 10:54:34,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__7jvj39hcpdtbj92gb38dilnvotu31cbv19idqv0kq3s3llipecc7npn6i9s3a1ie/family1/9c1c4282b46944968585aa2177ec3daa 2023-11-19 10:54:34,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-19 10:54:34,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 399433 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-19 10:54:34,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(1912): 81401826ca044bcce6b358200c9c2f2a/family1 is initiating minor compaction (all files) 2023-11-19 10:54:34,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@62ee41dd; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-19 10:54:34,887 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 81401826ca044bcce6b358200c9c2f2a/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a. 2023-11-19 10:54:34,887 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/bf6b90987d29473aadd0847ba73e0564, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/53b6f1e835b6485cacd98c00f1c0ed04, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/adb57a2c0d114494bed268fe6fa29589_SeqId_47_] into tmpdir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/.tmp, totalSize=390.1 K 2023-11-19 10:54:34,888 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting bf6b90987d29473aadd0847ba73e0564, keycount=1000, bloomtype=ROW, size=191.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878825094 2023-11-19 10:54:34,888 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting 53b6f1e835b6485cacd98c00f1c0ed04, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621225094 2023-11-19 10:54:34,889 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting adb57a2c0d114494bed268fe6fa29589_SeqId_47_, keycount=1002, bloomtype=ROW, size=191.8 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878825094 2023-11-19 10:54:34,889 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-19 10:54:34,891 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:54:34,893 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015113006641bb9f2c94b38a1734f9e4c6fd2f4 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015113006641bb9f2c94b38a1734f9e4c6fd2f4 2023-11-19 10:54:34,894 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512011e6814374321407594bf3ee145b1bccf to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512011e6814374321407594bf3ee145b1bccf 2023-11-19 10:54:34,895 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120508dbef502a4b483ea90cef24f366efd8 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120508dbef502a4b483ea90cef24f366efd8 2023-11-19 10:54:34,895 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 3 expired mob files are deleted 2023-11-19 10:54:34,895 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-19 10:54:34,896 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-19 10:54:34,896 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-19 10:54:34,896 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-19 10:54:34,897 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=42, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-19 10:54:34,898 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 1.8100 sec 2023-11-19 10:54:34,903 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] throttle.PressureAwareThroughputController(145): 81401826ca044bcce6b358200c9c2f2a#family1#compaction#62 average throughput is 25.80 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-19 10:54:34,939 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/7641d4cd1e7e4f9fb430160ba81ca56a, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/20910f8bc77e4bbe948b30bfcc6e12cf, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/0372416d5e154b2c8846df1641f90991, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/68181ea596414227894b598f51cb0a70, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/364235cb371d4cbebe591342b7592751, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/1c7ea13572b4451a904c6f801267a5d7, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/fc1cf4a5a1c541b092cef7754794588c, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/df33b23412f543399a3f4f4e242d0b33, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/b80d4418345c437b9daba728cfd26f2f, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/9e10bd03a27a461eb5c8ec25a75ddec1_SeqId_44_] to archive 2023-11-19 10:54:34,940 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:54:34,942 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/7641d4cd1e7e4f9fb430160ba81ca56a to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/7641d4cd1e7e4f9fb430160ba81ca56a 2023-11-19 10:54:34,944 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/20910f8bc77e4bbe948b30bfcc6e12cf to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/20910f8bc77e4bbe948b30bfcc6e12cf 2023-11-19 10:54:34,945 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/0372416d5e154b2c8846df1641f90991 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/0372416d5e154b2c8846df1641f90991 2023-11-19 10:54:34,946 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/68181ea596414227894b598f51cb0a70 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/68181ea596414227894b598f51cb0a70 2023-11-19 10:54:34,948 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/364235cb371d4cbebe591342b7592751 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/364235cb371d4cbebe591342b7592751 2023-11-19 10:54:34,949 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/1c7ea13572b4451a904c6f801267a5d7 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/1c7ea13572b4451a904c6f801267a5d7 2023-11-19 10:54:34,950 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/fc1cf4a5a1c541b092cef7754794588c to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/fc1cf4a5a1c541b092cef7754794588c 2023-11-19 10:54:34,951 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/df33b23412f543399a3f4f4e242d0b33 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/df33b23412f543399a3f4f4e242d0b33 2023-11-19 10:54:34,952 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/b80d4418345c437b9daba728cfd26f2f to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/b80d4418345c437b9daba728cfd26f2f 2023-11-19 10:54:34,954 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/9e10bd03a27a461eb5c8ec25a75ddec1_SeqId_44_ to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/9e10bd03a27a461eb5c8ec25a75ddec1_SeqId_44_ 2023-11-19 10:54:34,970 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-19 10:54:34,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure2.ProcedureExecutor(1028): Stored pid=43, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:35,380 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-11-19 10:54:35,381 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-11-19 10:54:35,381 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-11-19 10:54:35,383 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-11-19 10:54:35,386 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=81401826ca044bcce6b358200c9c2f2a, REOPEN/MOVE}] 2023-11-19 10:54:35,386 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=81401826ca044bcce6b358200c9c2f2a, REOPEN/MOVE 2023-11-19 10:54:35,387 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=81401826ca044bcce6b358200c9c2f2a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:35,387 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700391275387"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700391275387"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700391275387"}]},"ts":"1700391275387"} 2023-11-19 10:54:35,388 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=45, state=RUNNABLE; CloseRegionProcedure 81401826ca044bcce6b358200c9c2f2a, server=jenkins-hbase4.apache.org,46035,1700391201579}] 2023-11-19 10:54:35,539 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:35,540 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 81401826ca044bcce6b358200c9c2f2a 2023-11-19 10:54:35,540 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 81401826ca044bcce6b358200c9c2f2a, disabling compactions & flushes 2023-11-19 10:54:35,540 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a. 2023-11-19 10:54:36,123 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/.tmp/family1/315dad04b82c4f62a00976aac2496ca3 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/315dad04b82c4f62a00976aac2496ca3 2023-11-19 10:54:36,127 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 81401826ca044bcce6b358200c9c2f2a/family1 of 81401826ca044bcce6b358200c9c2f2a into 315dad04b82c4f62a00976aac2496ca3(size=193.0 K), total size for store is 193.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-19 10:54:36,127 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 81401826ca044bcce6b358200c9c2f2a: 2023-11-19 10:54:36,127 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a. 2023-11-19 10:54:36,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a. 2023-11-19 10:54:36,128 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a., storeName=family1, fileCount=3, fileSize=390.1 K (191.4 K, 6.8 K, 191.8 K), priority=2, time=1700391274887; duration=1sec 2023-11-19 10:54:36,128 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a. after waiting 0 ms 2023-11-19 10:54:36,128 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a. 2023-11-19 10:54:36,128 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-19 10:54:36,128 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/bf6b90987d29473aadd0847ba73e0564, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/53b6f1e835b6485cacd98c00f1c0ed04, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/adb57a2c0d114494bed268fe6fa29589_SeqId_47_] to archive 2023-11-19 10:54:36,129 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:54:36,130 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/bf6b90987d29473aadd0847ba73e0564 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/bf6b90987d29473aadd0847ba73e0564 2023-11-19 10:54:36,131 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/53b6f1e835b6485cacd98c00f1c0ed04 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/53b6f1e835b6485cacd98c00f1c0ed04 2023-11-19 10:54:36,133 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/adb57a2c0d114494bed268fe6fa29589_SeqId_47_ to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/adb57a2c0d114494bed268fe6fa29589_SeqId_47_ 2023-11-19 10:54:36,137 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-19 10:54:36,138 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a. 2023-11-19 10:54:36,138 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 81401826ca044bcce6b358200c9c2f2a: 2023-11-19 10:54:36,138 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 81401826ca044bcce6b358200c9c2f2a to self. 2023-11-19 10:54:36,139 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 81401826ca044bcce6b358200c9c2f2a 2023-11-19 10:54:36,139 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=81401826ca044bcce6b358200c9c2f2a, regionState=CLOSED 2023-11-19 10:54:36,140 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700391276139"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700391276139"}]},"ts":"1700391276139"} 2023-11-19 10:54:36,142 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=45 2023-11-19 10:54:36,142 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=45, state=SUCCESS; CloseRegionProcedure 81401826ca044bcce6b358200c9c2f2a, server=jenkins-hbase4.apache.org,46035,1700391201579 in 753 msec 2023-11-19 10:54:36,142 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=81401826ca044bcce6b358200c9c2f2a, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,46035,1700391201579; forceNewPlan=false, retain=true 2023-11-19 10:54:36,293 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=81401826ca044bcce6b358200c9c2f2a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:36,293 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700391276292"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700391276292"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700391276292"}]},"ts":"1700391276292"} 2023-11-19 10:54:36,294 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=47, ppid=45, state=RUNNABLE; OpenRegionProcedure 81401826ca044bcce6b358200c9c2f2a, server=jenkins-hbase4.apache.org,46035,1700391201579}] 2023-11-19 10:54:36,446 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:36,448 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a. 2023-11-19 10:54:36,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 81401826ca044bcce6b358200c9c2f2a, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a.', STARTKEY => '', ENDKEY => ''} 2023-11-19 10:54:36,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 81401826ca044bcce6b358200c9c2f2a 2023-11-19 10:54:36,449 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-19 10:54:36,449 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 81401826ca044bcce6b358200c9c2f2a 2023-11-19 10:54:36,449 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 81401826ca044bcce6b358200c9c2f2a 2023-11-19 10:54:36,450 INFO [StoreOpener-81401826ca044bcce6b358200c9c2f2a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 81401826ca044bcce6b358200c9c2f2a 2023-11-19 10:54:36,450 DEBUG [StoreOpener-81401826ca044bcce6b358200c9c2f2a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1 2023-11-19 10:54:36,451 DEBUG [StoreOpener-81401826ca044bcce6b358200c9c2f2a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1 2023-11-19 10:54:36,451 INFO [StoreOpener-81401826ca044bcce6b358200c9c2f2a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 81401826ca044bcce6b358200c9c2f2a columnFamilyName family1 2023-11-19 10:54:36,455 DEBUG [StoreOpener-81401826ca044bcce6b358200c9c2f2a-1] regionserver.HStore(539): loaded hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/315dad04b82c4f62a00976aac2496ca3 2023-11-19 10:54:36,455 INFO [StoreOpener-81401826ca044bcce6b358200c9c2f2a-1] regionserver.HStore(310): Store=81401826ca044bcce6b358200c9c2f2a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-19 10:54:36,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a 2023-11-19 10:54:36,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a 2023-11-19 10:54:36,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 81401826ca044bcce6b358200c9c2f2a 2023-11-19 10:54:36,461 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 81401826ca044bcce6b358200c9c2f2a; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68527403, jitterRate=0.02113787829875946}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-19 10:54:36,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 81401826ca044bcce6b358200c9c2f2a: 2023-11-19 10:54:36,461 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a., pid=47, masterSystemTime=1700391276445 2023-11-19 10:54:36,462 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a. 2023-11-19 10:54:36,463 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a. 2023-11-19 10:54:36,463 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=81401826ca044bcce6b358200c9c2f2a, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:36,463 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700391276463"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700391276463"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700391276463"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700391276463"}]},"ts":"1700391276463"} 2023-11-19 10:54:36,465 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=47, resume processing ppid=45 2023-11-19 10:54:36,465 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=47, ppid=45, state=SUCCESS; OpenRegionProcedure 81401826ca044bcce6b358200c9c2f2a, server=jenkins-hbase4.apache.org,46035,1700391201579 in 170 msec 2023-11-19 10:54:36,467 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=44 2023-11-19 10:54:36,467 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=44, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=81401826ca044bcce6b358200c9c2f2a, REOPEN/MOVE in 1.0790 sec 2023-11-19 10:54:36,469 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=44, resume processing ppid=43 2023-11-19 10:54:36,469 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=43, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.0840 sec 2023-11-19 10:54:36,471 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=43, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.5000 sec 2023-11-19 10:54:36,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=43 2023-11-19 10:54:36,472 INFO [Listener at localhost/42675] compactions.TestMobCompactor(278): alter status finished 2023-11-19 10:54:36,473 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=33457] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:36,474 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-19 10:54:36,475 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-19 10:54:36,476 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-19 10:54:36,476 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700391876476 2023-11-19 10:54:36,476 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-19 10:54:36,477 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-11-19 10:54:36,477 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-19 10:54:36,479 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] zookeeper.ReadOnlyZKClient(139): Connect 0x46414ad2 to 127.0.0.1:60497 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-19 10:54:36,483 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6484dc6b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-19 10:54:36,483 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-19 10:54:36,484 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-19 10:54:36,484 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-19 10:54:36,484 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-19 10:54:36,484 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-19 10:54:37,310 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128c341d49b52b94bd98e4f3f52dba017fb to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128c341d49b52b94bd98e4f3f52dba017fb 2023-11-19 10:54:37,311 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-19 10:54:37,324 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-19 10:54:37,325 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47556, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-19 10:54:37,331 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-19 10:54:37,332 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44922, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-19 10:54:37,340 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/c381025d531f494bafc65c4e35a30f20 first=Optional[r05] last=Optional[r8] 2023-11-19 10:54:37,340 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a., hostname=jenkins-hbase4.apache.org,46035,1700391201579, seqNum=51 for row with hfile group [{family1,hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/c381025d531f494bafc65c4e35a30f20}] 2023-11-19 10:54:37,345 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(763): Validating hfile at hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/c381025d531f494bafc65c4e35a30f20 for inclusion in 81401826ca044bcce6b358200c9c2f2a/family1 2023-11-19 10:54:37,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-11-19 10:54:37,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(777): Region bounds: first= last= 2023-11-19 10:54:37,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegion(2446): Flush status journal for 81401826ca044bcce6b358200c9c2f2a: 2023-11-19 10:54:37,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/c381025d531f494bafc65c4e35a30f20 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__bo4u795t9alkp73tbe5bcd2ig1mm76het7j3drq5bfqv53stgcsug0rmutlhfmvq/family1/c381025d531f494bafc65c4e35a30f20 2023-11-19 10:54:37,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__bo4u795t9alkp73tbe5bcd2ig1mm76het7j3drq5bfqv53stgcsug0rmutlhfmvq/family1/c381025d531f494bafc65c4e35a30f20 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/82e6683c83a648b6a26d1c6b92adadd8_SeqId_53_ 2023-11-19 10:54:37,351 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(849): Loaded HFile hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__bo4u795t9alkp73tbe5bcd2ig1mm76het7j3drq5bfqv53stgcsug0rmutlhfmvq/family1/c381025d531f494bafc65c4e35a30f20 into 81401826ca044bcce6b358200c9c2f2a/family1 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/82e6683c83a648b6a26d1c6b92adadd8_SeqId_53_ - updating store file list. 2023-11-19 10:54:37,355 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(882): Loaded HFile hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/82e6683c83a648b6a26d1c6b92adadd8_SeqId_53_ into 81401826ca044bcce6b358200c9c2f2a/family1 2023-11-19 10:54:37,355 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(855): Successfully loaded hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__bo4u795t9alkp73tbe5bcd2ig1mm76het7j3drq5bfqv53stgcsug0rmutlhfmvq/family1/c381025d531f494bafc65c4e35a30f20 into 81401826ca044bcce6b358200c9c2f2a/family1 (new location: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/82e6683c83a648b6a26d1c6b92adadd8_SeqId_53_) 2023-11-19 10:54:37,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__bo4u795t9alkp73tbe5bcd2ig1mm76het7j3drq5bfqv53stgcsug0rmutlhfmvq/family1/c381025d531f494bafc65c4e35a30f20 2023-11-19 10:54:37,357 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-19 10:54:37,357 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:54:37,359 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112053bd8c071d644eb786c513397e8f479a to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112053bd8c071d644eb786c513397e8f479a 2023-11-19 10:54:37,360 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112887d67cc081a24394a5180af60252ee5c to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112887d67cc081a24394a5180af60252ee5c 2023-11-19 10:54:37,360 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2 expired mob files are deleted 2023-11-19 10:54:37,360 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-19 10:54:37,360 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-19 10:54:37,360 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-19 10:54:37,360 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-19 10:54:37,361 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-19 10:54:37,361 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-19 10:54:37,361 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-19 10:54:37,362 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 887 msec 2023-11-19 10:54:37,415 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-19 10:54:37,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:37,824 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-11-19 10:54:37,825 DEBUG [PEWorker-3] util.FSTableDescriptors(519): Deleted hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-11-19 10:54:37,825 INFO [PEWorker-3] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-11-19 10:54:37,827 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=50, ppid=49, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-11-19 10:54:37,830 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=81401826ca044bcce6b358200c9c2f2a, REOPEN/MOVE}] 2023-11-19 10:54:37,830 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=81401826ca044bcce6b358200c9c2f2a, REOPEN/MOVE 2023-11-19 10:54:37,831 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=81401826ca044bcce6b358200c9c2f2a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:37,831 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700391277831"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700391277831"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700391277831"}]},"ts":"1700391277831"} 2023-11-19 10:54:37,832 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE; CloseRegionProcedure 81401826ca044bcce6b358200c9c2f2a, server=jenkins-hbase4.apache.org,46035,1700391201579}] 2023-11-19 10:54:37,984 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:37,984 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 81401826ca044bcce6b358200c9c2f2a 2023-11-19 10:54:37,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 81401826ca044bcce6b358200c9c2f2a, disabling compactions & flushes 2023-11-19 10:54:37,984 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a. 2023-11-19 10:54:37,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a. 2023-11-19 10:54:37,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a. after waiting 0 ms 2023-11-19 10:54:37,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a. 2023-11-19 10:54:37,990 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-11-19 10:54:37,991 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a. 2023-11-19 10:54:37,991 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 81401826ca044bcce6b358200c9c2f2a: 2023-11-19 10:54:37,991 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 81401826ca044bcce6b358200c9c2f2a to self. 2023-11-19 10:54:37,992 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 81401826ca044bcce6b358200c9c2f2a 2023-11-19 10:54:37,992 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=81401826ca044bcce6b358200c9c2f2a, regionState=CLOSED 2023-11-19 10:54:37,992 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700391277992"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700391277992"}]},"ts":"1700391277992"} 2023-11-19 10:54:37,995 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=52, resume processing ppid=51 2023-11-19 10:54:37,995 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; CloseRegionProcedure 81401826ca044bcce6b358200c9c2f2a, server=jenkins-hbase4.apache.org,46035,1700391201579 in 161 msec 2023-11-19 10:54:37,995 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=81401826ca044bcce6b358200c9c2f2a, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,46035,1700391201579; forceNewPlan=false, retain=true 2023-11-19 10:54:38,145 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=81401826ca044bcce6b358200c9c2f2a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:38,146 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700391278145"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700391278145"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700391278145"}]},"ts":"1700391278145"} 2023-11-19 10:54:38,147 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=53, ppid=51, state=RUNNABLE; OpenRegionProcedure 81401826ca044bcce6b358200c9c2f2a, server=jenkins-hbase4.apache.org,46035,1700391201579}] 2023-11-19 10:54:38,298 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:38,301 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a. 2023-11-19 10:54:38,301 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 81401826ca044bcce6b358200c9c2f2a, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a.', STARTKEY => '', ENDKEY => ''} 2023-11-19 10:54:38,301 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 81401826ca044bcce6b358200c9c2f2a 2023-11-19 10:54:38,301 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-19 10:54:38,301 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 81401826ca044bcce6b358200c9c2f2a 2023-11-19 10:54:38,301 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 81401826ca044bcce6b358200c9c2f2a 2023-11-19 10:54:38,302 INFO [StoreOpener-81401826ca044bcce6b358200c9c2f2a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 81401826ca044bcce6b358200c9c2f2a 2023-11-19 10:54:38,303 DEBUG [StoreOpener-81401826ca044bcce6b358200c9c2f2a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1 2023-11-19 10:54:38,303 DEBUG [StoreOpener-81401826ca044bcce6b358200c9c2f2a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1 2023-11-19 10:54:38,303 INFO [StoreOpener-81401826ca044bcce6b358200c9c2f2a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 81401826ca044bcce6b358200c9c2f2a columnFamilyName family1 2023-11-19 10:54:38,308 DEBUG [StoreOpener-81401826ca044bcce6b358200c9c2f2a-1] regionserver.HStore(539): loaded hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/315dad04b82c4f62a00976aac2496ca3 2023-11-19 10:54:38,311 DEBUG [StoreOpener-81401826ca044bcce6b358200c9c2f2a-1] regionserver.HStore(539): loaded hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/family1/82e6683c83a648b6a26d1c6b92adadd8_SeqId_53_ 2023-11-19 10:54:38,311 INFO [StoreOpener-81401826ca044bcce6b358200c9c2f2a-1] regionserver.HStore(310): Store=81401826ca044bcce6b358200c9c2f2a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-19 10:54:38,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a 2023-11-19 10:54:38,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a 2023-11-19 10:54:38,316 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 81401826ca044bcce6b358200c9c2f2a 2023-11-19 10:54:38,317 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 81401826ca044bcce6b358200c9c2f2a; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71723159, jitterRate=0.06875835359096527}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-19 10:54:38,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 81401826ca044bcce6b358200c9c2f2a: 2023-11-19 10:54:38,318 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a., pid=53, masterSystemTime=1700391278298 2023-11-19 10:54:38,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a. 2023-11-19 10:54:38,319 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a. 2023-11-19 10:54:38,319 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=81401826ca044bcce6b358200c9c2f2a, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:38,319 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700391278319"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700391278319"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700391278319"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700391278319"}]},"ts":"1700391278319"} 2023-11-19 10:54:38,322 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=53, resume processing ppid=51 2023-11-19 10:54:38,322 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; OpenRegionProcedure 81401826ca044bcce6b358200c9c2f2a, server=jenkins-hbase4.apache.org,46035,1700391201579 in 174 msec 2023-11-19 10:54:38,323 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=51, resume processing ppid=50 2023-11-19 10:54:38,323 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=51, ppid=50, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=81401826ca044bcce6b358200c9c2f2a, REOPEN/MOVE in 492 msec 2023-11-19 10:54:38,325 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=50, resume processing ppid=49 2023-11-19 10:54:38,325 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=50, ppid=49, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 496 msec 2023-11-19 10:54:38,326 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 909 msec 2023-11-19 10:54:38,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=49 2023-11-19 10:54:38,329 INFO [Listener at localhost/42675] compactions.TestMobCompactor(278): alter status finished 2023-11-19 10:54:38,330 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=33457] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-19 10:54:38,331 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] procedure2.ProcedureExecutor(1028): Stored pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-19 10:54:38,331 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-19 10:54:38,332 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-19 10:54:38,332 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=54, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700391878332 2023-11-19 10:54:38,332 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-19 10:54:38,333 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-11-19 10:54:38,333 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-19 10:54:38,334 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] zookeeper.ReadOnlyZKClient(139): Connect 0x7bb4696c to 127.0.0.1:60497 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-19 10:54:38,338 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@399195f5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-19 10:54:38,338 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-19 10:54:38,338 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-19 10:54:38,339 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-19 10:54:38,339 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-19 10:54:38,339 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-19 10:54:38,339 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-19 10:54:38,339 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-19 10:54:38,339 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-19 10:54:38,339 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-19 10:54:38,339 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-19 10:54:38,340 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=54, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-19 10:54:38,341 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=54, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 10 msec 2023-11-19 10:54:38,387 INFO [Listener at localhost/42675] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=250 (was 252), OpenFileDescriptor=664 (was 645) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=136 (was 179), ProcessCount=171 (was 172), AvailableMemoryMB=15450 (was 15466) 2023-11-19 10:54:38,398 INFO [Listener at localhost/42675] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=250, OpenFileDescriptor=664, MaxFileDescriptor=60000, SystemLoadAverage=136, ProcessCount=171, AvailableMemoryMB=15449 2023-11-19 10:54:38,399 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-19 10:54:38,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure2.ProcedureExecutor(1028): Stored pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:38,401 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_PRE_OPERATION 2023-11-19 10:54:38,401 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily" procId is: 55 2023-11-19 10:54:38,402 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-19 10:54:38,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-19 10:54:38,403 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe 2023-11-19 10:54:38,403 DEBUG [HFileArchiver-10] backup.HFileArchiver(153): Directory hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe empty. 2023-11-19 10:54:38,404 DEBUG [HFileArchiver-10] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe 2023-11-19 10:54:38,404 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily regions 2023-11-19 10:54:38,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-19 10:54:38,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-19 10:54:38,811 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-11-19 10:54:38,812 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6bc32bc9f7c3f1d5eebc37dd041af4fe, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp 2023-11-19 10:54:39,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-19 10:54:39,218 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-19 10:54:39,218 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1604): Closing 6bc32bc9f7c3f1d5eebc37dd041af4fe, disabling compactions & flushes 2023-11-19 10:54:39,218 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe. 2023-11-19 10:54:39,218 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe. 2023-11-19 10:54:39,218 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe. after waiting 0 ms 2023-11-19 10:54:39,218 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe. 2023-11-19 10:54:39,218 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe. 2023-11-19 10:54:39,218 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1558): Region close journal for 6bc32bc9f7c3f1d5eebc37dd041af4fe: 2023-11-19 10:54:39,220 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ADD_TO_META 2023-11-19 10:54:39,221 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700391279221"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700391279221"}]},"ts":"1700391279221"} 2023-11-19 10:54:39,222 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-19 10:54:39,223 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-19 10:54:39,223 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700391279223"}]},"ts":"1700391279223"} 2023-11-19 10:54:39,224 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLING in hbase:meta 2023-11-19 10:54:39,227 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=6bc32bc9f7c3f1d5eebc37dd041af4fe, ASSIGN}] 2023-11-19 10:54:39,228 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=6bc32bc9f7c3f1d5eebc37dd041af4fe, ASSIGN 2023-11-19 10:54:39,229 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=6bc32bc9f7c3f1d5eebc37dd041af4fe, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46035,1700391201579; forceNewPlan=false, retain=false 2023-11-19 10:54:39,380 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=6bc32bc9f7c3f1d5eebc37dd041af4fe, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:39,380 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700391279380"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700391279380"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700391279380"}]},"ts":"1700391279380"} 2023-11-19 10:54:39,381 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=57, ppid=56, state=RUNNABLE; OpenRegionProcedure 6bc32bc9f7c3f1d5eebc37dd041af4fe, server=jenkins-hbase4.apache.org,46035,1700391201579}] 2023-11-19 10:54:39,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-19 10:54:39,532 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:39,535 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe. 2023-11-19 10:54:39,535 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6bc32bc9f7c3f1d5eebc37dd041af4fe, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe.', STARTKEY => '', ENDKEY => ''} 2023-11-19 10:54:39,535 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 6bc32bc9f7c3f1d5eebc37dd041af4fe 2023-11-19 10:54:39,535 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-19 10:54:39,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6bc32bc9f7c3f1d5eebc37dd041af4fe 2023-11-19 10:54:39,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6bc32bc9f7c3f1d5eebc37dd041af4fe 2023-11-19 10:54:39,537 INFO [StoreOpener-6bc32bc9f7c3f1d5eebc37dd041af4fe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 6bc32bc9f7c3f1d5eebc37dd041af4fe 2023-11-19 10:54:39,538 DEBUG [StoreOpener-6bc32bc9f7c3f1d5eebc37dd041af4fe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1 2023-11-19 10:54:39,538 DEBUG [StoreOpener-6bc32bc9f7c3f1d5eebc37dd041af4fe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1 2023-11-19 10:54:39,538 INFO [StoreOpener-6bc32bc9f7c3f1d5eebc37dd041af4fe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6bc32bc9f7c3f1d5eebc37dd041af4fe columnFamilyName family1 2023-11-19 10:54:39,539 INFO [StoreOpener-6bc32bc9f7c3f1d5eebc37dd041af4fe-1] regionserver.HStore(310): Store=6bc32bc9f7c3f1d5eebc37dd041af4fe/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-19 10:54:39,540 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe 2023-11-19 10:54:39,541 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe 2023-11-19 10:54:39,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6bc32bc9f7c3f1d5eebc37dd041af4fe 2023-11-19 10:54:39,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-19 10:54:39,545 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6bc32bc9f7c3f1d5eebc37dd041af4fe; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63393119, jitterRate=-0.05536891520023346}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-19 10:54:39,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6bc32bc9f7c3f1d5eebc37dd041af4fe: 2023-11-19 10:54:39,546 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe., pid=57, masterSystemTime=1700391279532 2023-11-19 10:54:39,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe. 2023-11-19 10:54:39,547 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe. 2023-11-19 10:54:39,547 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=6bc32bc9f7c3f1d5eebc37dd041af4fe, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:39,547 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700391279547"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700391279547"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700391279547"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700391279547"}]},"ts":"1700391279547"} 2023-11-19 10:54:39,550 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=57, resume processing ppid=56 2023-11-19 10:54:39,550 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=57, ppid=56, state=SUCCESS; OpenRegionProcedure 6bc32bc9f7c3f1d5eebc37dd041af4fe, server=jenkins-hbase4.apache.org,46035,1700391201579 in 168 msec 2023-11-19 10:54:39,551 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=56, resume processing ppid=55 2023-11-19 10:54:39,551 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=56, ppid=55, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=6bc32bc9f7c3f1d5eebc37dd041af4fe, ASSIGN in 323 msec 2023-11-19 10:54:39,552 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-19 10:54:39,552 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700391279552"}]},"ts":"1700391279552"} 2023-11-19 10:54:39,553 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLED in hbase:meta 2023-11-19 10:54:39,556 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_POST_OPERATION 2023-11-19 10:54:39,557 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=55, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1570 sec 2023-11-19 10:54:40,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-19 10:54:40,506 INFO [Listener at localhost/42675] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, procId: 55 completed 2023-11-19 10:54:40,524 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:54:40,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:40,525 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-19 10:54:40,525 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:54:40,525 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-19 10:54:40,525 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-19 10:54:40,526 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:40,526 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:40,528 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:54:40,528 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:40,528 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:54:40,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:54:40,528 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:40,528 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:54:40,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:40,529 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:40,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:54:40,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:40,529 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:40,529 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:40,529 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-19 10:54:40,529 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:54:40,529 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-19 10:54:40,530 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-19 10:54:40,530 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:54:40,530 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe. 2023-11-19 10:54:40,530 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe. started... 2023-11-19 10:54:40,531 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6bc32bc9f7c3f1d5eebc37dd041af4fe 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-19 10:54:40,951 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130a0ddc38e49b8488a843546b5f14e4339 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130a0ddc38e49b8488a843546b5f14e4339 2023-11-19 10:54:41,355 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/.tmp/family1/acf8b3b3ebde4c66b3dc0e4e007454d4 2023-11-19 10:54:41,360 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/.tmp/family1/acf8b3b3ebde4c66b3dc0e4e007454d4 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/acf8b3b3ebde4c66b3dc0e4e007454d4 2023-11-19 10:54:41,363 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/acf8b3b3ebde4c66b3dc0e4e007454d4, entries=1000, sequenceid=5, filesize=190.5 K 2023-11-19 10:54:41,364 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 6bc32bc9f7c3f1d5eebc37dd041af4fe in 833ms, sequenceid=5, compaction requested=false 2023-11-19 10:54:41,364 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-19 10:54:41,365 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6bc32bc9f7c3f1d5eebc37dd041af4fe: 2023-11-19 10:54:41,365 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe. 2023-11-19 10:54:41,365 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-19 10:54:41,365 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-19 10:54:41,365 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:41,365 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-19 10:54:41,365 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-19 10:54:41,367 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:41,367 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:41,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:41,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:41,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:41,367 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:41,367 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:54:41,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:41,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:41,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:41,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:41,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:41,368 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-19 10:54:41,368 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4b1952c3[Count = 0] remaining members to acquire global barrier 2023-11-19 10:54:41,368 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-19 10:54:41,368 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:41,369 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:41,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:41,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:41,370 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-19 10:54:41,370 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-19 10:54:41,370 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:54:41,370 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:41,370 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:54:41,372 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-19 10:54:41,372 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:54:41,372 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:41,372 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-19 10:54:41,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:41,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:41,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:41,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:41,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:41,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:41,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:41,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:41,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:41,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:41,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:54:41,375 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-19 10:54:41,375 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-19 10:54:41,375 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:54:41,375 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:54:41,375 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:41,375 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:54:41,379 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:41,379 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:41,379 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:41,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:41,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:41,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:41,379 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:54:41,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:41,379 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:54:41,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:54:41,379 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:41,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:41,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:41,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:41,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:41,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:41,381 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:41,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:41,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:41,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:41,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:41,383 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:41,383 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:41,383 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:41,383 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:54:41,383 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:54:41,383 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-19 10:54:41,383 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:41,383 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:54:41,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:54:41,383 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-19 10:54:41,383 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:54:41,383 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:54:41,383 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:41,383 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:41,383 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:41,383 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:54:41,384 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-19 10:54:41,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:54:41,384 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:54:41,484 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:54:41,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:54:41,488 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:54:41,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-19 10:54:41,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:41,490 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-19 10:54:41,490 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:54:41,490 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-19 10:54:41,490 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-19 10:54:41,491 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:41,491 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:41,492 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:54:41,492 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:41,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:54:41,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:54:41,492 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:41,492 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:54:41,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:41,493 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:41,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:54:41,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:41,493 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:41,493 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-19 10:54:41,493 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:41,494 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-19 10:54:41,494 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:54:41,494 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-19 10:54:41,494 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-19 10:54:41,494 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:54:41,494 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe. 2023-11-19 10:54:41,494 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe. started... 2023-11-19 10:54:41,494 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6bc32bc9f7c3f1d5eebc37dd041af4fe 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-19 10:54:41,674 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-19 10:54:41,908 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112810621b6741fa437488342faed699b161 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112810621b6741fa437488342faed699b161 2023-11-19 10:54:42,314 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/.tmp/family1/70fe3064519044709993547eb142c8cc 2023-11-19 10:54:42,318 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/.tmp/family1/70fe3064519044709993547eb142c8cc as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/70fe3064519044709993547eb142c8cc 2023-11-19 10:54:42,322 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/70fe3064519044709993547eb142c8cc, entries=1, sequenceid=9, filesize=5.0 K 2023-11-19 10:54:42,323 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 6bc32bc9f7c3f1d5eebc37dd041af4fe in 829ms, sequenceid=9, compaction requested=false 2023-11-19 10:54:42,323 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6bc32bc9f7c3f1d5eebc37dd041af4fe: 2023-11-19 10:54:42,323 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe. 2023-11-19 10:54:42,323 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-19 10:54:42,324 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-19 10:54:42,324 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:42,324 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-19 10:54:42,324 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-19 10:54:42,326 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:42,326 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:42,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:42,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:42,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:42,327 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:42,327 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:54:42,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:42,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:42,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:42,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:42,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:42,328 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-19 10:54:42,328 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9398cb2[Count = 0] remaining members to acquire global barrier 2023-11-19 10:54:42,328 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-19 10:54:42,328 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:42,329 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:42,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:42,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:42,330 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-19 10:54:42,330 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-19 10:54:42,330 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:54:42,330 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:42,330 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:54:42,331 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:42,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:42,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:42,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:42,331 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-19 10:54:42,331 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:54:42,331 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-19 10:54:42,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:42,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:42,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:42,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:42,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:42,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:42,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:42,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:54:42,334 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-19 10:54:42,334 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-19 10:54:42,334 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:54:42,334 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:54:42,334 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:42,334 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:54:42,335 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:42,335 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:42,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:42,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:42,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:42,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:42,335 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:54:42,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:42,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:42,336 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:42,336 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:54:42,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:54:42,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:42,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:42,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:42,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:42,337 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:42,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:42,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:42,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:42,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:42,341 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:42,341 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:42,341 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:42,341 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:54:42,341 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:54:42,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:54:42,341 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:54:42,341 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-19 10:54:42,341 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:54:42,341 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:42,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:54:42,341 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-19 10:54:42,341 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:42,341 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-19 10:54:42,341 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:42,342 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:54:42,342 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:42,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:54:42,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:54:42,442 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:54:42,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:54:42,447 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:54:42,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-19 10:54:42,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:42,449 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-19 10:54:42,449 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:54:42,449 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-19 10:54:42,449 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-19 10:54:42,449 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:42,449 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:42,451 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:54:42,451 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:42,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:54:42,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:54:42,451 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:42,451 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:54:42,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:42,452 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:42,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:54:42,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:42,452 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:42,452 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-19 10:54:42,452 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:42,452 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-19 10:54:42,453 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:54:42,453 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-19 10:54:42,453 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-19 10:54:42,453 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:54:42,453 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe. 2023-11-19 10:54:42,453 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe. started... 2023-11-19 10:54:42,453 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6bc32bc9f7c3f1d5eebc37dd041af4fe 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-19 10:54:42,875 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120148090472b3134a5cabfd4e142b4a6932 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120148090472b3134a5cabfd4e142b4a6932 2023-11-19 10:54:43,280 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/.tmp/family1/c192c128ecc146939bf3fdd6a7d27fef 2023-11-19 10:54:43,284 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/.tmp/family1/c192c128ecc146939bf3fdd6a7d27fef as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/c192c128ecc146939bf3fdd6a7d27fef 2023-11-19 10:54:43,288 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/c192c128ecc146939bf3fdd6a7d27fef, entries=1, sequenceid=13, filesize=5.0 K 2023-11-19 10:54:43,289 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6bc32bc9f7c3f1d5eebc37dd041af4fe in 836ms, sequenceid=13, compaction requested=true 2023-11-19 10:54:43,289 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6bc32bc9f7c3f1d5eebc37dd041af4fe: 2023-11-19 10:54:43,289 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe. 2023-11-19 10:54:43,289 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-19 10:54:43,289 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-19 10:54:43,289 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:43,289 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-19 10:54:43,289 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-19 10:54:43,291 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:43,291 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:43,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:43,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:43,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:43,291 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:43,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:43,291 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:54:43,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:43,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:43,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:43,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:43,293 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-19 10:54:43,293 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2134e190[Count = 0] remaining members to acquire global barrier 2023-11-19 10:54:43,293 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-19 10:54:43,293 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:43,294 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:43,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:43,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:43,294 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-19 10:54:43,294 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-19 10:54:43,294 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:54:43,294 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:43,294 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:54:43,296 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-19 10:54:43,296 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:43,297 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:54:43,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:43,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:43,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:43,297 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-19 10:54:43,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:43,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:43,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:43,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:43,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:43,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:43,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:43,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:54:43,299 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-19 10:54:43,299 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-19 10:54:43,299 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:54:43,299 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:54:43,299 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:43,299 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:54:43,301 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:43,301 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:54:43,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:43,301 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:43,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:43,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:43,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:43,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:43,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:54:43,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:54:43,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:43,301 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:43,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:43,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:43,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:43,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:43,303 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:43,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:43,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:43,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:43,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:43,307 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:54:43,307 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:43,307 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:54:43,307 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-19 10:54:43,307 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:43,307 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-19 10:54:43,307 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:54:43,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:54:43,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:54:43,307 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:54:43,307 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:43,308 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:43,308 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:43,308 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-19 10:54:43,308 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:43,308 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:54:43,308 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:43,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:54:43,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:54:43,408 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:54:43,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:54:43,412 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:54:43,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-19 10:54:43,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:43,414 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-19 10:54:43,414 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:54:43,414 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-19 10:54:43,414 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-19 10:54:43,414 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:43,414 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:43,419 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:43,419 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:54:43,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:54:43,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:54:43,419 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:43,419 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:54:43,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:43,420 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:43,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:54:43,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:43,420 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:43,420 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-19 10:54:43,420 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:43,420 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-19 10:54:43,420 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:54:43,420 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-19 10:54:43,421 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-19 10:54:43,421 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:54:43,421 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe. 2023-11-19 10:54:43,421 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe. started... 2023-11-19 10:54:43,421 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6bc32bc9f7c3f1d5eebc37dd041af4fe 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-19 10:54:43,832 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120590574ddbc9b14c02b9209be55bd9e76e to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120590574ddbc9b14c02b9209be55bd9e76e 2023-11-19 10:54:44,237 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/.tmp/family1/6f594e9adf174f0a9b3dc316940736e3 2023-11-19 10:54:44,242 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/.tmp/family1/6f594e9adf174f0a9b3dc316940736e3 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/6f594e9adf174f0a9b3dc316940736e3 2023-11-19 10:54:44,246 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/6f594e9adf174f0a9b3dc316940736e3, entries=1, sequenceid=17, filesize=5.0 K 2023-11-19 10:54:44,246 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6bc32bc9f7c3f1d5eebc37dd041af4fe in 825ms, sequenceid=17, compaction requested=true 2023-11-19 10:54:44,246 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6bc32bc9f7c3f1d5eebc37dd041af4fe: 2023-11-19 10:54:44,247 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe. 2023-11-19 10:54:44,247 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-19 10:54:44,247 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-19 10:54:44,247 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:44,247 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-19 10:54:44,247 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-19 10:54:44,248 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:44,248 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:44,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:44,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:44,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:44,249 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:44,249 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:54:44,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:44,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:44,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:44,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:44,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:44,250 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-19 10:54:44,250 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@27679b3c[Count = 0] remaining members to acquire global barrier 2023-11-19 10:54:44,250 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-19 10:54:44,250 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:44,252 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:44,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:44,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:44,253 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-19 10:54:44,253 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-19 10:54:44,253 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:54:44,253 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:44,253 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:54:44,255 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:44,256 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-19 10:54:44,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:44,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:44,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:44,256 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:54:44,256 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-19 10:54:44,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:44,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:44,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:44,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:44,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:44,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:44,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:44,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:54:44,258 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-19 10:54:44,258 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-19 10:54:44,258 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:54:44,258 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:54:44,258 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:44,258 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:54:44,260 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:44,260 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:44,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:44,260 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:54:44,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:44,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:44,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:44,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:44,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:54:44,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:54:44,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:44,261 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:44,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:44,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:44,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:44,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:44,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:44,262 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:44,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:44,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:44,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:44,264 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:44,264 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:44,264 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:54:44,264 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:44,264 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-19 10:54:44,264 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:54:44,264 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:54:44,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:54:44,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:54:44,264 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:54:44,264 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:44,265 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-19 10:54:44,265 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:44,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:54:44,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:54:44,265 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:44,265 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:54:44,265 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:44,365 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:54:44,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:54:44,369 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:54:44,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-19 10:54:44,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:44,371 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-19 10:54:44,371 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:54:44,371 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-19 10:54:44,371 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-19 10:54:44,372 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:44,372 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:44,373 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:44,373 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:54:44,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:54:44,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:54:44,373 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:44,373 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:54:44,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:44,374 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:44,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:54:44,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:44,374 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:44,374 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-19 10:54:44,374 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:44,374 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-19 10:54:44,374 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:54:44,374 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-19 10:54:44,375 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-19 10:54:44,375 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:54:44,375 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe. 2023-11-19 10:54:44,375 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe. started... 2023-11-19 10:54:44,375 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6bc32bc9f7c3f1d5eebc37dd041af4fe 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-19 10:54:44,790 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122849f26676a2114e438596394e9ed9073f to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015122849f26676a2114e438596394e9ed9073f 2023-11-19 10:54:45,196 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/.tmp/family1/386605f521b045ef87987c66e469e078 2023-11-19 10:54:45,202 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/.tmp/family1/386605f521b045ef87987c66e469e078 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/386605f521b045ef87987c66e469e078 2023-11-19 10:54:45,206 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/386605f521b045ef87987c66e469e078, entries=1, sequenceid=21, filesize=5.0 K 2023-11-19 10:54:45,207 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6bc32bc9f7c3f1d5eebc37dd041af4fe in 832ms, sequenceid=21, compaction requested=true 2023-11-19 10:54:45,207 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6bc32bc9f7c3f1d5eebc37dd041af4fe: 2023-11-19 10:54:45,207 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe. 2023-11-19 10:54:45,207 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-19 10:54:45,207 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-19 10:54:45,207 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:45,208 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-19 10:54:45,208 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-19 10:54:45,211 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:45,211 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:45,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:45,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:45,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:45,211 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:45,211 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:54:45,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:45,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:45,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:45,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:45,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:45,212 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-19 10:54:45,212 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@26e95a59[Count = 0] remaining members to acquire global barrier 2023-11-19 10:54:45,212 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-19 10:54:45,212 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:45,213 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:45,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:45,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:45,214 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-19 10:54:45,214 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-19 10:54:45,214 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:54:45,214 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:45,214 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:54:45,215 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:45,215 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-19 10:54:45,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:45,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:45,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:45,215 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:54:45,215 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-19 10:54:45,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:45,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:45,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:45,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:45,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:45,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:45,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:45,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:54:45,217 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-19 10:54:45,217 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-19 10:54:45,218 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:54:45,218 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:54:45,218 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:45,218 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:54:45,219 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:45,219 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:45,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:45,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:45,219 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:54:45,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:45,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:45,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:45,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:54:45,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:54:45,220 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:45,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:45,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:45,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:45,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:45,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:45,221 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:45,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:45,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:45,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:45,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:45,223 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:45,223 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:45,224 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:45,224 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:54:45,224 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:45,224 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:54:45,224 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:45,224 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-19 10:54:45,224 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:54:45,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:54:45,224 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:54:45,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:54:45,224 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:45,224 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-19 10:54:45,224 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-19 10:54:45,224 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:54:45,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:54:45,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:54:45,224 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:45,324 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:54:45,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:54:45,328 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:54:45,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-19 10:54:45,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:45,330 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-19 10:54:45,330 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:54:45,330 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-19 10:54:45,330 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-19 10:54:45,330 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:45,330 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:45,331 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:45,332 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:54:45,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:54:45,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:54:45,332 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:45,332 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:54:45,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:45,332 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:45,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:54:45,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:45,333 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:45,333 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-19 10:54:45,333 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:45,333 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-19 10:54:45,333 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:54:45,333 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-19 10:54:45,333 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-19 10:54:45,333 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:54:45,333 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe. 2023-11-19 10:54:45,333 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe. started... 2023-11-19 10:54:45,333 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6bc32bc9f7c3f1d5eebc37dd041af4fe 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-19 10:54:45,750 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231b5d1b51e86ef48059c7ec74f05564cab to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231b5d1b51e86ef48059c7ec74f05564cab 2023-11-19 10:54:46,156 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/.tmp/family1/0cafe6b162a9409ca6dabdbdd552c245 2023-11-19 10:54:46,161 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/.tmp/family1/0cafe6b162a9409ca6dabdbdd552c245 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/0cafe6b162a9409ca6dabdbdd552c245 2023-11-19 10:54:46,164 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/0cafe6b162a9409ca6dabdbdd552c245, entries=1, sequenceid=25, filesize=5.0 K 2023-11-19 10:54:46,165 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6bc32bc9f7c3f1d5eebc37dd041af4fe in 832ms, sequenceid=25, compaction requested=true 2023-11-19 10:54:46,165 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6bc32bc9f7c3f1d5eebc37dd041af4fe: 2023-11-19 10:54:46,165 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe. 2023-11-19 10:54:46,165 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-19 10:54:46,165 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-19 10:54:46,165 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:46,165 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-19 10:54:46,165 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-19 10:54:46,167 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:46,167 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:46,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:46,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:46,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:46,168 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:46,168 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:54:46,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:46,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:46,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:46,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:46,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:46,169 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-19 10:54:46,169 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@63701e2a[Count = 0] remaining members to acquire global barrier 2023-11-19 10:54:46,169 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-19 10:54:46,170 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:46,171 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:46,171 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:46,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:46,172 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-19 10:54:46,172 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-19 10:54:46,172 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:54:46,172 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:46,172 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:54:46,173 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-19 10:54:46,173 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:46,173 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:54:46,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:46,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:46,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:46,173 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-19 10:54:46,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:46,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:46,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:46,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:46,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:46,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:46,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:46,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:54:46,175 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-19 10:54:46,175 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-19 10:54:46,175 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:54:46,175 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:54:46,176 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:46,176 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:54:46,177 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:46,177 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:46,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:46,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:46,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:46,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:46,177 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:54:46,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:46,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:54:46,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:54:46,178 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:46,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:46,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:46,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:46,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:46,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:46,179 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:46,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:46,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:46,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:46,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:46,181 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:54:46,181 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:46,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:54:46,181 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:54:46,181 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:54:46,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:54:46,181 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-19 10:54:46,182 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:54:46,181 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:46,182 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:46,182 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:46,182 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:46,182 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:46,182 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-19 10:54:46,182 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:46,182 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-19 10:54:46,182 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:54:46,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:54:46,182 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:54:46,282 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:54:46,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:54:46,287 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:54:46,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-19 10:54:46,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:46,288 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-19 10:54:46,288 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:54:46,288 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-19 10:54:46,288 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-19 10:54:46,289 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:46,289 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:46,291 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:54:46,291 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:46,291 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:54:46,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:54:46,292 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:46,292 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:54:46,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:46,292 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:46,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:54:46,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:46,292 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:46,292 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-19 10:54:46,293 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:46,293 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-19 10:54:46,293 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:54:46,293 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-19 10:54:46,293 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-19 10:54:46,293 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:54:46,293 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe. 2023-11-19 10:54:46,293 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe. started... 2023-11-19 10:54:46,293 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6bc32bc9f7c3f1d5eebc37dd041af4fe 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-19 10:54:46,705 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601011ed00eab45864415b7a880dcfba8f1be to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601011ed00eab45864415b7a880dcfba8f1be 2023-11-19 10:54:47,110 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/.tmp/family1/7212d3b889bf4c14ad410798a9c6e9df 2023-11-19 10:54:47,130 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7bb4696c to 127.0.0.1:60497 2023-11-19 10:54:47,130 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-19 10:54:47,131 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-19 10:54:47,131 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x46414ad2 to 127.0.0.1:60497 2023-11-19 10:54:47,131 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-19 10:54:47,131 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-19 10:54:47,131 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x61edd822 to 127.0.0.1:60497 2023-11-19 10:54:47,131 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-19 10:54:47,131 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-19 10:54:47,131 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1367a3cb to 127.0.0.1:60497 2023-11-19 10:54:47,131 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-19 10:54:47,132 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-19 10:54:47,132 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6ef2d67e to 127.0.0.1:60497 2023-11-19 10:54:47,132 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-19 10:54:47,135 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/.tmp/family1/7212d3b889bf4c14ad410798a9c6e9df as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/7212d3b889bf4c14ad410798a9c6e9df 2023-11-19 10:54:47,139 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/7212d3b889bf4c14ad410798a9c6e9df, entries=1, sequenceid=29, filesize=5.0 K 2023-11-19 10:54:47,139 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6bc32bc9f7c3f1d5eebc37dd041af4fe in 846ms, sequenceid=29, compaction requested=true 2023-11-19 10:54:47,140 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6bc32bc9f7c3f1d5eebc37dd041af4fe: 2023-11-19 10:54:47,140 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe. 2023-11-19 10:54:47,140 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-19 10:54:47,140 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-19 10:54:47,140 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:47,140 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-19 10:54:47,140 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-19 10:54:47,142 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:47,142 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:47,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:47,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:47,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:47,142 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:47,143 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:54:47,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:47,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:47,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:47,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:47,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:47,144 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-19 10:54:47,144 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@654e5bb5[Count = 0] remaining members to acquire global barrier 2023-11-19 10:54:47,144 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-19 10:54:47,144 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:47,145 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:47,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:47,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:47,145 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-19 10:54:47,145 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-19 10:54:47,145 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:54:47,145 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:47,145 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:54:47,147 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-19 10:54:47,147 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:54:47,147 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:47,147 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-19 10:54:47,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:47,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:47,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:47,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:47,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:47,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:47,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:47,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:47,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:47,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:47,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:54:47,149 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-19 10:54:47,149 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-19 10:54:47,149 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:54:47,149 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:54:47,149 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:47,149 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:54:47,151 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:47,151 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:47,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:47,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:47,151 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:54:47,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:47,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:47,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:47,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:54:47,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:54:47,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:47,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:47,152 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:47,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:47,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:47,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:47,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:47,153 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:47,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:47,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:47,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:47,156 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:47,156 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:54:47,156 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:47,156 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:54:47,156 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:47,156 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-19 10:54:47,156 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:54:47,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:54:47,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:54:47,156 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:54:47,156 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:47,157 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:47,157 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-19 10:54:47,157 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:54:47,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:54:47,157 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:47,157 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:54:47,157 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:47,257 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:54:47,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:54:47,261 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:54:47,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-19 10:54:47,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:47,263 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-19 10:54:47,263 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:54:47,263 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-19 10:54:47,263 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-19 10:54:47,264 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:47,264 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:47,265 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:54:47,265 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:47,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:54:47,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:54:47,265 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:47,265 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:54:47,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:47,266 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:47,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:54:47,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:47,266 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:47,267 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-19 10:54:47,267 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:47,267 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-19 10:54:47,267 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:54:47,267 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-19 10:54:47,267 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-19 10:54:47,267 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:54:47,267 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe. 2023-11-19 10:54:47,267 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe. started... 2023-11-19 10:54:47,267 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6bc32bc9f7c3f1d5eebc37dd041af4fe 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-19 10:54:47,682 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010394e17d0316774ff0af0c1d9677fc3173 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010394e17d0316774ff0af0c1d9677fc3173 2023-11-19 10:54:48,087 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/.tmp/family1/f54f44a8b399400e8c24b70809ffcb50 2023-11-19 10:54:48,091 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/.tmp/family1/f54f44a8b399400e8c24b70809ffcb50 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/f54f44a8b399400e8c24b70809ffcb50 2023-11-19 10:54:48,095 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/f54f44a8b399400e8c24b70809ffcb50, entries=1, sequenceid=33, filesize=5.0 K 2023-11-19 10:54:48,095 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6bc32bc9f7c3f1d5eebc37dd041af4fe in 828ms, sequenceid=33, compaction requested=true 2023-11-19 10:54:48,096 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6bc32bc9f7c3f1d5eebc37dd041af4fe: 2023-11-19 10:54:48,096 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe. 2023-11-19 10:54:48,096 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-19 10:54:48,096 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-19 10:54:48,096 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:48,096 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-19 10:54:48,096 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-19 10:54:48,097 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:48,097 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:48,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:48,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:48,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:48,098 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:48,098 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:54:48,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:48,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:48,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:48,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:48,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:48,099 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-19 10:54:48,099 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7eeb825b[Count = 0] remaining members to acquire global barrier 2023-11-19 10:54:48,099 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-19 10:54:48,099 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:48,104 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:48,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:48,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:48,104 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-19 10:54:48,104 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-19 10:54:48,104 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:48,104 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:54:48,104 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:54:48,105 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-19 10:54:48,105 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:54:48,105 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:48,105 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-19 10:54:48,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:48,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:48,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:48,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:48,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:48,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:48,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:48,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:48,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:48,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:48,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:54:48,108 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-19 10:54:48,108 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-19 10:54:48,108 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:54:48,108 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:54:48,108 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:48,108 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:54:48,109 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:48,109 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:48,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:48,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:48,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:48,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:48,109 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:54:48,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:48,110 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:48,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:54:48,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:54:48,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:48,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:48,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:48,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:48,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:48,111 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:48,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:48,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:48,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:48,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:48,114 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:48,114 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:54:48,114 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:48,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:54:48,114 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-19 10:54:48,114 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:54:48,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:54:48,114 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-19 10:54:48,114 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:54:48,114 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:54:48,114 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:48,114 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:48,114 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:48,114 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:48,114 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:48,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:54:48,114 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-19 10:54:48,114 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:54:48,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:54:48,214 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:54:48,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:54:48,218 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:54:48,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-19 10:54:48,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:48,220 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-19 10:54:48,220 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:54:48,220 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-19 10:54:48,220 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-19 10:54:48,220 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:48,220 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:48,221 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:54:48,221 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:48,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:54:48,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:54:48,221 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:48,221 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:54:48,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:48,222 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:48,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:54:48,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:48,222 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:48,223 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-19 10:54:48,223 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:48,223 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-19 10:54:48,223 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:54:48,223 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-19 10:54:48,223 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-19 10:54:48,223 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:54:48,223 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe. 2023-11-19 10:54:48,223 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe. started... 2023-11-19 10:54:48,223 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6bc32bc9f7c3f1d5eebc37dd041af4fe 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-19 10:54:48,640 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090732d009ae94324c3ea7b36260c84ffebf to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015090732d009ae94324c3ea7b36260c84ffebf 2023-11-19 10:54:48,656 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/.tmp/family1/e1143a99ee294acc85a1cb23d284e989 2023-11-19 10:54:48,660 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/.tmp/family1/e1143a99ee294acc85a1cb23d284e989 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/e1143a99ee294acc85a1cb23d284e989 2023-11-19 10:54:48,664 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/e1143a99ee294acc85a1cb23d284e989, entries=1, sequenceid=37, filesize=5.0 K 2023-11-19 10:54:48,665 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6bc32bc9f7c3f1d5eebc37dd041af4fe in 442ms, sequenceid=37, compaction requested=true 2023-11-19 10:54:48,665 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6bc32bc9f7c3f1d5eebc37dd041af4fe: 2023-11-19 10:54:48,665 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe. 2023-11-19 10:54:48,665 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-19 10:54:48,665 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-19 10:54:48,665 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:48,665 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-19 10:54:48,665 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-19 10:54:48,667 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:48,667 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:48,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:48,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:48,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:48,667 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:48,667 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:54:48,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:48,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:48,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:48,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:48,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:48,669 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-19 10:54:48,669 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@12bc344d[Count = 0] remaining members to acquire global barrier 2023-11-19 10:54:48,669 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-19 10:54:48,669 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:48,670 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:48,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:48,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:48,671 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-19 10:54:48,671 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-19 10:54:48,671 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:54:48,671 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:48,671 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:54:48,673 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-19 10:54:48,673 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:54:48,673 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:48,673 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-19 10:54:48,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:48,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:48,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:48,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:48,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:48,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:48,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:48,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:48,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:48,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:48,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:54:48,676 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-19 10:54:48,676 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-19 10:54:48,676 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:54:48,676 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:54:48,676 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:48,676 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:54:48,677 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:48,677 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:48,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:48,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:48,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:48,678 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:48,678 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:54:48,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:48,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:48,678 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:48,678 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:54:48,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:54:48,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:48,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:48,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:48,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:48,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:48,679 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:48,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:48,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:48,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:48,682 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:48,682 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:48,682 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:48,682 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:54:48,682 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:48,682 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:54:48,682 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-19 10:54:48,682 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:48,682 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-19 10:54:48,682 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:54:48,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:54:48,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:54:48,682 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:54:48,682 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:48,682 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:48,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:54:48,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:54:48,683 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-19 10:54:48,683 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:54:48,783 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:54:48,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:54:48,788 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:54:48,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-19 10:54:48,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:48,790 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-19 10:54:48,790 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:54:48,791 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-19 10:54:48,791 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-19 10:54:48,791 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:48,791 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:48,792 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:48,792 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:54:48,793 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:54:48,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:54:48,793 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:48,793 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:54:48,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:48,793 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:48,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:54:48,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:48,794 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:48,794 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-19 10:54:48,794 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:48,794 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-19 10:54:48,794 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:54:48,794 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-19 10:54:48,794 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-19 10:54:48,794 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:54:48,794 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe. 2023-11-19 10:54:48,794 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe. started... 2023-11-19 10:54:48,795 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6bc32bc9f7c3f1d5eebc37dd041af4fe 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-19 10:54:49,209 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511202d9a2c7db2b04301b87e2a2be1f0a26f to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511202d9a2c7db2b04301b87e2a2be1f0a26f 2023-11-19 10:54:49,614 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/.tmp/family1/8cdf089163b74fa5a07f5ceea27b3a6c 2023-11-19 10:54:49,618 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/.tmp/family1/8cdf089163b74fa5a07f5ceea27b3a6c as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/8cdf089163b74fa5a07f5ceea27b3a6c 2023-11-19 10:54:49,622 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/8cdf089163b74fa5a07f5ceea27b3a6c, entries=1, sequenceid=41, filesize=5.0 K 2023-11-19 10:54:49,623 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6bc32bc9f7c3f1d5eebc37dd041af4fe in 828ms, sequenceid=41, compaction requested=true 2023-11-19 10:54:49,623 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6bc32bc9f7c3f1d5eebc37dd041af4fe: 2023-11-19 10:54:49,623 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe. 2023-11-19 10:54:49,623 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-19 10:54:49,623 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-19 10:54:49,623 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:49,623 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-19 10:54:49,623 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-19 10:54:49,625 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:49,625 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:49,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:49,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:49,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:49,626 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:49,626 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:54:49,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:49,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:49,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:49,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:49,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:49,627 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-19 10:54:49,627 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@715ee97e[Count = 0] remaining members to acquire global barrier 2023-11-19 10:54:49,627 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-19 10:54:49,627 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:49,628 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:49,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:49,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:49,628 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-19 10:54:49,628 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-19 10:54:49,628 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:54:49,628 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:49,628 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:54:49,630 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-19 10:54:49,630 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:54:49,630 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:49,630 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-19 10:54:49,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:49,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:49,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:49,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:49,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:49,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:49,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:49,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:49,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:49,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:49,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:54:49,632 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-19 10:54:49,632 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-19 10:54:49,632 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:54:49,632 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:54:49,632 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:49,632 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:54:49,636 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:49,636 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:49,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:49,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:54:49,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:54:49,636 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:54:49,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:49,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:49,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:54:49,637 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:49,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:54:49,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:54:49,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:49,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:49,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:54:49,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:49,638 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:49,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:49,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:54:49,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:49,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:49,640 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:54:49,640 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:49,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:54:49,640 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:54:49,640 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:54:49,640 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-19 10:54:49,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:54:49,640 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-19 10:54:49,641 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:54:49,640 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:49,641 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:49,641 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:49,641 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:49,641 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:49,641 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:49,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:54:49,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:54:49,641 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-19 10:54:49,641 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:54:49,741 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:54:49,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:54:49,743 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=33457] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:49,744 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] procedure2.ProcedureExecutor(1028): Stored pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-19 10:54:49,745 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-19 10:54:49,745 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-19 10:54:49,745 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=58, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700391889745 2023-11-19 10:54:49,746 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-19 10:54:49,747 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-11-19 10:54:49,747 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-19 10:54:49,748 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] zookeeper.ReadOnlyZKClient(139): Connect 0x31b344ee to 127.0.0.1:60497 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-19 10:54:49,752 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@52b58608, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-19 10:54:49,752 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-19 10:54:50,584 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601035274c3f39ec240e397624299e7300e09 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601035274c3f39ec240e397624299e7300e09 2023-11-19 10:54:50,585 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-19 10:54:50,597 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-19 10:54:50,598 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45724, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-19 10:54:50,604 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-19 10:54:50,605 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37150, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-19 10:54:50,612 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/9d8915b4d5c24de78420aa27efb40c5b first=Optional[r3] last=Optional[r6] 2023-11-19 10:54:50,613 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe., hostname=jenkins-hbase4.apache.org,46035,1700391201579, seqNum=2 for row with hfile group [{family1,hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/9d8915b4d5c24de78420aa27efb40c5b}] 2023-11-19 10:54:50,616 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(763): Validating hfile at hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/9d8915b4d5c24de78420aa27efb40c5b for inclusion in 6bc32bc9f7c3f1d5eebc37dd041af4fe/family1 2023-11-19 10:54:50,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-19 10:54:50,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(777): Region bounds: first= last= 2023-11-19 10:54:50,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegion(2446): Flush status journal for 6bc32bc9f7c3f1d5eebc37dd041af4fe: 2023-11-19 10:54:50,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/9d8915b4d5c24de78420aa27efb40c5b to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__e2d1bv70u1o6hhuquv32ora9qiped28650nl3qo4r56923eb1utkuj91nm6mo65g/family1/9d8915b4d5c24de78420aa27efb40c5b 2023-11-19 10:54:50,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__e2d1bv70u1o6hhuquv32ora9qiped28650nl3qo4r56923eb1utkuj91nm6mo65g/family1/9d8915b4d5c24de78420aa27efb40c5b as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/8e293cee6a984ac59d75e6a67c6a2a04_SeqId_44_ 2023-11-19 10:54:50,621 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(849): Loaded HFile hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__e2d1bv70u1o6hhuquv32ora9qiped28650nl3qo4r56923eb1utkuj91nm6mo65g/family1/9d8915b4d5c24de78420aa27efb40c5b into 6bc32bc9f7c3f1d5eebc37dd041af4fe/family1 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/8e293cee6a984ac59d75e6a67c6a2a04_SeqId_44_ - updating store file list. 2023-11-19 10:54:50,624 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(882): Loaded HFile hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/8e293cee6a984ac59d75e6a67c6a2a04_SeqId_44_ into 6bc32bc9f7c3f1d5eebc37dd041af4fe/family1 2023-11-19 10:54:50,624 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(855): Successfully loaded hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__e2d1bv70u1o6hhuquv32ora9qiped28650nl3qo4r56923eb1utkuj91nm6mo65g/family1/9d8915b4d5c24de78420aa27efb40c5b into 6bc32bc9f7c3f1d5eebc37dd041af4fe/family1 (new location: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/8e293cee6a984ac59d75e6a67c6a2a04_SeqId_44_) 2023-11-19 10:54:50,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__e2d1bv70u1o6hhuquv32ora9qiped28650nl3qo4r56923eb1utkuj91nm6mo65g/family1/9d8915b4d5c24de78420aa27efb40c5b 2023-11-19 10:54:50,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-19 10:54:50,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51552 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-19 10:54:50,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(1912): 6bc32bc9f7c3f1d5eebc37dd041af4fe/family1 is initiating minor compaction 2023-11-19 10:54:50,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@47d5441; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-19 10:54:50,627 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 6bc32bc9f7c3f1d5eebc37dd041af4fe/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe. 2023-11-19 10:54:50,628 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/70fe3064519044709993547eb142c8cc, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/c192c128ecc146939bf3fdd6a7d27fef, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/6f594e9adf174f0a9b3dc316940736e3, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/386605f521b045ef87987c66e469e078, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/0cafe6b162a9409ca6dabdbdd552c245, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/7212d3b889bf4c14ad410798a9c6e9df, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/f54f44a8b399400e8c24b70809ffcb50, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/e1143a99ee294acc85a1cb23d284e989, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/8cdf089163b74fa5a07f5ceea27b3a6c, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/8e293cee6a984ac59d75e6a67c6a2a04_SeqId_44_] into tmpdir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/.tmp, totalSize=50.3 K 2023-11-19 10:54:50,628 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting 70fe3064519044709993547eb142c8cc, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-19 10:54:50,628 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting c192c128ecc146939bf3fdd6a7d27fef, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-19 10:54:50,628 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting 6f594e9adf174f0a9b3dc316940736e3, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-19 10:54:50,628 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting 386605f521b045ef87987c66e469e078, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-19 10:54:50,628 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting 0cafe6b162a9409ca6dabdbdd552c245, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-19 10:54:50,628 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting 7212d3b889bf4c14ad410798a9c6e9df, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-19 10:54:50,628 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting f54f44a8b399400e8c24b70809ffcb50, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-19 10:54:50,628 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting e1143a99ee294acc85a1cb23d284e989, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-19 10:54:50,628 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting 8cdf089163b74fa5a07f5ceea27b3a6c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-19 10:54:50,628 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting 8e293cee6a984ac59d75e6a67c6a2a04_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-19 10:54:50,629 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-19 10:54:50,630 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:54:50,631 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015122849f26676a2114e438596394e9ed9073f to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015122849f26676a2114e438596394e9ed9073f 2023-11-19 10:54:50,632 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231b5d1b51e86ef48059c7ec74f05564cab to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231b5d1b51e86ef48059c7ec74f05564cab 2023-11-19 10:54:50,633 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601011ed00eab45864415b7a880dcfba8f1be to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601011ed00eab45864415b7a880dcfba8f1be 2023-11-19 10:54:50,634 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010394e17d0316774ff0af0c1d9677fc3173 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010394e17d0316774ff0af0c1d9677fc3173 2023-11-19 10:54:50,634 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 4 expired mob files are deleted 2023-11-19 10:54:50,634 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-19 10:54:50,634 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-19 10:54:50,635 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-19 10:54:50,635 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-19 10:54:50,635 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-19 10:54:50,635 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-19 10:54:50,635 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-19 10:54:50,635 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-19 10:54:50,635 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-19 10:54:50,660 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] throttle.PressureAwareThroughputController(145): 6bc32bc9f7c3f1d5eebc37dd041af4fe#family1#compaction#73 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-19 10:54:51,085 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205d4ed08479f6a4b4f8b878e3a92fddfac to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205d4ed08479f6a4b4f8b878e3a92fddfac 2023-11-19 10:54:51,085 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-19 10:54:51,113 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/ce25fb35a66f4b35aae9b32016454ad4 first=Optional[r00] last=Optional[r2] 2023-11-19 10:54:51,113 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe., hostname=jenkins-hbase4.apache.org,46035,1700391201579, seqNum=2 for row with hfile group [{family1,hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/ce25fb35a66f4b35aae9b32016454ad4}] 2023-11-19 10:54:51,115 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(763): Validating hfile at hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/ce25fb35a66f4b35aae9b32016454ad4 for inclusion in 6bc32bc9f7c3f1d5eebc37dd041af4fe/family1 2023-11-19 10:54:51,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-19 10:54:51,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(777): Region bounds: first= last= 2023-11-19 10:54:51,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegion(2446): Flush status journal for 6bc32bc9f7c3f1d5eebc37dd041af4fe: 2023-11-19 10:54:51,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/ce25fb35a66f4b35aae9b32016454ad4 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__gsenhfhs491v472j535ud6tm8ka2sh0kjvm5ufpmg7daai0rsol64l0rkaml5k69/family1/ce25fb35a66f4b35aae9b32016454ad4 2023-11-19 10:54:51,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__gsenhfhs491v472j535ud6tm8ka2sh0kjvm5ufpmg7daai0rsol64l0rkaml5k69/family1/ce25fb35a66f4b35aae9b32016454ad4 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/8a8423d1fdd245b681bf14b2f748dd53_SeqId_46_ 2023-11-19 10:54:51,121 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(849): Loaded HFile hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__gsenhfhs491v472j535ud6tm8ka2sh0kjvm5ufpmg7daai0rsol64l0rkaml5k69/family1/ce25fb35a66f4b35aae9b32016454ad4 into 6bc32bc9f7c3f1d5eebc37dd041af4fe/family1 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/8a8423d1fdd245b681bf14b2f748dd53_SeqId_46_ - updating store file list. 2023-11-19 10:54:51,124 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(882): Loaded HFile hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/8a8423d1fdd245b681bf14b2f748dd53_SeqId_46_ into 6bc32bc9f7c3f1d5eebc37dd041af4fe/family1 2023-11-19 10:54:51,124 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(855): Successfully loaded hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__gsenhfhs491v472j535ud6tm8ka2sh0kjvm5ufpmg7daai0rsol64l0rkaml5k69/family1/ce25fb35a66f4b35aae9b32016454ad4 into 6bc32bc9f7c3f1d5eebc37dd041af4fe/family1 (new location: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/8a8423d1fdd245b681bf14b2f748dd53_SeqId_46_) 2023-11-19 10:54:51,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__gsenhfhs491v472j535ud6tm8ka2sh0kjvm5ufpmg7daai0rsol64l0rkaml5k69/family1/ce25fb35a66f4b35aae9b32016454ad4 2023-11-19 10:54:51,126 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-19 10:54:51,127 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:54:51,128 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130a0ddc38e49b8488a843546b5f14e4339 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130a0ddc38e49b8488a843546b5f14e4339 2023-11-19 10:54:51,129 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120148090472b3134a5cabfd4e142b4a6932 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120148090472b3134a5cabfd4e142b4a6932 2023-11-19 10:54:51,130 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120590574ddbc9b14c02b9209be55bd9e76e to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120590574ddbc9b14c02b9209be55bd9e76e 2023-11-19 10:54:51,130 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 3 expired mob files are deleted 2023-11-19 10:54:51,130 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-19 10:54:51,131 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-19 10:54:51,131 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-19 10:54:51,131 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-19 10:54:51,132 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=58, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-19 10:54:51,133 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=58, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 1.3890 sec 2023-11-19 10:54:51,212 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-19 10:54:51,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure2.ProcedureExecutor(1028): Stored pid=59, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:51,476 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/.tmp/family1/f11d703b03e446ad8181e00f26a1b210 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/f11d703b03e446ad8181e00f26a1b210 2023-11-19 10:54:51,480 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 6bc32bc9f7c3f1d5eebc37dd041af4fe/family1 of 6bc32bc9f7c3f1d5eebc37dd041af4fe into f11d703b03e446ad8181e00f26a1b210(size=6.8 K), total size for store is 388.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-19 10:54:51,480 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 6bc32bc9f7c3f1d5eebc37dd041af4fe: 2023-11-19 10:54:51,481 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe., storeName=family1, fileCount=10, fileSize=50.3 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1700391290627; duration=0sec 2023-11-19 10:54:51,481 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-19 10:54:51,537 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/70fe3064519044709993547eb142c8cc, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/c192c128ecc146939bf3fdd6a7d27fef, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/6f594e9adf174f0a9b3dc316940736e3, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/386605f521b045ef87987c66e469e078, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/0cafe6b162a9409ca6dabdbdd552c245, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/7212d3b889bf4c14ad410798a9c6e9df, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/f54f44a8b399400e8c24b70809ffcb50, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/e1143a99ee294acc85a1cb23d284e989, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/8cdf089163b74fa5a07f5ceea27b3a6c, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/8e293cee6a984ac59d75e6a67c6a2a04_SeqId_44_] to archive 2023-11-19 10:54:51,538 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:54:51,540 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/70fe3064519044709993547eb142c8cc to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/70fe3064519044709993547eb142c8cc 2023-11-19 10:54:51,541 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/c192c128ecc146939bf3fdd6a7d27fef to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/c192c128ecc146939bf3fdd6a7d27fef 2023-11-19 10:54:51,542 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/6f594e9adf174f0a9b3dc316940736e3 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/6f594e9adf174f0a9b3dc316940736e3 2023-11-19 10:54:51,543 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/386605f521b045ef87987c66e469e078 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/386605f521b045ef87987c66e469e078 2023-11-19 10:54:51,544 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/0cafe6b162a9409ca6dabdbdd552c245 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/0cafe6b162a9409ca6dabdbdd552c245 2023-11-19 10:54:51,545 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/7212d3b889bf4c14ad410798a9c6e9df to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/7212d3b889bf4c14ad410798a9c6e9df 2023-11-19 10:54:51,545 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/f54f44a8b399400e8c24b70809ffcb50 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/f54f44a8b399400e8c24b70809ffcb50 2023-11-19 10:54:51,546 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/e1143a99ee294acc85a1cb23d284e989 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/e1143a99ee294acc85a1cb23d284e989 2023-11-19 10:54:51,547 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/8cdf089163b74fa5a07f5ceea27b3a6c to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/8cdf089163b74fa5a07f5ceea27b3a6c 2023-11-19 10:54:51,548 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/8e293cee6a984ac59d75e6a67c6a2a04_SeqId_44_ to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/8e293cee6a984ac59d75e6a67c6a2a04_SeqId_44_ 2023-11-19 10:54:51,621 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-11-19 10:54:51,622 DEBUG [PEWorker-4] util.FSTableDescriptors(519): Deleted hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-11-19 10:54:51,622 INFO [PEWorker-4] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-11-19 10:54:51,624 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-11-19 10:54:51,626 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=6bc32bc9f7c3f1d5eebc37dd041af4fe, REOPEN/MOVE}] 2023-11-19 10:54:51,627 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=6bc32bc9f7c3f1d5eebc37dd041af4fe, REOPEN/MOVE 2023-11-19 10:54:51,627 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=6bc32bc9f7c3f1d5eebc37dd041af4fe, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:51,627 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700391291627"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700391291627"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700391291627"}]},"ts":"1700391291627"} 2023-11-19 10:54:51,628 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=62, ppid=61, state=RUNNABLE; CloseRegionProcedure 6bc32bc9f7c3f1d5eebc37dd041af4fe, server=jenkins-hbase4.apache.org,46035,1700391201579}] 2023-11-19 10:54:51,780 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:51,780 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6bc32bc9f7c3f1d5eebc37dd041af4fe 2023-11-19 10:54:51,780 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6bc32bc9f7c3f1d5eebc37dd041af4fe, disabling compactions & flushes 2023-11-19 10:54:51,780 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe. 2023-11-19 10:54:51,780 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe. 2023-11-19 10:54:51,780 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe. after waiting 0 ms 2023-11-19 10:54:51,780 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe. 2023-11-19 10:54:51,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/recovered.edits/49.seqid, newMaxSeqId=49, maxSeqId=1 2023-11-19 10:54:51,787 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe. 2023-11-19 10:54:51,787 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6bc32bc9f7c3f1d5eebc37dd041af4fe: 2023-11-19 10:54:51,787 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 6bc32bc9f7c3f1d5eebc37dd041af4fe to self. 2023-11-19 10:54:51,788 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6bc32bc9f7c3f1d5eebc37dd041af4fe 2023-11-19 10:54:51,788 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=6bc32bc9f7c3f1d5eebc37dd041af4fe, regionState=CLOSED 2023-11-19 10:54:51,788 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700391291788"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700391291788"}]},"ts":"1700391291788"} 2023-11-19 10:54:51,790 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=62, resume processing ppid=61 2023-11-19 10:54:51,791 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=62, ppid=61, state=SUCCESS; CloseRegionProcedure 6bc32bc9f7c3f1d5eebc37dd041af4fe, server=jenkins-hbase4.apache.org,46035,1700391201579 in 161 msec 2023-11-19 10:54:51,791 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=6bc32bc9f7c3f1d5eebc37dd041af4fe, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,46035,1700391201579; forceNewPlan=false, retain=true 2023-11-19 10:54:51,941 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=6bc32bc9f7c3f1d5eebc37dd041af4fe, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:51,942 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700391291941"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700391291941"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700391291941"}]},"ts":"1700391291941"} 2023-11-19 10:54:51,943 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=63, ppid=61, state=RUNNABLE; OpenRegionProcedure 6bc32bc9f7c3f1d5eebc37dd041af4fe, server=jenkins-hbase4.apache.org,46035,1700391201579}] 2023-11-19 10:54:52,094 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:52,097 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe. 2023-11-19 10:54:52,097 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6bc32bc9f7c3f1d5eebc37dd041af4fe, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe.', STARTKEY => '', ENDKEY => ''} 2023-11-19 10:54:52,097 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 6bc32bc9f7c3f1d5eebc37dd041af4fe 2023-11-19 10:54:52,097 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-19 10:54:52,097 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6bc32bc9f7c3f1d5eebc37dd041af4fe 2023-11-19 10:54:52,097 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6bc32bc9f7c3f1d5eebc37dd041af4fe 2023-11-19 10:54:52,098 INFO [StoreOpener-6bc32bc9f7c3f1d5eebc37dd041af4fe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 6bc32bc9f7c3f1d5eebc37dd041af4fe 2023-11-19 10:54:52,099 DEBUG [StoreOpener-6bc32bc9f7c3f1d5eebc37dd041af4fe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1 2023-11-19 10:54:52,099 DEBUG [StoreOpener-6bc32bc9f7c3f1d5eebc37dd041af4fe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1 2023-11-19 10:54:52,100 INFO [StoreOpener-6bc32bc9f7c3f1d5eebc37dd041af4fe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6bc32bc9f7c3f1d5eebc37dd041af4fe columnFamilyName family1 2023-11-19 10:54:52,104 DEBUG [StoreOpener-6bc32bc9f7c3f1d5eebc37dd041af4fe-1] regionserver.HStore(539): loaded hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/8a8423d1fdd245b681bf14b2f748dd53_SeqId_46_ 2023-11-19 10:54:52,109 DEBUG [StoreOpener-6bc32bc9f7c3f1d5eebc37dd041af4fe-1] regionserver.HStore(539): loaded hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/acf8b3b3ebde4c66b3dc0e4e007454d4 2023-11-19 10:54:52,112 DEBUG [StoreOpener-6bc32bc9f7c3f1d5eebc37dd041af4fe-1] regionserver.HStore(539): loaded hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/f11d703b03e446ad8181e00f26a1b210 2023-11-19 10:54:52,112 INFO [StoreOpener-6bc32bc9f7c3f1d5eebc37dd041af4fe-1] regionserver.HStore(310): Store=6bc32bc9f7c3f1d5eebc37dd041af4fe/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-19 10:54:52,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe 2023-11-19 10:54:52,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe 2023-11-19 10:54:52,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6bc32bc9f7c3f1d5eebc37dd041af4fe 2023-11-19 10:54:52,117 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6bc32bc9f7c3f1d5eebc37dd041af4fe; next sequenceid=50; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72721180, jitterRate=0.0836300253868103}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-19 10:54:52,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6bc32bc9f7c3f1d5eebc37dd041af4fe: 2023-11-19 10:54:52,117 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe., pid=63, masterSystemTime=1700391292094 2023-11-19 10:54:52,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-19 10:54:52,118 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-19 10:54:52,119 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 397422 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-19 10:54:52,119 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HStore(1912): 6bc32bc9f7c3f1d5eebc37dd041af4fe/family1 is initiating minor compaction (all files) 2023-11-19 10:54:52,119 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 6bc32bc9f7c3f1d5eebc37dd041af4fe/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe. 2023-11-19 10:54:52,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe. 2023-11-19 10:54:52,119 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/acf8b3b3ebde4c66b3dc0e4e007454d4, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/f11d703b03e446ad8181e00f26a1b210, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/8a8423d1fdd245b681bf14b2f748dd53_SeqId_46_] into tmpdir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/.tmp, totalSize=388.1 K 2023-11-19 10:54:52,120 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe. 2023-11-19 10:54:52,120 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=6bc32bc9f7c3f1d5eebc37dd041af4fe, regionState=OPEN, openSeqNum=50, regionLocation=jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:52,120 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting acf8b3b3ebde4c66b3dc0e4e007454d4, keycount=1000, bloomtype=ROW, size=190.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878825094 2023-11-19 10:54:52,120 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700391292120"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700391292120"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700391292120"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700391292120"}]},"ts":"1700391292120"} 2023-11-19 10:54:52,120 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting f11d703b03e446ad8181e00f26a1b210, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621225094 2023-11-19 10:54:52,121 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting 8a8423d1fdd245b681bf14b2f748dd53_SeqId_46_, keycount=1002, bloomtype=ROW, size=190.9 K, encoding=NONE, compression=NONE, seqNum=47, earliestPutTs=1448878825094 2023-11-19 10:54:52,122 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=63, resume processing ppid=61 2023-11-19 10:54:52,123 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=63, ppid=61, state=SUCCESS; OpenRegionProcedure 6bc32bc9f7c3f1d5eebc37dd041af4fe, server=jenkins-hbase4.apache.org,46035,1700391201579 in 178 msec 2023-11-19 10:54:52,124 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=60 2023-11-19 10:54:52,124 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=60, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=6bc32bc9f7c3f1d5eebc37dd041af4fe, REOPEN/MOVE in 496 msec 2023-11-19 10:54:52,126 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=59 2023-11-19 10:54:52,126 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=59, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 500 msec 2023-11-19 10:54:52,127 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=59, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 914 msec 2023-11-19 10:54:52,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=59 2023-11-19 10:54:52,130 INFO [Listener at localhost/42675] compactions.TestMobCompactor(278): alter status finished 2023-11-19 10:54:52,131 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=33457] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:52,133 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] throttle.PressureAwareThroughputController(145): 6bc32bc9f7c3f1d5eebc37dd041af4fe#family1#compaction#74 average throughput is 25.66 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-19 10:54:52,136 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-19 10:54:52,139 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-19 10:54:52,139 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-19 10:54:52,139 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700391892139 2023-11-19 10:54:52,140 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-19 10:54:52,140 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-11-19 10:54:52,140 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-19 10:54:52,142 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] zookeeper.ReadOnlyZKClient(139): Connect 0x1ea52177 to 127.0.0.1:60497 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-19 10:54:52,151 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@59a6a766, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-19 10:54:52,151 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-19 10:54:52,151 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-19 10:54:52,151 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-19 10:54:52,151 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-19 10:54:52,151 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-19 10:54:52,972 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511285e8ede470ea348a88ed4b52505d03eb4 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511285e8ede470ea348a88ed4b52505d03eb4 2023-11-19 10:54:52,973 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-19 10:54:52,985 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-19 10:54:52,986 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46064, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-19 10:54:52,992 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-19 10:54:52,993 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48622, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-19 10:54:53,000 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/2365a63b73344245ac1a1ec8fa78beca first=Optional[r05] last=Optional[r8] 2023-11-19 10:54:53,001 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe., hostname=jenkins-hbase4.apache.org,46035,1700391201579, seqNum=50 for row with hfile group [{family1,hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/2365a63b73344245ac1a1ec8fa78beca}] 2023-11-19 10:54:53,005 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(763): Validating hfile at hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/2365a63b73344245ac1a1ec8fa78beca for inclusion in 6bc32bc9f7c3f1d5eebc37dd041af4fe/family1 2023-11-19 10:54:53,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-11-19 10:54:53,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(777): Region bounds: first= last= 2023-11-19 10:54:53,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegion(2446): Flush status journal for 6bc32bc9f7c3f1d5eebc37dd041af4fe: 2023-11-19 10:54:53,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/2365a63b73344245ac1a1ec8fa78beca to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__2qb58u9fpcajuomcc984d1gnu0i1kool52hjpk1a63kl74le9uotnd6freh2f2p2/family1/2365a63b73344245ac1a1ec8fa78beca 2023-11-19 10:54:53,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__2qb58u9fpcajuomcc984d1gnu0i1kool52hjpk1a63kl74le9uotnd6freh2f2p2/family1/2365a63b73344245ac1a1ec8fa78beca as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/3a067205322840c8b90d0416f16bbb32_SeqId_52_ 2023-11-19 10:54:53,010 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(849): Loaded HFile hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__2qb58u9fpcajuomcc984d1gnu0i1kool52hjpk1a63kl74le9uotnd6freh2f2p2/family1/2365a63b73344245ac1a1ec8fa78beca into 6bc32bc9f7c3f1d5eebc37dd041af4fe/family1 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/3a067205322840c8b90d0416f16bbb32_SeqId_52_ - updating store file list. 2023-11-19 10:54:53,013 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(882): Loaded HFile hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/3a067205322840c8b90d0416f16bbb32_SeqId_52_ into 6bc32bc9f7c3f1d5eebc37dd041af4fe/family1 2023-11-19 10:54:53,013 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(855): Successfully loaded hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__2qb58u9fpcajuomcc984d1gnu0i1kool52hjpk1a63kl74le9uotnd6freh2f2p2/family1/2365a63b73344245ac1a1ec8fa78beca into 6bc32bc9f7c3f1d5eebc37dd041af4fe/family1 (new location: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/3a067205322840c8b90d0416f16bbb32_SeqId_52_) 2023-11-19 10:54:53,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__2qb58u9fpcajuomcc984d1gnu0i1kool52hjpk1a63kl74le9uotnd6freh2f2p2/family1/2365a63b73344245ac1a1ec8fa78beca 2023-11-19 10:54:53,015 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-19 10:54:53,016 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:54:53,018 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511202d9a2c7db2b04301b87e2a2be1f0a26f to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511202d9a2c7db2b04301b87e2a2be1f0a26f 2023-11-19 10:54:53,019 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112810621b6741fa437488342faed699b161 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112810621b6741fa437488342faed699b161 2023-11-19 10:54:53,019 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2 expired mob files are deleted 2023-11-19 10:54:53,019 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-19 10:54:53,019 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-19 10:54:53,019 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-19 10:54:53,019 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-19 10:54:53,019 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-19 10:54:53,019 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-19 10:54:53,020 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-19 10:54:53,021 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 888 msec 2023-11-19 10:54:53,075 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} 2023-11-19 10:54:53,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:53,353 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/.tmp/family1/4c5099e8c7b54b03aaafaf2152f5d1ff as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/4c5099e8c7b54b03aaafaf2152f5d1ff 2023-11-19 10:54:53,357 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 6bc32bc9f7c3f1d5eebc37dd041af4fe/family1 of 6bc32bc9f7c3f1d5eebc37dd041af4fe into 4c5099e8c7b54b03aaafaf2152f5d1ff(size=192.0 K), total size for store is 197.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-19 10:54:53,358 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 6bc32bc9f7c3f1d5eebc37dd041af4fe: 2023-11-19 10:54:53,358 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe., storeName=6bc32bc9f7c3f1d5eebc37dd041af4fe/family1, priority=13, startTime=1700391292117; duration=1sec 2023-11-19 10:54:53,358 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-19 10:54:53,428 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/acf8b3b3ebde4c66b3dc0e4e007454d4, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/f11d703b03e446ad8181e00f26a1b210, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/8a8423d1fdd245b681bf14b2f748dd53_SeqId_46_] to archive 2023-11-19 10:54:53,429 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:54:53,431 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/acf8b3b3ebde4c66b3dc0e4e007454d4 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/acf8b3b3ebde4c66b3dc0e4e007454d4 2023-11-19 10:54:53,432 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/f11d703b03e446ad8181e00f26a1b210 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/f11d703b03e446ad8181e00f26a1b210 2023-11-19 10:54:53,433 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/8a8423d1fdd245b681bf14b2f748dd53_SeqId_46_ to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/8a8423d1fdd245b681bf14b2f748dd53_SeqId_46_ 2023-11-19 10:54:53,483 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-11-19 10:54:53,484 DEBUG [PEWorker-2] util.FSTableDescriptors(519): Deleted hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-11-19 10:54:53,484 INFO [PEWorker-2] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-11-19 10:54:53,486 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=66, ppid=65, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-11-19 10:54:53,487 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=6bc32bc9f7c3f1d5eebc37dd041af4fe, REOPEN/MOVE}] 2023-11-19 10:54:53,488 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=6bc32bc9f7c3f1d5eebc37dd041af4fe, REOPEN/MOVE 2023-11-19 10:54:53,488 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=6bc32bc9f7c3f1d5eebc37dd041af4fe, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:53,488 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700391293488"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700391293488"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700391293488"}]},"ts":"1700391293488"} 2023-11-19 10:54:53,489 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=68, ppid=67, state=RUNNABLE; CloseRegionProcedure 6bc32bc9f7c3f1d5eebc37dd041af4fe, server=jenkins-hbase4.apache.org,46035,1700391201579}] 2023-11-19 10:54:53,640 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:53,641 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6bc32bc9f7c3f1d5eebc37dd041af4fe 2023-11-19 10:54:53,641 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6bc32bc9f7c3f1d5eebc37dd041af4fe, disabling compactions & flushes 2023-11-19 10:54:53,641 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe. 2023-11-19 10:54:53,641 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe. 2023-11-19 10:54:53,641 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe. after waiting 0 ms 2023-11-19 10:54:53,641 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe. 2023-11-19 10:54:53,647 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=49 2023-11-19 10:54:53,648 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe. 2023-11-19 10:54:53,648 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6bc32bc9f7c3f1d5eebc37dd041af4fe: 2023-11-19 10:54:53,648 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 6bc32bc9f7c3f1d5eebc37dd041af4fe to self. 2023-11-19 10:54:53,649 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6bc32bc9f7c3f1d5eebc37dd041af4fe 2023-11-19 10:54:53,649 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=6bc32bc9f7c3f1d5eebc37dd041af4fe, regionState=CLOSED 2023-11-19 10:54:53,649 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700391293649"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700391293649"}]},"ts":"1700391293649"} 2023-11-19 10:54:53,651 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=68, resume processing ppid=67 2023-11-19 10:54:53,651 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=67, state=SUCCESS; CloseRegionProcedure 6bc32bc9f7c3f1d5eebc37dd041af4fe, server=jenkins-hbase4.apache.org,46035,1700391201579 in 161 msec 2023-11-19 10:54:53,652 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=6bc32bc9f7c3f1d5eebc37dd041af4fe, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,46035,1700391201579; forceNewPlan=false, retain=true 2023-11-19 10:54:53,802 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=6bc32bc9f7c3f1d5eebc37dd041af4fe, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:53,802 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700391293802"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700391293802"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700391293802"}]},"ts":"1700391293802"} 2023-11-19 10:54:53,804 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 6bc32bc9f7c3f1d5eebc37dd041af4fe, server=jenkins-hbase4.apache.org,46035,1700391201579}] 2023-11-19 10:54:53,955 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:53,958 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe. 2023-11-19 10:54:53,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6bc32bc9f7c3f1d5eebc37dd041af4fe, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe.', STARTKEY => '', ENDKEY => ''} 2023-11-19 10:54:53,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 6bc32bc9f7c3f1d5eebc37dd041af4fe 2023-11-19 10:54:53,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-19 10:54:53,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6bc32bc9f7c3f1d5eebc37dd041af4fe 2023-11-19 10:54:53,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6bc32bc9f7c3f1d5eebc37dd041af4fe 2023-11-19 10:54:53,959 INFO [StoreOpener-6bc32bc9f7c3f1d5eebc37dd041af4fe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 6bc32bc9f7c3f1d5eebc37dd041af4fe 2023-11-19 10:54:53,960 DEBUG [StoreOpener-6bc32bc9f7c3f1d5eebc37dd041af4fe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1 2023-11-19 10:54:53,960 DEBUG [StoreOpener-6bc32bc9f7c3f1d5eebc37dd041af4fe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1 2023-11-19 10:54:53,960 INFO [StoreOpener-6bc32bc9f7c3f1d5eebc37dd041af4fe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6bc32bc9f7c3f1d5eebc37dd041af4fe columnFamilyName family1 2023-11-19 10:54:53,965 DEBUG [StoreOpener-6bc32bc9f7c3f1d5eebc37dd041af4fe-1] regionserver.HStore(539): loaded hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/3a067205322840c8b90d0416f16bbb32_SeqId_52_ 2023-11-19 10:54:53,968 DEBUG [StoreOpener-6bc32bc9f7c3f1d5eebc37dd041af4fe-1] regionserver.HStore(539): loaded hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/family1/4c5099e8c7b54b03aaafaf2152f5d1ff 2023-11-19 10:54:53,968 INFO [StoreOpener-6bc32bc9f7c3f1d5eebc37dd041af4fe-1] regionserver.HStore(310): Store=6bc32bc9f7c3f1d5eebc37dd041af4fe/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-19 10:54:53,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe 2023-11-19 10:54:53,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe 2023-11-19 10:54:53,972 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6bc32bc9f7c3f1d5eebc37dd041af4fe 2023-11-19 10:54:53,973 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6bc32bc9f7c3f1d5eebc37dd041af4fe; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72107390, jitterRate=0.07448384165763855}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-19 10:54:53,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6bc32bc9f7c3f1d5eebc37dd041af4fe: 2023-11-19 10:54:53,974 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe., pid=69, masterSystemTime=1700391293955 2023-11-19 10:54:53,975 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe. 2023-11-19 10:54:53,975 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe. 2023-11-19 10:54:53,975 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=6bc32bc9f7c3f1d5eebc37dd041af4fe, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:53,975 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700391293975"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700391293975"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700391293975"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700391293975"}]},"ts":"1700391293975"} 2023-11-19 10:54:53,978 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=67 2023-11-19 10:54:53,978 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 6bc32bc9f7c3f1d5eebc37dd041af4fe, server=jenkins-hbase4.apache.org,46035,1700391201579 in 172 msec 2023-11-19 10:54:53,979 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=67, resume processing ppid=66 2023-11-19 10:54:53,979 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=6bc32bc9f7c3f1d5eebc37dd041af4fe, REOPEN/MOVE in 491 msec 2023-11-19 10:54:53,981 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=66, resume processing ppid=65 2023-11-19 10:54:53,981 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=66, ppid=65, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 495 msec 2023-11-19 10:54:53,982 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 906 msec 2023-11-19 10:54:53,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=65 2023-11-19 10:54:53,984 INFO [Listener at localhost/42675] compactions.TestMobCompactor(278): alter status finished 2023-11-19 10:54:53,985 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=33457] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-19 10:54:53,986 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] procedure2.ProcedureExecutor(1028): Stored pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-19 10:54:53,987 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-19 10:54:53,987 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-19 10:54:53,987 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=70, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700391893987 2023-11-19 10:54:53,988 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-19 10:54:53,988 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-11-19 10:54:53,988 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-19 10:54:53,990 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] zookeeper.ReadOnlyZKClient(139): Connect 0x67f48a27 to 127.0.0.1:60497 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-19 10:54:53,994 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@eab2191, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-19 10:54:53,994 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-19 10:54:53,994 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-19 10:54:53,994 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-19 10:54:53,995 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-19 10:54:53,995 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-19 10:54:53,995 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-19 10:54:53,995 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-19 10:54:53,995 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-19 10:54:53,995 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-19 10:54:53,995 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-19 10:54:53,996 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=70, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-19 10:54:53,997 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=70, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 11 msec 2023-11-19 10:54:54,052 INFO [Listener at localhost/42675] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=243 (was 250), OpenFileDescriptor=641 (was 664), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=154 (was 136) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 171), AvailableMemoryMB=15410 (was 15449) 2023-11-19 10:54:54,062 INFO [Listener at localhost/42675] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=243, OpenFileDescriptor=641, MaxFileDescriptor=60000, SystemLoadAverage=154, ProcessCount=171, AvailableMemoryMB=15409 2023-11-19 10:54:54,066 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-19 10:54:54,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testGetAfterCompaction 2023-11-19 10:54:54,068 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-11-19 10:54:54,068 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testGetAfterCompaction" procId is: 71 2023-11-19 10:54:54,068 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-19 10:54:54,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-19 10:54:54,069 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe 2023-11-19 10:54:54,070 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe empty. 2023-11-19 10:54:54,070 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe 2023-11-19 10:54:54,070 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-11-19 10:54:54,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-19 10:54:54,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-19 10:54:54,479 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/default/testGetAfterCompaction/.tabledesc/.tableinfo.0000000001 2023-11-19 10:54:54,480 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => 726889889edf2231a960c7164a1e7ffe, NAME => 'testGetAfterCompaction,,1700391294065.726889889edf2231a960c7164a1e7ffe.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp 2023-11-19 10:54:54,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-19 10:54:54,886 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1700391294065.726889889edf2231a960c7164a1e7ffe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-19 10:54:54,886 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1604): Closing 726889889edf2231a960c7164a1e7ffe, disabling compactions & flushes 2023-11-19 10:54:54,886 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1700391294065.726889889edf2231a960c7164a1e7ffe. 2023-11-19 10:54:54,886 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1700391294065.726889889edf2231a960c7164a1e7ffe. 2023-11-19 10:54:54,886 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1700391294065.726889889edf2231a960c7164a1e7ffe. after waiting 0 ms 2023-11-19 10:54:54,886 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1700391294065.726889889edf2231a960c7164a1e7ffe. 2023-11-19 10:54:54,886 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1700391294065.726889889edf2231a960c7164a1e7ffe. 2023-11-19 10:54:54,886 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1558): Region close journal for 726889889edf2231a960c7164a1e7ffe: 2023-11-19 10:54:54,888 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-11-19 10:54:54,889 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1700391294065.726889889edf2231a960c7164a1e7ffe.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1700391294889"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700391294889"}]},"ts":"1700391294889"} 2023-11-19 10:54:54,890 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-19 10:54:54,891 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-19 10:54:54,891 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700391294891"}]},"ts":"1700391294891"} 2023-11-19 10:54:54,892 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLING in hbase:meta 2023-11-19 10:54:54,894 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=726889889edf2231a960c7164a1e7ffe, ASSIGN}] 2023-11-19 10:54:54,895 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=726889889edf2231a960c7164a1e7ffe, ASSIGN 2023-11-19 10:54:54,896 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testGetAfterCompaction, region=726889889edf2231a960c7164a1e7ffe, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46035,1700391201579; forceNewPlan=false, retain=false 2023-11-19 10:54:55,047 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=726889889edf2231a960c7164a1e7ffe, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:55,047 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1700391294065.726889889edf2231a960c7164a1e7ffe.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1700391295047"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700391295047"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700391295047"}]},"ts":"1700391295047"} 2023-11-19 10:54:55,048 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=73, ppid=72, state=RUNNABLE; OpenRegionProcedure 726889889edf2231a960c7164a1e7ffe, server=jenkins-hbase4.apache.org,46035,1700391201579}] 2023-11-19 10:54:55,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-19 10:54:55,200 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:55,202 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testGetAfterCompaction,,1700391294065.726889889edf2231a960c7164a1e7ffe. 2023-11-19 10:54:55,202 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 726889889edf2231a960c7164a1e7ffe, NAME => 'testGetAfterCompaction,,1700391294065.726889889edf2231a960c7164a1e7ffe.', STARTKEY => '', ENDKEY => ''} 2023-11-19 10:54:55,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro with path null and priority 1073741823 2023-11-19 10:54:55,204 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro from HTD of testGetAfterCompaction successfully. 2023-11-19 10:54:55,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testGetAfterCompaction 726889889edf2231a960c7164a1e7ffe 2023-11-19 10:54:55,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1700391294065.726889889edf2231a960c7164a1e7ffe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-19 10:54:55,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 726889889edf2231a960c7164a1e7ffe 2023-11-19 10:54:55,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 726889889edf2231a960c7164a1e7ffe 2023-11-19 10:54:55,205 INFO [StoreOpener-726889889edf2231a960c7164a1e7ffe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 726889889edf2231a960c7164a1e7ffe 2023-11-19 10:54:55,207 DEBUG [StoreOpener-726889889edf2231a960c7164a1e7ffe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1 2023-11-19 10:54:55,207 DEBUG [StoreOpener-726889889edf2231a960c7164a1e7ffe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1 2023-11-19 10:54:55,207 INFO [StoreOpener-726889889edf2231a960c7164a1e7ffe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 726889889edf2231a960c7164a1e7ffe columnFamilyName f1 2023-11-19 10:54:55,208 INFO [StoreOpener-726889889edf2231a960c7164a1e7ffe-1] regionserver.HStore(310): Store=726889889edf2231a960c7164a1e7ffe/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-19 10:54:55,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe 2023-11-19 10:54:55,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe 2023-11-19 10:54:55,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 726889889edf2231a960c7164a1e7ffe 2023-11-19 10:54:55,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-19 10:54:55,213 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 726889889edf2231a960c7164a1e7ffe; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63121551, jitterRate=-0.05941559374332428}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-19 10:54:55,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 726889889edf2231a960c7164a1e7ffe: 2023-11-19 10:54:55,214 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testGetAfterCompaction,,1700391294065.726889889edf2231a960c7164a1e7ffe., pid=73, masterSystemTime=1700391295200 2023-11-19 10:54:55,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testGetAfterCompaction,,1700391294065.726889889edf2231a960c7164a1e7ffe. 2023-11-19 10:54:55,215 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testGetAfterCompaction,,1700391294065.726889889edf2231a960c7164a1e7ffe. 2023-11-19 10:54:55,215 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=726889889edf2231a960c7164a1e7ffe, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:55,215 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testGetAfterCompaction,,1700391294065.726889889edf2231a960c7164a1e7ffe.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1700391295215"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700391295215"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700391295215"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700391295215"}]},"ts":"1700391295215"} 2023-11-19 10:54:55,218 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=73, resume processing ppid=72 2023-11-19 10:54:55,218 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=72, state=SUCCESS; OpenRegionProcedure 726889889edf2231a960c7164a1e7ffe, server=jenkins-hbase4.apache.org,46035,1700391201579 in 169 msec 2023-11-19 10:54:55,219 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=72, resume processing ppid=71 2023-11-19 10:54:55,219 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=726889889edf2231a960c7164a1e7ffe, ASSIGN in 324 msec 2023-11-19 10:54:55,220 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-19 10:54:55,220 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700391295220"}]},"ts":"1700391295220"} 2023-11-19 10:54:55,221 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLED in hbase:meta 2023-11-19 10:54:55,224 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-11-19 10:54:55,225 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; CreateTableProcedure table=testGetAfterCompaction in 1.1580 sec 2023-11-19 10:54:56,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-19 10:54:56,173 INFO [Listener at localhost/42675] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testGetAfterCompaction, procId: 71 completed 2023-11-19 10:54:56,173 DEBUG [Listener at localhost/42675] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testGetAfterCompaction get assigned. Timeout = 60000ms 2023-11-19 10:54:56,175 INFO [Listener at localhost/42675] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-11-19 10:54:56,177 INFO [Listener at localhost/42675] hbase.HBaseTestingUtility(3484): All regions for table testGetAfterCompaction assigned to meta. Checking AM states. 2023-11-19 10:54:56,178 INFO [Listener at localhost/42675] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-11-19 10:54:56,178 INFO [Listener at localhost/42675] hbase.HBaseTestingUtility(3504): All regions for table testGetAfterCompaction assigned. 2023-11-19 10:54:56,182 INFO [Listener at localhost/42675] regionserver.HRegion(2745): Flushing 726889889edf2231a960c7164a1e7ffe 1/1 column families, dataSize=37 B heapSize=368 B 2023-11-19 10:54:56,326 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-19 10:54:56,326 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(142): Chore: CompactedHFilesCleaner missed its start time 2023-11-19 10:54:56,326 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1ea52177 to 127.0.0.1:60497 2023-11-19 10:54:56,326 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-19 10:54:56,326 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x67f48a27 to 127.0.0.1:60497 2023-11-19 10:54:56,326 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-19 10:54:56,327 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-19 10:54:56,327 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x31b344ee to 127.0.0.1:60497 2023-11-19 10:54:56,327 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-19 10:54:56,735 INFO [Listener at localhost/42675] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311196823394d9b86402c869ff742651f67f3 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202311196823394d9b86402c869ff742651f67f3 2023-11-19 10:54:56,741 INFO [Listener at localhost/42675] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/.tmp/f1/cd27ff795c8147729a9be50fcdfc5318 2023-11-19 10:54:56,745 DEBUG [Listener at localhost/42675] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/.tmp/f1/cd27ff795c8147729a9be50fcdfc5318 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/cd27ff795c8147729a9be50fcdfc5318 2023-11-19 10:54:56,749 INFO [Listener at localhost/42675] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/cd27ff795c8147729a9be50fcdfc5318, entries=1, sequenceid=5, filesize=4.9 K 2023-11-19 10:54:56,750 INFO [Listener at localhost/42675] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 726889889edf2231a960c7164a1e7ffe in 568ms, sequenceid=5, compaction requested=false 2023-11-19 10:54:56,750 DEBUG [Listener at localhost/42675] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testGetAfterCompaction' 2023-11-19 10:54:56,750 DEBUG [Listener at localhost/42675] regionserver.HRegion(2446): Flush status journal for 726889889edf2231a960c7164a1e7ffe: 2023-11-19 10:54:56,752 INFO [Listener at localhost/42675] regionserver.HRegion(2745): Flushing 726889889edf2231a960c7164a1e7ffe 1/1 column families, dataSize=37 B heapSize=368 B 2023-11-19 10:54:56,762 INFO [Listener at localhost/42675] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231119a0a8099f7bd544e4ba60be77d801733c to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231119a0a8099f7bd544e4ba60be77d801733c 2023-11-19 10:54:57,167 INFO [Listener at localhost/42675] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/.tmp/f1/f6eb238be64645c8b6f1f1475001c67b 2023-11-19 10:54:57,171 DEBUG [Listener at localhost/42675] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/.tmp/f1/f6eb238be64645c8b6f1f1475001c67b as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/f6eb238be64645c8b6f1f1475001c67b 2023-11-19 10:54:57,175 INFO [Listener at localhost/42675] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/f6eb238be64645c8b6f1f1475001c67b, entries=1, sequenceid=9, filesize=4.9 K 2023-11-19 10:54:57,176 INFO [Listener at localhost/42675] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 726889889edf2231a960c7164a1e7ffe in 424ms, sequenceid=9, compaction requested=false 2023-11-19 10:54:57,176 DEBUG [Listener at localhost/42675] regionserver.HRegion(2446): Flush status journal for 726889889edf2231a960c7164a1e7ffe: 2023-11-19 10:54:57,177 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=33457] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testGetAfterCompaction 2023-11-19 10:54:57,179 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] procedure2.ProcedureExecutor(1028): Stored pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-11-19 10:54:57,179 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-11-19 10:54:57,180 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] mob.MobUtils(833): start MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-19 10:54:57,180 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=74, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700391897180 2023-11-19 10:54:57,180 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-19 10:54:57,181 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testGetAfterCompaction' and column 'f1' 2023-11-19 10:54:57,181 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testGetAfterCompaction' column='f1' 2023-11-19 10:54:57,182 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] zookeeper.ReadOnlyZKClient(139): Connect 0x2993319f to 127.0.0.1:60497 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-19 10:54:57,190 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7ee33a95, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-19 10:54:57,190 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231119 for table='testGetAfterCompaction' and column='f1' 2023-11-19 10:54:57,229 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/cd27ff795c8147729a9be50fcdfc5318; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700391296741; access_time=1700391296184; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:57,229 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/f6eb238be64645c8b6f1f1475001c67b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700391297167; access_time=1700391296754; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:57,280 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/cd27ff795c8147729a9be50fcdfc5318; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700391296741; access_time=1700391296184; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:57,280 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/f6eb238be64645c8b6f1f1475001c67b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700391297167; access_time=1700391296754; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:57,326 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-19 10:54:57,331 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/cd27ff795c8147729a9be50fcdfc5318; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700391296741; access_time=1700391296184; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:57,331 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/f6eb238be64645c8b6f1f1475001c67b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700391297167; access_time=1700391296754; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:57,381 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/cd27ff795c8147729a9be50fcdfc5318; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700391296741; access_time=1700391296184; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:57,382 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/f6eb238be64645c8b6f1f1475001c67b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700391297167; access_time=1700391296754; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:57,432 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/cd27ff795c8147729a9be50fcdfc5318; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700391296741; access_time=1700391296184; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:57,432 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/f6eb238be64645c8b6f1f1475001c67b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700391297167; access_time=1700391296754; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:57,483 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/cd27ff795c8147729a9be50fcdfc5318; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700391296741; access_time=1700391296184; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:57,483 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/f6eb238be64645c8b6f1f1475001c67b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700391297167; access_time=1700391296754; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:57,533 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/cd27ff795c8147729a9be50fcdfc5318; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700391296741; access_time=1700391296184; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:57,534 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/f6eb238be64645c8b6f1f1475001c67b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700391297167; access_time=1700391296754; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:57,584 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/cd27ff795c8147729a9be50fcdfc5318; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700391296741; access_time=1700391296184; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:57,584 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/f6eb238be64645c8b6f1f1475001c67b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700391297167; access_time=1700391296754; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:57,635 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/cd27ff795c8147729a9be50fcdfc5318; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700391296741; access_time=1700391296184; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:57,635 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/f6eb238be64645c8b6f1f1475001c67b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700391297167; access_time=1700391296754; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:57,685 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/cd27ff795c8147729a9be50fcdfc5318; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700391296741; access_time=1700391296184; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:57,685 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/f6eb238be64645c8b6f1f1475001c67b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700391297167; access_time=1700391296754; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:57,736 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/cd27ff795c8147729a9be50fcdfc5318; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700391296741; access_time=1700391296184; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:57,736 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/f6eb238be64645c8b6f1f1475001c67b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700391297167; access_time=1700391296754; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:57,786 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/cd27ff795c8147729a9be50fcdfc5318; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700391296741; access_time=1700391296184; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:57,786 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/f6eb238be64645c8b6f1f1475001c67b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700391297167; access_time=1700391296754; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:57,837 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/cd27ff795c8147729a9be50fcdfc5318; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700391296741; access_time=1700391296184; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:57,837 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/f6eb238be64645c8b6f1f1475001c67b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700391297167; access_time=1700391296754; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:57,888 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/cd27ff795c8147729a9be50fcdfc5318; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700391296741; access_time=1700391296184; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:57,888 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/f6eb238be64645c8b6f1f1475001c67b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700391297167; access_time=1700391296754; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:57,938 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/cd27ff795c8147729a9be50fcdfc5318; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700391296741; access_time=1700391296184; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:57,938 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/f6eb238be64645c8b6f1f1475001c67b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700391297167; access_time=1700391296754; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:57,989 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/cd27ff795c8147729a9be50fcdfc5318; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700391296741; access_time=1700391296184; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:57,989 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/f6eb238be64645c8b6f1f1475001c67b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700391297167; access_time=1700391296754; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:58,016 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311195734833fa724479f9528d558c611c8a8 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202311195734833fa724479f9528d558c611c8a8 2023-11-19 10:54:58,017 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231119 table='testGetAfterCompaction' column='f1' 2023-11-19 10:54:58,029 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-19 10:54:58,030 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46074, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-19 10:54:58,036 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-19 10:54:58,037 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48634, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-19 10:54:58,039 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/cd27ff795c8147729a9be50fcdfc5318; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700391296741; access_time=1700391296184; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:58,039 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/f6eb238be64645c8b6f1f1475001c67b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700391297167; access_time=1700391296754; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:58,045 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231119/f1/ac8191cf2d9249e3b8190be2710a7ca8 first=Optional[r1] last=Optional[r2] 2023-11-19 10:54:58,046 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testGetAfterCompaction,,1700391294065.726889889edf2231a960c7164a1e7ffe., hostname=jenkins-hbase4.apache.org,46035,1700391201579, seqNum=2 for row with hfile group [{f1,hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231119/f1/ac8191cf2d9249e3b8190be2710a7ca8}] 2023-11-19 10:54:58,049 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(763): Validating hfile at hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231119/f1/ac8191cf2d9249e3b8190be2710a7ca8 for inclusion in 726889889edf2231a960c7164a1e7ffe/f1 2023-11-19 10:54:58,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-11-19 10:54:58,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(777): Region bounds: first= last= 2023-11-19 10:54:58,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegion(2446): Flush status journal for 726889889edf2231a960c7164a1e7ffe: 2023-11-19 10:54:58,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231119/f1/ac8191cf2d9249e3b8190be2710a7ca8 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testGetAfterCompaction__h48j5a9tp5cqvfmarcpgk49v2n5pbs5u9lmpo6nhem1gm98o2mnohi505uov045g/f1/ac8191cf2d9249e3b8190be2710a7ca8 2023-11-19 10:54:58,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testGetAfterCompaction__h48j5a9tp5cqvfmarcpgk49v2n5pbs5u9lmpo6nhem1gm98o2mnohi505uov045g/f1/ac8191cf2d9249e3b8190be2710a7ca8 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/7a24f55e358e4f29831abf9a1a39dc4e_SeqId_12_ 2023-11-19 10:54:58,054 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(849): Loaded HFile hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testGetAfterCompaction__h48j5a9tp5cqvfmarcpgk49v2n5pbs5u9lmpo6nhem1gm98o2mnohi505uov045g/f1/ac8191cf2d9249e3b8190be2710a7ca8 into 726889889edf2231a960c7164a1e7ffe/f1 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/7a24f55e358e4f29831abf9a1a39dc4e_SeqId_12_ - updating store file list. 2023-11-19 10:54:58,057 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(882): Loaded HFile hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/7a24f55e358e4f29831abf9a1a39dc4e_SeqId_12_ into 726889889edf2231a960c7164a1e7ffe/f1 2023-11-19 10:54:58,057 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(855): Successfully loaded hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testGetAfterCompaction__h48j5a9tp5cqvfmarcpgk49v2n5pbs5u9lmpo6nhem1gm98o2mnohi505uov045g/f1/ac8191cf2d9249e3b8190be2710a7ca8 into 726889889edf2231a960c7164a1e7ffe/f1 (new location: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/7a24f55e358e4f29831abf9a1a39dc4e_SeqId_12_) 2023-11-19 10:54:58,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testGetAfterCompaction__h48j5a9tp5cqvfmarcpgk49v2n5pbs5u9lmpo6nhem1gm98o2mnohi505uov045g/f1/ac8191cf2d9249e3b8190be2710a7ca8 2023-11-19 10:54:58,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(1912): 726889889edf2231a960c7164a1e7ffe/f1 is initiating minor compaction 2023-11-19 10:54:58,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@720bc473; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-19 10:54:58,058 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 726889889edf2231a960c7164a1e7ffe/f1 in testGetAfterCompaction,,1700391294065.726889889edf2231a960c7164a1e7ffe. 2023-11-19 10:54:58,058 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/f6eb238be64645c8b6f1f1475001c67b, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/7a24f55e358e4f29831abf9a1a39dc4e_SeqId_12_] into tmpdir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/.tmp, totalSize=10.0 K 2023-11-19 10:54:58,058 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting f6eb238be64645c8b6f1f1475001c67b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-19 10:54:58,058 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting 7a24f55e358e4f29831abf9a1a39dc4e_SeqId_12_, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-19 10:54:58,060 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231119 table='testGetAfterCompaction' column='f1' 2023-11-19 10:54:58,060 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:54:58,062 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202311196823394d9b86402c869ff742651f67f3 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202311196823394d9b86402c869ff742651f67f3 2023-11-19 10:54:58,063 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231119a0a8099f7bd544e4ba60be77d801733c to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231119a0a8099f7bd544e4ba60be77d801733c 2023-11-19 10:54:58,063 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testGetAfterCompaction 2 expired mob files are deleted 2023-11-19 10:54:58,063 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231119' 2023-11-19 10:54:58,063 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231119 for table='testGetAfterCompaction' and column='f1' 2023-11-19 10:54:58,063 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testGetAfterCompaction' column='f1' 2023-11-19 10:54:58,063 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] mob.MobUtils(840): end MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-19 10:54:58,064 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=74, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-11-19 10:54:58,065 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=74, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE in 886 msec 2023-11-19 10:54:58,065 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] throttle.PressureAwareThroughputController(145): 726889889edf2231a960c7164a1e7ffe#f1#compaction#77 average throughput is 0.25 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-19 10:54:58,090 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/7a24f55e358e4f29831abf9a1a39dc4e_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700391298012; access_time=1700391297201; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-19 10:54:58,090 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/cd27ff795c8147729a9be50fcdfc5318; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700391296741; access_time=1700391296184; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:58,090 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/f6eb238be64645c8b6f1f1475001c67b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700391297167; access_time=1700391296754; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:58,094 DEBUG [Listener at localhost/42675] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-11-19 10:54:58,097 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46082, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-11-19 10:54:58,097 INFO [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=46035] regionserver.RSRpcServices(1662): Compacting testGetAfterCompaction,,1700391294065.726889889edf2231a960c7164a1e7ffe. 2023-11-19 10:54:58,098 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=46035] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 2 compacting, 0 eligible, 16 blocking 2023-11-19 10:54:58,098 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=46035] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-11-19 10:54:58,098 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=46035] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-11-19 10:54:58,098 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=46035] regionserver.CompactSplit(415): Not compacting testGetAfterCompaction,,1700391294065.726889889edf2231a960c7164a1e7ffe. because compaction request was cancelled 2023-11-19 10:54:58,149 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/7a24f55e358e4f29831abf9a1a39dc4e_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700391298012; access_time=1700391297201; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-19 10:54:58,149 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/cd27ff795c8147729a9be50fcdfc5318; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700391296741; access_time=1700391296184; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:58,149 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/f6eb238be64645c8b6f1f1475001c67b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700391297167; access_time=1700391296754; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:58,200 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/7a24f55e358e4f29831abf9a1a39dc4e_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700391298012; access_time=1700391297201; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-19 10:54:58,200 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/cd27ff795c8147729a9be50fcdfc5318; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700391296741; access_time=1700391296184; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:58,200 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/f6eb238be64645c8b6f1f1475001c67b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700391297167; access_time=1700391296754; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:58,251 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/7a24f55e358e4f29831abf9a1a39dc4e_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700391298012; access_time=1700391297201; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-19 10:54:58,251 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/cd27ff795c8147729a9be50fcdfc5318; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700391296741; access_time=1700391296184; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:58,251 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/f6eb238be64645c8b6f1f1475001c67b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700391297167; access_time=1700391296754; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:58,302 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/7a24f55e358e4f29831abf9a1a39dc4e_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700391298012; access_time=1700391297201; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-19 10:54:58,302 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/cd27ff795c8147729a9be50fcdfc5318; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700391296741; access_time=1700391296184; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:58,302 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/f6eb238be64645c8b6f1f1475001c67b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700391297167; access_time=1700391296754; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:58,352 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/7a24f55e358e4f29831abf9a1a39dc4e_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700391298012; access_time=1700391297201; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-19 10:54:58,353 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/cd27ff795c8147729a9be50fcdfc5318; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700391296741; access_time=1700391296184; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:58,353 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/f6eb238be64645c8b6f1f1475001c67b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700391297167; access_time=1700391296754; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:58,403 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/7a24f55e358e4f29831abf9a1a39dc4e_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700391298012; access_time=1700391297201; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-19 10:54:58,404 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/cd27ff795c8147729a9be50fcdfc5318; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700391296741; access_time=1700391296184; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:58,404 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/f6eb238be64645c8b6f1f1475001c67b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700391297167; access_time=1700391296754; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:58,454 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/7a24f55e358e4f29831abf9a1a39dc4e_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700391298012; access_time=1700391297201; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-19 10:54:58,454 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/cd27ff795c8147729a9be50fcdfc5318; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700391296741; access_time=1700391296184; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:58,454 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/f6eb238be64645c8b6f1f1475001c67b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700391297167; access_time=1700391296754; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:58,505 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/7a24f55e358e4f29831abf9a1a39dc4e_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700391298012; access_time=1700391297201; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-19 10:54:58,505 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/cd27ff795c8147729a9be50fcdfc5318; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700391296741; access_time=1700391296184; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:58,505 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/f6eb238be64645c8b6f1f1475001c67b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700391297167; access_time=1700391296754; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:58,556 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/7a24f55e358e4f29831abf9a1a39dc4e_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700391298012; access_time=1700391297201; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-19 10:54:58,556 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/cd27ff795c8147729a9be50fcdfc5318; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700391296741; access_time=1700391296184; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:58,556 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/f6eb238be64645c8b6f1f1475001c67b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700391297167; access_time=1700391296754; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:58,606 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/7a24f55e358e4f29831abf9a1a39dc4e_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700391298012; access_time=1700391297201; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-19 10:54:58,607 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/cd27ff795c8147729a9be50fcdfc5318; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700391296741; access_time=1700391296184; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:58,607 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/f6eb238be64645c8b6f1f1475001c67b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700391297167; access_time=1700391296754; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:58,657 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/7a24f55e358e4f29831abf9a1a39dc4e_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700391298012; access_time=1700391297201; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-19 10:54:58,657 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/cd27ff795c8147729a9be50fcdfc5318; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700391296741; access_time=1700391296184; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:58,658 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/f6eb238be64645c8b6f1f1475001c67b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700391297167; access_time=1700391296754; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:58,708 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/7a24f55e358e4f29831abf9a1a39dc4e_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700391298012; access_time=1700391297201; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-19 10:54:58,708 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/cd27ff795c8147729a9be50fcdfc5318; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700391296741; access_time=1700391296184; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:58,708 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/f6eb238be64645c8b6f1f1475001c67b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700391297167; access_time=1700391296754; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:58,759 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/7a24f55e358e4f29831abf9a1a39dc4e_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700391298012; access_time=1700391297201; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-19 10:54:58,759 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/cd27ff795c8147729a9be50fcdfc5318; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700391296741; access_time=1700391296184; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:58,759 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/f6eb238be64645c8b6f1f1475001c67b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700391297167; access_time=1700391296754; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:58,810 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/7a24f55e358e4f29831abf9a1a39dc4e_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700391298012; access_time=1700391297201; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-19 10:54:58,810 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/cd27ff795c8147729a9be50fcdfc5318; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700391296741; access_time=1700391296184; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:58,810 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/f6eb238be64645c8b6f1f1475001c67b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700391297167; access_time=1700391296754; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:58,860 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/7a24f55e358e4f29831abf9a1a39dc4e_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700391298012; access_time=1700391297201; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-19 10:54:58,861 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/cd27ff795c8147729a9be50fcdfc5318; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700391296741; access_time=1700391296184; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:58,861 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/f6eb238be64645c8b6f1f1475001c67b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700391297167; access_time=1700391296754; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:58,878 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/.tmp/f1/585be75de4524a209c5f05d1dacb0335 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/585be75de4524a209c5f05d1dacb0335 2023-11-19 10:54:58,882 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 2 file(s) in 726889889edf2231a960c7164a1e7ffe/f1 of 726889889edf2231a960c7164a1e7ffe into 585be75de4524a209c5f05d1dacb0335(size=5.1 K), total size for store is 10.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-19 10:54:58,882 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 726889889edf2231a960c7164a1e7ffe: 2023-11-19 10:54:58,882 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testGetAfterCompaction,,1700391294065.726889889edf2231a960c7164a1e7ffe., storeName=f1, fileCount=2, fileSize=10.0 K (4.9 K, 5.1 K), priority=2, time=1700391298058; duration=0sec 2023-11-19 10:54:58,882 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-19 10:54:58,911 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/585be75de4524a209c5f05d1dacb0335; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1700391298873; access_time=1700391298063; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:58,911 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/7a24f55e358e4f29831abf9a1a39dc4e_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700391298012; access_time=1700391297201; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-19 10:54:58,911 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/cd27ff795c8147729a9be50fcdfc5318; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700391296741; access_time=1700391296184; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:58,911 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/f6eb238be64645c8b6f1f1475001c67b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700391297167; access_time=1700391296754; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:58,927 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/f6eb238be64645c8b6f1f1475001c67b, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/7a24f55e358e4f29831abf9a1a39dc4e_SeqId_12_] to archive 2023-11-19 10:54:58,927 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:54:58,929 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/f6eb238be64645c8b6f1f1475001c67b to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/f6eb238be64645c8b6f1f1475001c67b 2023-11-19 10:54:58,930 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/7a24f55e358e4f29831abf9a1a39dc4e_SeqId_12_ to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/7a24f55e358e4f29831abf9a1a39dc4e_SeqId_12_ 2023-11-19 10:54:58,962 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/585be75de4524a209c5f05d1dacb0335; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1700391298873; access_time=1700391298063; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:58,962 INFO [Listener at localhost/42675] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/cd27ff795c8147729a9be50fcdfc5318; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700391296741; access_time=1700391296184; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-19 10:54:59,076 INFO [Listener at localhost/42675] client.HBaseAdmin$15(890): Started disable of testGetAfterCompaction 2023-11-19 10:54:59,080 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testGetAfterCompaction 2023-11-19 10:54:59,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure2.ProcedureExecutor(1028): Stored pid=75, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testGetAfterCompaction 2023-11-19 10:54:59,089 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700391299088"}]},"ts":"1700391299088"} 2023-11-19 10:54:59,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-11-19 10:54:59,090 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLING in hbase:meta 2023-11-19 10:54:59,091 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testGetAfterCompaction to state=DISABLING 2023-11-19 10:54:59,092 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=726889889edf2231a960c7164a1e7ffe, UNASSIGN}] 2023-11-19 10:54:59,093 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=726889889edf2231a960c7164a1e7ffe, UNASSIGN 2023-11-19 10:54:59,094 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=726889889edf2231a960c7164a1e7ffe, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:59,094 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1700391294065.726889889edf2231a960c7164a1e7ffe.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1700391299094"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700391299094"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700391299094"}]},"ts":"1700391299094"} 2023-11-19 10:54:59,095 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; CloseRegionProcedure 726889889edf2231a960c7164a1e7ffe, server=jenkins-hbase4.apache.org,46035,1700391201579}] 2023-11-19 10:54:59,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-11-19 10:54:59,246 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:54:59,247 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 726889889edf2231a960c7164a1e7ffe 2023-11-19 10:54:59,247 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 726889889edf2231a960c7164a1e7ffe, disabling compactions & flushes 2023-11-19 10:54:59,247 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1700391294065.726889889edf2231a960c7164a1e7ffe. 2023-11-19 10:54:59,247 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1700391294065.726889889edf2231a960c7164a1e7ffe. 2023-11-19 10:54:59,247 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1700391294065.726889889edf2231a960c7164a1e7ffe. after waiting 0 ms 2023-11-19 10:54:59,247 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1700391294065.726889889edf2231a960c7164a1e7ffe. 2023-11-19 10:54:59,251 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-11-19 10:54:59,251 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-11-19 10:54:59,252 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1700391294065.726889889edf2231a960c7164a1e7ffe. 2023-11-19 10:54:59,252 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 726889889edf2231a960c7164a1e7ffe: 2023-11-19 10:54:59,253 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 726889889edf2231a960c7164a1e7ffe 2023-11-19 10:54:59,254 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=726889889edf2231a960c7164a1e7ffe, regionState=CLOSED 2023-11-19 10:54:59,254 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1700391294065.726889889edf2231a960c7164a1e7ffe.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1700391299254"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700391299254"}]},"ts":"1700391299254"} 2023-11-19 10:54:59,256 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-11-19 10:54:59,256 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; CloseRegionProcedure 726889889edf2231a960c7164a1e7ffe, server=jenkins-hbase4.apache.org,46035,1700391201579 in 160 msec 2023-11-19 10:54:59,257 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=75 2023-11-19 10:54:59,257 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=75, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=726889889edf2231a960c7164a1e7ffe, UNASSIGN in 164 msec 2023-11-19 10:54:59,258 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700391299258"}]},"ts":"1700391299258"} 2023-11-19 10:54:59,259 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLED in hbase:meta 2023-11-19 10:54:59,260 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testGetAfterCompaction to state=DISABLED 2023-11-19 10:54:59,261 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=75, state=SUCCESS; DisableTableProcedure table=testGetAfterCompaction in 179 msec 2023-11-19 10:54:59,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-11-19 10:54:59,391 INFO [Listener at localhost/42675] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testGetAfterCompaction, procId: 75 completed 2023-11-19 10:54:59,396 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testGetAfterCompaction 2023-11-19 10:54:59,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testGetAfterCompaction 2023-11-19 10:54:59,403 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-19 10:54:59,404 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=78, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-19 10:54:59,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=78 2023-11-19 10:54:59,407 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe 2023-11-19 10:54:59,409 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1, FileablePath, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/recovered.edits] 2023-11-19 10:54:59,415 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/585be75de4524a209c5f05d1dacb0335 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/585be75de4524a209c5f05d1dacb0335 2023-11-19 10:54:59,417 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/cd27ff795c8147729a9be50fcdfc5318 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/f1/cd27ff795c8147729a9be50fcdfc5318 2023-11-19 10:54:59,420 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/recovered.edits/15.seqid to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe/recovered.edits/15.seqid 2023-11-19 10:54:59,421 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/default/testGetAfterCompaction/726889889edf2231a960c7164a1e7ffe 2023-11-19 10:54:59,421 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-11-19 10:54:59,421 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-11-19 10:54:59,422 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1] 2023-11-19 10:54:59,425 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202311195734833fa724479f9528d558c611c8a8 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202311195734833fa724479f9528d558c611c8a8 2023-11-19 10:54:59,426 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-11-19 10:54:59,428 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=78, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-19 10:54:59,452 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testGetAfterCompaction from hbase:meta 2023-11-19 10:54:59,455 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testGetAfterCompaction' descriptor. 2023-11-19 10:54:59,457 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=78, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-19 10:54:59,457 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testGetAfterCompaction' from region states. 2023-11-19 10:54:59,457 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction,,1700391294065.726889889edf2231a960c7164a1e7ffe.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1700391299457"}]},"ts":"9223372036854775807"} 2023-11-19 10:54:59,459 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-11-19 10:54:59,459 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 726889889edf2231a960c7164a1e7ffe, NAME => 'testGetAfterCompaction,,1700391294065.726889889edf2231a960c7164a1e7ffe.', STARTKEY => '', ENDKEY => ''}] 2023-11-19 10:54:59,459 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testGetAfterCompaction' as deleted. 2023-11-19 10:54:59,459 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1700391299459"}]},"ts":"9223372036854775807"} 2023-11-19 10:54:59,461 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testGetAfterCompaction state from META 2023-11-19 10:54:59,462 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=78, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-19 10:54:59,463 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; DeleteTableProcedure table=testGetAfterCompaction in 66 msec 2023-11-19 10:54:59,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=78 2023-11-19 10:54:59,506 INFO [Listener at localhost/42675] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testGetAfterCompaction, procId: 78 completed 2023-11-19 10:54:59,518 INFO [Listener at localhost/42675] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=239 (was 243), OpenFileDescriptor=626 (was 641), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=158 (was 154) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 171), AvailableMemoryMB=15372 (was 15409) 2023-11-19 10:54:59,528 INFO [Listener at localhost/42675] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=239, OpenFileDescriptor=626, MaxFileDescriptor=60000, SystemLoadAverage=158, ProcessCount=171, AvailableMemoryMB=15371 2023-11-19 10:54:59,530 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-19 10:54:59,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testCompactionWithHFileLink 2023-11-19 10:54:59,532 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_PRE_OPERATION 2023-11-19 10:54:59,532 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testCompactionWithHFileLink" procId is: 79 2023-11-19 10:54:59,532 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-19 10:54:59,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-19 10:54:59,534 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d 2023-11-19 10:54:59,534 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332 2023-11-19 10:54:59,534 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0 2023-11-19 10:54:59,535 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d empty. 2023-11-19 10:54:59,535 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0 empty. 2023-11-19 10:54:59,535 DEBUG [HFileArchiver-14] backup.HFileArchiver(153): Directory hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332 empty. 2023-11-19 10:54:59,535 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d 2023-11-19 10:54:59,535 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0 2023-11-19 10:54:59,535 DEBUG [HFileArchiver-14] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332 2023-11-19 10:54:59,535 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testCompactionWithHFileLink regions 2023-11-19 10:54:59,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-19 10:54:59,710 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-19 10:54:59,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-19 10:54:59,943 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-11-19 10:54:59,945 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(7675): creating {ENCODED => 4a83e887540ecadca9444556fadfc332, NAME => 'testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp 2023-11-19 10:54:59,945 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(7675): creating {ENCODED => 637f0b3884286bfcfceb56152d715e9d, NAME => 'testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp 2023-11-19 10:54:59,946 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(7675): creating {ENCODED => 3bb6c0b2c9863082d1a21587d98896c0, NAME => 'testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp 2023-11-19 10:54:59,961 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-19 10:54:59,961 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1604): Closing 4a83e887540ecadca9444556fadfc332, disabling compactions & flushes 2023-11-19 10:54:59,961 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332. 2023-11-19 10:54:59,961 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332. 2023-11-19 10:54:59,961 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332. after waiting 0 ms 2023-11-19 10:54:59,961 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332. 2023-11-19 10:54:59,962 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332. 2023-11-19 10:54:59,962 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1558): Region close journal for 4a83e887540ecadca9444556fadfc332: 2023-11-19 10:54:59,964 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-19 10:54:59,964 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1604): Closing 637f0b3884286bfcfceb56152d715e9d, disabling compactions & flushes 2023-11-19 10:54:59,964 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d. 2023-11-19 10:54:59,964 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d. 2023-11-19 10:54:59,964 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d. after waiting 0 ms 2023-11-19 10:54:59,964 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d. 2023-11-19 10:54:59,964 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d. 2023-11-19 10:54:59,964 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1558): Region close journal for 637f0b3884286bfcfceb56152d715e9d: 2023-11-19 10:55:00,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-19 10:55:00,363 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-19 10:55:00,363 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1604): Closing 3bb6c0b2c9863082d1a21587d98896c0, disabling compactions & flushes 2023-11-19 10:55:00,363 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0. 2023-11-19 10:55:00,363 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0. 2023-11-19 10:55:00,363 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0. after waiting 0 ms 2023-11-19 10:55:00,363 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0. 2023-11-19 10:55:00,363 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0. 2023-11-19 10:55:00,363 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1558): Region close journal for 3bb6c0b2c9863082d1a21587d98896c0: 2023-11-19 10:55:00,366 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ADD_TO_META 2023-11-19 10:55:00,367 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700391300366"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700391300366"}]},"ts":"1700391300366"} 2023-11-19 10:55:00,367 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700391300366"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700391300366"}]},"ts":"1700391300366"} 2023-11-19 10:55:00,367 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700391300366"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700391300366"}]},"ts":"1700391300366"} 2023-11-19 10:55:00,369 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-19 10:55:00,369 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-19 10:55:00,370 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700391300370"}]},"ts":"1700391300370"} 2023-11-19 10:55:00,371 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-11-19 10:55:00,375 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=637f0b3884286bfcfceb56152d715e9d, ASSIGN}, {pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=4a83e887540ecadca9444556fadfc332, ASSIGN}, {pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=3bb6c0b2c9863082d1a21587d98896c0, ASSIGN}] 2023-11-19 10:55:00,377 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=637f0b3884286bfcfceb56152d715e9d, ASSIGN 2023-11-19 10:55:00,377 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=4a83e887540ecadca9444556fadfc332, ASSIGN 2023-11-19 10:55:00,377 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=3bb6c0b2c9863082d1a21587d98896c0, ASSIGN 2023-11-19 10:55:00,377 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=637f0b3884286bfcfceb56152d715e9d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46035,1700391201579; forceNewPlan=false, retain=false 2023-11-19 10:55:00,377 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=4a83e887540ecadca9444556fadfc332, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46035,1700391201579; forceNewPlan=false, retain=false 2023-11-19 10:55:00,377 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=3bb6c0b2c9863082d1a21587d98896c0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46035,1700391201579; forceNewPlan=false, retain=false 2023-11-19 10:55:00,529 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=637f0b3884286bfcfceb56152d715e9d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:00,529 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=3bb6c0b2c9863082d1a21587d98896c0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:00,529 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=4a83e887540ecadca9444556fadfc332, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:00,529 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700391300529"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700391300529"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700391300529"}]},"ts":"1700391300529"} 2023-11-19 10:55:00,530 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700391300529"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700391300529"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700391300529"}]},"ts":"1700391300529"} 2023-11-19 10:55:00,530 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700391300529"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700391300529"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700391300529"}]},"ts":"1700391300529"} 2023-11-19 10:55:00,531 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=83, ppid=80, state=RUNNABLE; OpenRegionProcedure 637f0b3884286bfcfceb56152d715e9d, server=jenkins-hbase4.apache.org,46035,1700391201579}] 2023-11-19 10:55:00,531 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=84, ppid=82, state=RUNNABLE; OpenRegionProcedure 3bb6c0b2c9863082d1a21587d98896c0, server=jenkins-hbase4.apache.org,46035,1700391201579}] 2023-11-19 10:55:00,533 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=81, state=RUNNABLE; OpenRegionProcedure 4a83e887540ecadca9444556fadfc332, server=jenkins-hbase4.apache.org,46035,1700391201579}] 2023-11-19 10:55:00,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-19 10:55:00,684 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:00,686 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0. 2023-11-19 10:55:00,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3bb6c0b2c9863082d1a21587d98896c0, NAME => 'testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0.', STARTKEY => '2', ENDKEY => ''} 2023-11-19 10:55:00,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 3bb6c0b2c9863082d1a21587d98896c0 2023-11-19 10:55:00,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-19 10:55:00,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3bb6c0b2c9863082d1a21587d98896c0 2023-11-19 10:55:00,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3bb6c0b2c9863082d1a21587d98896c0 2023-11-19 10:55:00,688 INFO [StoreOpener-3bb6c0b2c9863082d1a21587d98896c0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 3bb6c0b2c9863082d1a21587d98896c0 2023-11-19 10:55:00,689 DEBUG [StoreOpener-3bb6c0b2c9863082d1a21587d98896c0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1 2023-11-19 10:55:00,689 DEBUG [StoreOpener-3bb6c0b2c9863082d1a21587d98896c0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1 2023-11-19 10:55:00,689 INFO [StoreOpener-3bb6c0b2c9863082d1a21587d98896c0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3bb6c0b2c9863082d1a21587d98896c0 columnFamilyName family1 2023-11-19 10:55:00,691 INFO [StoreOpener-3bb6c0b2c9863082d1a21587d98896c0-1] regionserver.HStore(310): Store=3bb6c0b2c9863082d1a21587d98896c0/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-19 10:55:00,691 INFO [StoreOpener-3bb6c0b2c9863082d1a21587d98896c0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 3bb6c0b2c9863082d1a21587d98896c0 2023-11-19 10:55:00,692 DEBUG [StoreOpener-3bb6c0b2c9863082d1a21587d98896c0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family2 2023-11-19 10:55:00,692 DEBUG [StoreOpener-3bb6c0b2c9863082d1a21587d98896c0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family2 2023-11-19 10:55:00,692 INFO [StoreOpener-3bb6c0b2c9863082d1a21587d98896c0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3bb6c0b2c9863082d1a21587d98896c0 columnFamilyName family2 2023-11-19 10:55:00,693 INFO [StoreOpener-3bb6c0b2c9863082d1a21587d98896c0-1] regionserver.HStore(310): Store=3bb6c0b2c9863082d1a21587d98896c0/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-19 10:55:00,694 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0 2023-11-19 10:55:00,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0 2023-11-19 10:55:00,696 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-19 10:55:00,697 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3bb6c0b2c9863082d1a21587d98896c0 2023-11-19 10:55:00,699 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-19 10:55:00,699 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3bb6c0b2c9863082d1a21587d98896c0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73003119, jitterRate=0.08783124387264252}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-19 10:55:00,699 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3bb6c0b2c9863082d1a21587d98896c0: 2023-11-19 10:55:00,700 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0., pid=84, masterSystemTime=1700391300684 2023-11-19 10:55:00,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0. 2023-11-19 10:55:00,701 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0. 2023-11-19 10:55:00,701 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d. 2023-11-19 10:55:00,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 637f0b3884286bfcfceb56152d715e9d, NAME => 'testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d.', STARTKEY => '', ENDKEY => '1'} 2023-11-19 10:55:00,702 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=3bb6c0b2c9863082d1a21587d98896c0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:00,702 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 637f0b3884286bfcfceb56152d715e9d 2023-11-19 10:55:00,702 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-19 10:55:00,702 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700391300702"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700391300702"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700391300702"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700391300702"}]},"ts":"1700391300702"} 2023-11-19 10:55:00,702 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 637f0b3884286bfcfceb56152d715e9d 2023-11-19 10:55:00,702 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 637f0b3884286bfcfceb56152d715e9d 2023-11-19 10:55:00,703 INFO [StoreOpener-637f0b3884286bfcfceb56152d715e9d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 637f0b3884286bfcfceb56152d715e9d 2023-11-19 10:55:00,704 DEBUG [StoreOpener-637f0b3884286bfcfceb56152d715e9d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1 2023-11-19 10:55:00,705 DEBUG [StoreOpener-637f0b3884286bfcfceb56152d715e9d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1 2023-11-19 10:55:00,704 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=84, resume processing ppid=82 2023-11-19 10:55:00,705 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=84, ppid=82, state=SUCCESS; OpenRegionProcedure 3bb6c0b2c9863082d1a21587d98896c0, server=jenkins-hbase4.apache.org,46035,1700391201579 in 172 msec 2023-11-19 10:55:00,705 INFO [StoreOpener-637f0b3884286bfcfceb56152d715e9d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 637f0b3884286bfcfceb56152d715e9d columnFamilyName family1 2023-11-19 10:55:00,705 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=3bb6c0b2c9863082d1a21587d98896c0, ASSIGN in 330 msec 2023-11-19 10:55:00,706 INFO [StoreOpener-637f0b3884286bfcfceb56152d715e9d-1] regionserver.HStore(310): Store=637f0b3884286bfcfceb56152d715e9d/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-19 10:55:00,706 INFO [StoreOpener-637f0b3884286bfcfceb56152d715e9d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 637f0b3884286bfcfceb56152d715e9d 2023-11-19 10:55:00,707 DEBUG [StoreOpener-637f0b3884286bfcfceb56152d715e9d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family2 2023-11-19 10:55:00,707 DEBUG [StoreOpener-637f0b3884286bfcfceb56152d715e9d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family2 2023-11-19 10:55:00,707 INFO [StoreOpener-637f0b3884286bfcfceb56152d715e9d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 637f0b3884286bfcfceb56152d715e9d columnFamilyName family2 2023-11-19 10:55:00,708 INFO [StoreOpener-637f0b3884286bfcfceb56152d715e9d-1] regionserver.HStore(310): Store=637f0b3884286bfcfceb56152d715e9d/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-19 10:55:00,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d 2023-11-19 10:55:00,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d 2023-11-19 10:55:00,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-19 10:55:00,712 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 637f0b3884286bfcfceb56152d715e9d 2023-11-19 10:55:00,713 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-19 10:55:00,713 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 637f0b3884286bfcfceb56152d715e9d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68165871, jitterRate=0.01575063169002533}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-19 10:55:00,714 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 637f0b3884286bfcfceb56152d715e9d: 2023-11-19 10:55:00,714 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d., pid=83, masterSystemTime=1700391300684 2023-11-19 10:55:00,715 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d. 2023-11-19 10:55:00,715 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d. 2023-11-19 10:55:00,715 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332. 2023-11-19 10:55:00,715 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4a83e887540ecadca9444556fadfc332, NAME => 'testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332.', STARTKEY => '1', ENDKEY => '2'} 2023-11-19 10:55:00,716 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=637f0b3884286bfcfceb56152d715e9d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:00,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 4a83e887540ecadca9444556fadfc332 2023-11-19 10:55:00,716 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700391300715"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700391300715"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700391300715"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700391300715"}]},"ts":"1700391300715"} 2023-11-19 10:55:00,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-19 10:55:00,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4a83e887540ecadca9444556fadfc332 2023-11-19 10:55:00,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4a83e887540ecadca9444556fadfc332 2023-11-19 10:55:00,717 INFO [StoreOpener-4a83e887540ecadca9444556fadfc332-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 4a83e887540ecadca9444556fadfc332 2023-11-19 10:55:00,718 DEBUG [StoreOpener-4a83e887540ecadca9444556fadfc332-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1 2023-11-19 10:55:00,718 DEBUG [StoreOpener-4a83e887540ecadca9444556fadfc332-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1 2023-11-19 10:55:00,718 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=83, resume processing ppid=80 2023-11-19 10:55:00,718 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=83, ppid=80, state=SUCCESS; OpenRegionProcedure 637f0b3884286bfcfceb56152d715e9d, server=jenkins-hbase4.apache.org,46035,1700391201579 in 186 msec 2023-11-19 10:55:00,719 INFO [StoreOpener-4a83e887540ecadca9444556fadfc332-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4a83e887540ecadca9444556fadfc332 columnFamilyName family1 2023-11-19 10:55:00,719 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=80, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=637f0b3884286bfcfceb56152d715e9d, ASSIGN in 344 msec 2023-11-19 10:55:00,719 INFO [StoreOpener-4a83e887540ecadca9444556fadfc332-1] regionserver.HStore(310): Store=4a83e887540ecadca9444556fadfc332/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-19 10:55:00,720 INFO [StoreOpener-4a83e887540ecadca9444556fadfc332-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 4a83e887540ecadca9444556fadfc332 2023-11-19 10:55:00,721 DEBUG [StoreOpener-4a83e887540ecadca9444556fadfc332-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family2 2023-11-19 10:55:00,721 DEBUG [StoreOpener-4a83e887540ecadca9444556fadfc332-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family2 2023-11-19 10:55:00,721 INFO [StoreOpener-4a83e887540ecadca9444556fadfc332-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4a83e887540ecadca9444556fadfc332 columnFamilyName family2 2023-11-19 10:55:00,722 INFO [StoreOpener-4a83e887540ecadca9444556fadfc332-1] regionserver.HStore(310): Store=4a83e887540ecadca9444556fadfc332/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-19 10:55:00,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332 2023-11-19 10:55:00,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332 2023-11-19 10:55:00,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-19 10:55:00,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4a83e887540ecadca9444556fadfc332 2023-11-19 10:55:00,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-19 10:55:00,727 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4a83e887540ecadca9444556fadfc332; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67089791, jitterRate=-2.8420984745025635E-4}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-19 10:55:00,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4a83e887540ecadca9444556fadfc332: 2023-11-19 10:55:00,728 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332., pid=85, masterSystemTime=1700391300684 2023-11-19 10:55:00,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332. 2023-11-19 10:55:00,729 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332. 2023-11-19 10:55:00,729 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=4a83e887540ecadca9444556fadfc332, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:00,729 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700391300729"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700391300729"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700391300729"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700391300729"}]},"ts":"1700391300729"} 2023-11-19 10:55:00,731 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=85, resume processing ppid=81 2023-11-19 10:55:00,731 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=81, state=SUCCESS; OpenRegionProcedure 4a83e887540ecadca9444556fadfc332, server=jenkins-hbase4.apache.org,46035,1700391201579 in 199 msec 2023-11-19 10:55:00,733 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=79 2023-11-19 10:55:00,733 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=4a83e887540ecadca9444556fadfc332, ASSIGN in 357 msec 2023-11-19 10:55:00,733 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-19 10:55:00,733 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700391300733"}]},"ts":"1700391300733"} 2023-11-19 10:55:00,734 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-11-19 10:55:00,736 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_POST_OPERATION 2023-11-19 10:55:00,737 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; CreateTableProcedure table=testCompactionWithHFileLink in 1.2060 sec 2023-11-19 10:55:01,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-19 10:55:01,637 INFO [Listener at localhost/42675] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testCompactionWithHFileLink, procId: 79 completed 2023-11-19 10:55:01,644 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d. with WAL disabled. Data may be lost in the event of a crash. 2023-11-19 10:55:01,645 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332. with WAL disabled. Data may be lost in the event of a crash. 2023-11-19 10:55:01,646 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0. with WAL disabled. Data may be lost in the event of a crash. 2023-11-19 10:55:01,649 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:55:01,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-19 10:55:01,652 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-19 10:55:01,652 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:55:01,652 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-19 10:55:01,652 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-19 10:55:01,652 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-19 10:55:01,652 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-19 10:55:01,653 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:01,654 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:55:01,654 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:55:01,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:55:01,654 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:01,654 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:55:01,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-19 10:55:01,654 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-19 10:55:01,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:55:01,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-19 10:55:01,655 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-19 10:55:01,655 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-19 10:55:01,655 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-19 10:55:01,655 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:55:01,655 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-19 10:55:01,659 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332. 2023-11-19 10:55:01,659 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332. started... 2023-11-19 10:55:01,659 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0. 2023-11-19 10:55:01,659 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-19 10:55:01,660 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:55:01,660 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4a83e887540ecadca9444556fadfc332 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-19 10:55:01,660 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d. 2023-11-19 10:55:01,660 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d. started... 2023-11-19 10:55:01,660 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0. started... 2023-11-19 10:55:01,661 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 637f0b3884286bfcfceb56152d715e9d 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-19 10:55:01,661 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 3bb6c0b2c9863082d1a21587d98896c0 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-19 10:55:02,085 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311196239bac53d134db79a5c84de2f7daf56 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311196239bac53d134db79a5c84de2f7daf56 2023-11-19 10:55:02,085 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231119a8af52671e4e4cb4bbc0dbbc1e850e3c to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231119a8af52671e4e4cb4bbc0dbbc1e850e3c 2023-11-19 10:55:02,085 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231119ad49a6e2e2f04861aa39bb7d1c84a9d1 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231119ad49a6e2e2f04861aa39bb7d1c84a9d1 2023-11-19 10:55:02,491 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/.tmp/family1/e50fef40dd3c40128bc0fa95885d7dab 2023-11-19 10:55:02,491 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/.tmp/family1/0372b9105a144b4a8aaef5a3dc101a63 2023-11-19 10:55:02,491 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/.tmp/family1/6ce54f57ed0d4ff3be15c835afea0542 2023-11-19 10:55:02,517 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311197fa17086a2924b7587f689ed4404b312 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311197fa17086a2924b7587f689ed4404b312 2023-11-19 10:55:02,526 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/.tmp/family2/d88c375eb41c48309e3230ffee5ac927 2023-11-19 10:55:02,532 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/.tmp/family1/0372b9105a144b4a8aaef5a3dc101a63 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/0372b9105a144b4a8aaef5a3dc101a63 2023-11-19 10:55:02,537 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/0372b9105a144b4a8aaef5a3dc101a63, entries=4, sequenceid=5, filesize=5.4 K 2023-11-19 10:55:02,538 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/.tmp/family2/d88c375eb41c48309e3230ffee5ac927 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family2/d88c375eb41c48309e3230ffee5ac927 2023-11-19 10:55:02,542 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family2/d88c375eb41c48309e3230ffee5ac927, entries=2, sequenceid=5, filesize=5.1 K 2023-11-19 10:55:02,542 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 4a83e887540ecadca9444556fadfc332 in 882ms, sequenceid=5, compaction requested=false 2023-11-19 10:55:02,543 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-11-19 10:55:02,543 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4a83e887540ecadca9444556fadfc332: 2023-11-19 10:55:02,543 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332. 2023-11-19 10:55:02,543 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-19 10:55:02,917 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311199c132e83723846f08c79fc6a7b3e7296 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311199c132e83723846f08c79fc6a7b3e7296 2023-11-19 10:55:02,917 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231119da78e20f10184426ae754ff38533b694 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231119da78e20f10184426ae754ff38533b694 2023-11-19 10:55:03,322 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/.tmp/family2/4514248a5e4c40a18c2176148afa3a70 2023-11-19 10:55:03,322 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/.tmp/family2/5e1ddebf717143dd894f0cda6b80e167 2023-11-19 10:55:03,327 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/.tmp/family1/e50fef40dd3c40128bc0fa95885d7dab as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/e50fef40dd3c40128bc0fa95885d7dab 2023-11-19 10:55:03,327 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/.tmp/family1/6ce54f57ed0d4ff3be15c835afea0542 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/6ce54f57ed0d4ff3be15c835afea0542 2023-11-19 10:55:03,330 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/e50fef40dd3c40128bc0fa95885d7dab, entries=4, sequenceid=5, filesize=5.4 K 2023-11-19 10:55:03,331 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/6ce54f57ed0d4ff3be15c835afea0542, entries=4, sequenceid=5, filesize=5.4 K 2023-11-19 10:55:03,331 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/.tmp/family2/5e1ddebf717143dd894f0cda6b80e167 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family2/5e1ddebf717143dd894f0cda6b80e167 2023-11-19 10:55:03,331 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/.tmp/family2/4514248a5e4c40a18c2176148afa3a70 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family2/4514248a5e4c40a18c2176148afa3a70 2023-11-19 10:55:03,335 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family2/4514248a5e4c40a18c2176148afa3a70, entries=2, sequenceid=5, filesize=5.1 K 2023-11-19 10:55:03,335 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family2/5e1ddebf717143dd894f0cda6b80e167, entries=2, sequenceid=5, filesize=5.1 K 2023-11-19 10:55:03,336 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 637f0b3884286bfcfceb56152d715e9d in 1675ms, sequenceid=5, compaction requested=false 2023-11-19 10:55:03,336 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 3bb6c0b2c9863082d1a21587d98896c0 in 1675ms, sequenceid=5, compaction requested=false 2023-11-19 10:55:03,337 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 3bb6c0b2c9863082d1a21587d98896c0: 2023-11-19 10:55:03,337 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 637f0b3884286bfcfceb56152d715e9d: 2023-11-19 10:55:03,337 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d. 2023-11-19 10:55:03,337 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0. 2023-11-19 10:55:03,337 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-19 10:55:03,337 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-19 10:55:03,337 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-19 10:55:03,337 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:03,337 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-19 10:55:03,337 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-19 10:55:03,339 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:03,339 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-19 10:55:03,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:03,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:03,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:55:03,340 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-19 10:55:03,340 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:55:03,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:03,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:03,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-19 10:55:03,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:03,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:03,341 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-19 10:55:03,341 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@665a9713[Count = 0] remaining members to acquire global barrier 2023-11-19 10:55:03,341 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-19 10:55:03,341 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-19 10:55:03,343 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-19 10:55:03,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-19 10:55:03,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-19 10:55:03,343 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-19 10:55:03,343 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-19 10:55:03,343 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:55:03,343 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:03,343 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:55:03,344 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-19 10:55:03,344 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:03,344 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:55:03,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:03,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:03,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:55:03,344 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-19 10:55:03,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:03,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:03,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-19 10:55:03,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:03,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:03,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-19 10:55:03,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:03,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:55:03,346 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-19 10:55:03,346 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-19 10:55:03,346 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:55:03,346 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:55:03,346 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-19 10:55:03,347 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:55:03,348 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-19 10:55:03,348 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-19 10:55:03,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-19 10:55:03,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-19 10:55:03,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:03,348 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:55:03,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:55:03,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-19 10:55:03,348 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:03,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:55:03,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:55:03,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:03,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-19 10:55:03,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-19 10:55:03,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:03,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-19 10:55:03,350 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:03,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:03,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:03,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-19 10:55:03,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:03,352 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:03,352 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-19 10:55:03,352 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:55:03,352 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-19 10:55:03,352 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:55:03,352 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-11-19 10:55:03,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:55:03,352 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-19 10:55:03,353 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:55:03,352 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:03,352 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:55:03,352 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:55:03,353 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-19 10:55:03,353 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-19 10:55:03,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:55:03,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:55:03,353 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-19 10:55:03,353 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:55:03,353 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-19 10:55:03,453 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:55:03,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:55:03,455 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d. with WAL disabled. Data may be lost in the event of a crash. 2023-11-19 10:55:03,455 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332. with WAL disabled. Data may be lost in the event of a crash. 2023-11-19 10:55:03,455 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0. with WAL disabled. Data may be lost in the event of a crash. 2023-11-19 10:55:03,457 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:55:03,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-19 10:55:03,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-19 10:55:03,460 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-19 10:55:03,460 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:55:03,460 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-19 10:55:03,460 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-19 10:55:03,460 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-19 10:55:03,460 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-19 10:55:03,462 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:55:03,462 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:03,462 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:55:03,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:55:03,462 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:03,462 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:55:03,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-19 10:55:03,463 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-19 10:55:03,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:55:03,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-19 10:55:03,463 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-19 10:55:03,463 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-19 10:55:03,463 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-19 10:55:03,463 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-19 10:55:03,463 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:55:03,463 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-19 10:55:03,464 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332. 2023-11-19 10:55:03,464 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332. started... 2023-11-19 10:55:03,464 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0. 2023-11-19 10:55:03,464 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0. started... 2023-11-19 10:55:03,464 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4a83e887540ecadca9444556fadfc332 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-19 10:55:03,464 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 3bb6c0b2c9863082d1a21587d98896c0 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-19 10:55:03,465 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-19 10:55:03,465 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:55:03,465 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d. 2023-11-19 10:55:03,465 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d. started... 2023-11-19 10:55:03,465 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 637f0b3884286bfcfceb56152d715e9d 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-19 10:55:03,494 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231119d36e7f2d34364bdc8fb49339fb2de294 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231119d36e7f2d34364bdc8fb49339fb2de294 2023-11-19 10:55:03,893 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311190980babcd5a04424bddc05cf5c3462ea to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311190980babcd5a04424bddc05cf5c3462ea 2023-11-19 10:55:03,894 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231119ef0f22069d204985939432fd3e807d7c to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231119ef0f22069d204985939432fd3e807d7c 2023-11-19 10:55:03,902 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/.tmp/family1/bfcb67f7218c4938aa6226f4b310974c 2023-11-19 10:55:04,298 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/.tmp/family1/e6f86413cc15400981952800b7cd63ba 2023-11-19 10:55:04,298 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/.tmp/family1/1a192ccf5c384a4b9227c6be349c1cdb 2023-11-19 10:55:04,318 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023111955a42fdbce5b479dbb0d2c04d8b5cd31 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023111955a42fdbce5b479dbb0d2c04d8b5cd31 2023-11-19 10:55:04,715 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023111951cd1c0b130e4709a801f87037625642 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023111951cd1c0b130e4709a801f87037625642 2023-11-19 10:55:04,721 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/.tmp/family2/f110b6db2dc64eeb9eb40bee5be84288 2023-11-19 10:55:04,721 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231119f5d6a458d10a4d5b966a6a4248c301d3 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231119f5d6a458d10a4d5b966a6a4248c301d3 2023-11-19 10:55:04,723 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/.tmp/family2/87683fada1bc4361bef06981be006667 2023-11-19 10:55:04,726 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/.tmp/family1/e6f86413cc15400981952800b7cd63ba as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/e6f86413cc15400981952800b7cd63ba 2023-11-19 10:55:04,727 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/.tmp/family2/4845a1ccc26a493ba944c124fee0873d 2023-11-19 10:55:04,728 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/.tmp/family1/bfcb67f7218c4938aa6226f4b310974c as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/bfcb67f7218c4938aa6226f4b310974c 2023-11-19 10:55:04,731 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/e6f86413cc15400981952800b7cd63ba, entries=4, sequenceid=9, filesize=5.4 K 2023-11-19 10:55:04,731 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/.tmp/family2/f110b6db2dc64eeb9eb40bee5be84288 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family2/f110b6db2dc64eeb9eb40bee5be84288 2023-11-19 10:55:04,732 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/.tmp/family1/1a192ccf5c384a4b9227c6be349c1cdb as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/1a192ccf5c384a4b9227c6be349c1cdb 2023-11-19 10:55:04,732 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/bfcb67f7218c4938aa6226f4b310974c, entries=4, sequenceid=9, filesize=5.4 K 2023-11-19 10:55:04,733 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/.tmp/family2/87683fada1bc4361bef06981be006667 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family2/87683fada1bc4361bef06981be006667 2023-11-19 10:55:04,736 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family2/f110b6db2dc64eeb9eb40bee5be84288, entries=2, sequenceid=9, filesize=5.1 K 2023-11-19 10:55:04,736 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/1a192ccf5c384a4b9227c6be349c1cdb, entries=4, sequenceid=9, filesize=5.4 K 2023-11-19 10:55:04,737 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 637f0b3884286bfcfceb56152d715e9d in 1272ms, sequenceid=9, compaction requested=false 2023-11-19 10:55:04,737 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 637f0b3884286bfcfceb56152d715e9d: 2023-11-19 10:55:04,737 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d. 2023-11-19 10:55:04,737 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/.tmp/family2/4845a1ccc26a493ba944c124fee0873d as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family2/4845a1ccc26a493ba944c124fee0873d 2023-11-19 10:55:04,737 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-19 10:55:04,742 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family2/87683fada1bc4361bef06981be006667, entries=2, sequenceid=9, filesize=5.1 K 2023-11-19 10:55:04,742 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family2/4845a1ccc26a493ba944c124fee0873d, entries=2, sequenceid=9, filesize=5.1 K 2023-11-19 10:55:04,742 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 4a83e887540ecadca9444556fadfc332 in 1278ms, sequenceid=9, compaction requested=false 2023-11-19 10:55:04,742 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4a83e887540ecadca9444556fadfc332: 2023-11-19 10:55:04,742 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332. 2023-11-19 10:55:04,742 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-19 10:55:04,742 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 3bb6c0b2c9863082d1a21587d98896c0 in 1278ms, sequenceid=9, compaction requested=false 2023-11-19 10:55:04,743 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 3bb6c0b2c9863082d1a21587d98896c0: 2023-11-19 10:55:04,743 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0. 2023-11-19 10:55:04,743 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-19 10:55:04,743 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-19 10:55:04,743 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:04,743 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-19 10:55:04,743 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-19 10:55:04,749 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:04,749 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-19 10:55:04,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:04,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:04,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:55:04,750 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-19 10:55:04,750 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:55:04,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:04,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:04,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-19 10:55:04,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:04,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:04,751 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-19 10:55:04,751 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@440138d9[Count = 0] remaining members to acquire global barrier 2023-11-19 10:55:04,751 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-19 10:55:04,751 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-19 10:55:04,752 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-19 10:55:04,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-19 10:55:04,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-19 10:55:04,752 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-19 10:55:04,752 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-19 10:55:04,752 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:55:04,752 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:04,753 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:55:04,754 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-19 10:55:04,754 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:04,754 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-19 10:55:04,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:04,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:04,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:55:04,754 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:55:04,754 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-19 10:55:04,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:04,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:04,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-19 10:55:04,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:04,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:04,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-19 10:55:04,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:04,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:55:04,757 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-19 10:55:04,757 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-19 10:55:04,757 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:55:04,757 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:55:04,757 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-19 10:55:04,757 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:55:04,759 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-19 10:55:04,759 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:55:04,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-19 10:55:04,759 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-19 10:55:04,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-19 10:55:04,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-19 10:55:04,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:04,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:55:04,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:55:04,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:04,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:55:04,760 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:04,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-19 10:55:04,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-19 10:55:04,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:04,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-19 10:55:04,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:04,761 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:04,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:04,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-19 10:55:04,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:04,764 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:04,764 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:55:04,764 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-19 10:55:04,764 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:55:04,764 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-19 10:55:04,764 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-19 10:55:04,764 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:55:04,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:55:04,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:55:04,764 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:55:04,764 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:04,765 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-19 10:55:04,765 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:55:04,765 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-19 10:55:04,765 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-19 10:55:04,765 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-19 10:55:04,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:55:04,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:55:04,865 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:55:04,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:55:04,867 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d. with WAL disabled. Data may be lost in the event of a crash. 2023-11-19 10:55:04,868 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332. with WAL disabled. Data may be lost in the event of a crash. 2023-11-19 10:55:04,868 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0. with WAL disabled. Data may be lost in the event of a crash. 2023-11-19 10:55:04,871 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:55:04,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-19 10:55:04,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-19 10:55:04,872 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-19 10:55:04,873 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:55:04,873 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-19 10:55:04,873 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-19 10:55:04,873 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-19 10:55:04,873 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-19 10:55:04,874 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:04,874 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:55:04,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:55:04,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:55:04,875 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:04,875 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:55:04,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-19 10:55:04,875 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-19 10:55:04,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:55:04,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-19 10:55:04,875 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-19 10:55:04,876 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-19 10:55:04,876 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-19 10:55:04,876 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-19 10:55:04,876 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:55:04,876 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-19 10:55:04,876 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332. 2023-11-19 10:55:04,876 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332. started... 2023-11-19 10:55:04,876 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0. 2023-11-19 10:55:04,876 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0. started... 2023-11-19 10:55:04,876 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4a83e887540ecadca9444556fadfc332 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-19 10:55:04,876 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 3bb6c0b2c9863082d1a21587d98896c0 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-19 10:55:04,877 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-19 10:55:04,877 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:55:04,877 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d. 2023-11-19 10:55:04,877 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d. started... 2023-11-19 10:55:04,877 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 637f0b3884286bfcfceb56152d715e9d 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-19 10:55:05,300 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311198762411ff2534743bb3aefeef885cc70 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311198762411ff2534743bb3aefeef885cc70 2023-11-19 10:55:05,302 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311192bf23f9cf93e47bcb5dff8874611341c to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311192bf23f9cf93e47bcb5dff8874611341c 2023-11-19 10:55:05,305 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311197c4d4dbcefaf4730a6b094a06d1a1610 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311197c4d4dbcefaf4730a6b094a06d1a1610 2023-11-19 10:55:05,306 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/.tmp/family1/3a6ace9e1d19485c9163859fc4342e66 2023-11-19 10:55:05,309 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/.tmp/family1/ac2fe88928b040f1abd62cc82dd57b34 2023-11-19 10:55:05,330 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311195b8670b102fc4b909cbe489ae0a66395 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311195b8670b102fc4b909cbe489ae0a66395 2023-11-19 10:55:05,331 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231119292a84ddcfbe4b3aae81c253546b6ac0 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231119292a84ddcfbe4b3aae81c253546b6ac0 2023-11-19 10:55:05,336 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/.tmp/family2/ba44e63e3aab4a2696e51a294c0e959d 2023-11-19 10:55:05,339 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/.tmp/family1/ac2fe88928b040f1abd62cc82dd57b34 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/ac2fe88928b040f1abd62cc82dd57b34 2023-11-19 10:55:05,342 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/ac2fe88928b040f1abd62cc82dd57b34, entries=4, sequenceid=13, filesize=5.4 K 2023-11-19 10:55:05,343 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/.tmp/family2/ba44e63e3aab4a2696e51a294c0e959d as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family2/ba44e63e3aab4a2696e51a294c0e959d 2023-11-19 10:55:05,346 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family2/ba44e63e3aab4a2696e51a294c0e959d, entries=2, sequenceid=13, filesize=5.1 K 2023-11-19 10:55:05,346 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 637f0b3884286bfcfceb56152d715e9d in 469ms, sequenceid=13, compaction requested=true 2023-11-19 10:55:05,346 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 637f0b3884286bfcfceb56152d715e9d: 2023-11-19 10:55:05,346 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d. 2023-11-19 10:55:05,346 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-19 10:55:05,717 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/.tmp/family1/b5f58cf5e2f5425e9430630e361758ce 2023-11-19 10:55:05,734 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/.tmp/family2/65763493d9b84815a761f0299a47abfa 2023-11-19 10:55:05,738 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/.tmp/family1/3a6ace9e1d19485c9163859fc4342e66 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/3a6ace9e1d19485c9163859fc4342e66 2023-11-19 10:55:05,741 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/3a6ace9e1d19485c9163859fc4342e66, entries=4, sequenceid=13, filesize=5.4 K 2023-11-19 10:55:05,741 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/.tmp/family2/65763493d9b84815a761f0299a47abfa as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family2/65763493d9b84815a761f0299a47abfa 2023-11-19 10:55:05,745 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family2/65763493d9b84815a761f0299a47abfa, entries=2, sequenceid=13, filesize=5.1 K 2023-11-19 10:55:05,745 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 3bb6c0b2c9863082d1a21587d98896c0 in 869ms, sequenceid=13, compaction requested=true 2023-11-19 10:55:05,745 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 3bb6c0b2c9863082d1a21587d98896c0: 2023-11-19 10:55:05,745 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0. 2023-11-19 10:55:05,745 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-19 10:55:06,131 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023111924ebccfaae33428b85a4315ff54c382c to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023111924ebccfaae33428b85a4315ff54c382c 2023-11-19 10:55:06,537 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/.tmp/family2/8bfd838e615a4158b81518f03b3d4f70 2023-11-19 10:55:06,541 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/.tmp/family1/b5f58cf5e2f5425e9430630e361758ce as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/b5f58cf5e2f5425e9430630e361758ce 2023-11-19 10:55:06,545 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/b5f58cf5e2f5425e9430630e361758ce, entries=4, sequenceid=13, filesize=5.4 K 2023-11-19 10:55:06,545 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/.tmp/family2/8bfd838e615a4158b81518f03b3d4f70 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family2/8bfd838e615a4158b81518f03b3d4f70 2023-11-19 10:55:06,549 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family2/8bfd838e615a4158b81518f03b3d4f70, entries=2, sequenceid=13, filesize=5.1 K 2023-11-19 10:55:06,550 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 4a83e887540ecadca9444556fadfc332 in 1674ms, sequenceid=13, compaction requested=true 2023-11-19 10:55:06,550 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4a83e887540ecadca9444556fadfc332: 2023-11-19 10:55:06,550 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332. 2023-11-19 10:55:06,550 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-19 10:55:06,550 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-19 10:55:06,550 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:06,550 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-19 10:55:06,550 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-19 10:55:06,552 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:06,552 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-19 10:55:06,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:06,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:06,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:55:06,552 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-19 10:55:06,552 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:55:06,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:06,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:06,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-19 10:55:06,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:06,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:06,554 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-19 10:55:06,554 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@376c6248[Count = 0] remaining members to acquire global barrier 2023-11-19 10:55:06,554 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-19 10:55:06,554 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-19 10:55:06,555 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-19 10:55:06,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-19 10:55:06,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-19 10:55:06,555 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-19 10:55:06,555 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-19 10:55:06,555 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:06,555 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:55:06,555 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:55:06,557 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:06,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:06,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:06,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:55:06,557 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-19 10:55:06,558 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:55:06,558 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-19 10:55:06,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:06,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:06,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-19 10:55:06,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:06,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:06,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-19 10:55:06,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:06,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:55:06,560 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-19 10:55:06,560 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-19 10:55:06,560 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:55:06,560 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:55:06,560 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-19 10:55:06,560 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:55:06,562 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-19 10:55:06,562 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-19 10:55:06,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-19 10:55:06,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-19 10:55:06,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:06,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-19 10:55:06,562 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:55:06,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:55:06,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:55:06,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:06,563 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:06,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:55:06,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-19 10:55:06,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-19 10:55:06,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:06,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-19 10:55:06,564 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:06,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:06,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:06,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-19 10:55:06,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:06,567 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:06,567 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:55:06,567 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-19 10:55:06,567 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:55:06,567 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-19 10:55:06,567 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:55:06,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:55:06,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:55:06,567 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-19 10:55:06,568 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:55:06,567 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:06,568 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-19 10:55:06,568 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-19 10:55:06,568 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-19 10:55:06,568 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-11-19 10:55:06,568 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:55:06,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:55:06,568 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-19 10:55:06,568 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:55:06,668 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:55:06,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:55:06,670 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d. with WAL disabled. Data may be lost in the event of a crash. 2023-11-19 10:55:06,670 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332. with WAL disabled. Data may be lost in the event of a crash. 2023-11-19 10:55:06,670 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0. with WAL disabled. Data may be lost in the event of a crash. 2023-11-19 10:55:06,673 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:55:06,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-19 10:55:06,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-19 10:55:06,674 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-19 10:55:06,674 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:55:06,674 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-19 10:55:06,674 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-19 10:55:06,675 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-19 10:55:06,675 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-19 10:55:06,676 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:55:06,676 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:06,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:55:06,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:55:06,677 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:06,677 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:55:06,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-19 10:55:06,677 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-19 10:55:06,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:55:06,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-19 10:55:06,677 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-19 10:55:06,678 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-19 10:55:06,678 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-19 10:55:06,678 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-19 10:55:06,678 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:55:06,678 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-19 10:55:06,678 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332. 2023-11-19 10:55:06,678 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0. 2023-11-19 10:55:06,678 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-19 10:55:06,678 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d. 2023-11-19 10:55:06,678 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d. started... 2023-11-19 10:55:06,678 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0. started... 2023-11-19 10:55:06,678 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332. started... 2023-11-19 10:55:06,678 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 3bb6c0b2c9863082d1a21587d98896c0 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-19 10:55:06,678 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:55:06,678 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 637f0b3884286bfcfceb56152d715e9d 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-19 10:55:06,678 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4a83e887540ecadca9444556fadfc332 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-19 10:55:06,702 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311194d02a0bf91464cde99c2cf0119bd6cac to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311194d02a0bf91464cde99c2cf0119bd6cac 2023-11-19 10:55:07,102 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231119a597da2e193f44fcb76cc5cae46d94d0 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231119a597da2e193f44fcb76cc5cae46d94d0 2023-11-19 10:55:07,102 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023111941569f188b6f438a9805fe018e660ff6 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023111941569f188b6f438a9805fe018e660ff6 2023-11-19 10:55:07,107 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/.tmp/family1/50cfabdebac34a6a88ee5aab65fb8770 2023-11-19 10:55:07,511 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/.tmp/family1/05c787f40212496d9d807f1c78e870dc 2023-11-19 10:55:07,511 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/.tmp/family1/4c5188c6e778445caff4c373976479e9 2023-11-19 10:55:07,522 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311192c908dd4a8304c60afcf7867653e1d26 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311192c908dd4a8304c60afcf7867653e1d26 2023-11-19 10:55:07,529 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231119bea3fe6087dd4568aad3f9266b1da482 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231119bea3fe6087dd4568aad3f9266b1da482 2023-11-19 10:55:07,532 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/.tmp/family2/bc0941dc9bb04974a011a607c8cd6d95 2023-11-19 10:55:07,535 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/.tmp/family1/4c5188c6e778445caff4c373976479e9 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/4c5188c6e778445caff4c373976479e9 2023-11-19 10:55:07,538 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/4c5188c6e778445caff4c373976479e9, entries=4, sequenceid=17, filesize=5.4 K 2023-11-19 10:55:07,539 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/.tmp/family2/bc0941dc9bb04974a011a607c8cd6d95 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family2/bc0941dc9bb04974a011a607c8cd6d95 2023-11-19 10:55:07,542 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family2/bc0941dc9bb04974a011a607c8cd6d95, entries=2, sequenceid=17, filesize=5.1 K 2023-11-19 10:55:07,542 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 4a83e887540ecadca9444556fadfc332 in 864ms, sequenceid=17, compaction requested=true 2023-11-19 10:55:07,542 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4a83e887540ecadca9444556fadfc332: 2023-11-19 10:55:07,543 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332. 2023-11-19 10:55:07,543 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-19 10:55:07,927 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/.tmp/family2/c628e404e9d6494db8abb403651cbd06 2023-11-19 10:55:07,931 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231119c4b422c32dac47a1910bcd923fbeab81 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231119c4b422c32dac47a1910bcd923fbeab81 2023-11-19 10:55:07,932 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/.tmp/family1/50cfabdebac34a6a88ee5aab65fb8770 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/50cfabdebac34a6a88ee5aab65fb8770 2023-11-19 10:55:07,938 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/50cfabdebac34a6a88ee5aab65fb8770, entries=4, sequenceid=17, filesize=5.4 K 2023-11-19 10:55:07,939 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/.tmp/family2/c628e404e9d6494db8abb403651cbd06 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family2/c628e404e9d6494db8abb403651cbd06 2023-11-19 10:55:07,943 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family2/c628e404e9d6494db8abb403651cbd06, entries=2, sequenceid=17, filesize=5.1 K 2023-11-19 10:55:07,943 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 3bb6c0b2c9863082d1a21587d98896c0 in 1265ms, sequenceid=17, compaction requested=true 2023-11-19 10:55:07,943 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 3bb6c0b2c9863082d1a21587d98896c0: 2023-11-19 10:55:07,943 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0. 2023-11-19 10:55:07,943 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-19 10:55:08,339 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/.tmp/family2/e2bd97573076422091726d2553c6895e 2023-11-19 10:55:08,343 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/.tmp/family1/05c787f40212496d9d807f1c78e870dc as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/05c787f40212496d9d807f1c78e870dc 2023-11-19 10:55:08,346 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/05c787f40212496d9d807f1c78e870dc, entries=4, sequenceid=17, filesize=5.4 K 2023-11-19 10:55:08,347 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/.tmp/family2/e2bd97573076422091726d2553c6895e as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family2/e2bd97573076422091726d2553c6895e 2023-11-19 10:55:08,351 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family2/e2bd97573076422091726d2553c6895e, entries=2, sequenceid=17, filesize=5.1 K 2023-11-19 10:55:08,351 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 637f0b3884286bfcfceb56152d715e9d in 1673ms, sequenceid=17, compaction requested=true 2023-11-19 10:55:08,352 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 637f0b3884286bfcfceb56152d715e9d: 2023-11-19 10:55:08,352 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d. 2023-11-19 10:55:08,352 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-19 10:55:08,352 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-19 10:55:08,352 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:08,352 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-19 10:55:08,352 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-19 10:55:08,353 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:08,354 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-19 10:55:08,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:08,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:08,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:55:08,354 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-19 10:55:08,354 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:55:08,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:08,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:08,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-19 10:55:08,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:08,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:08,356 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-19 10:55:08,356 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@317f78c2[Count = 0] remaining members to acquire global barrier 2023-11-19 10:55:08,356 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-19 10:55:08,356 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-19 10:55:08,357 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-19 10:55:08,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-19 10:55:08,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-19 10:55:08,357 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-19 10:55:08,357 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-19 10:55:08,357 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:55:08,357 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:08,357 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:55:08,359 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-19 10:55:08,359 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:08,359 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:55:08,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:08,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:08,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:55:08,359 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-19 10:55:08,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:08,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:08,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-19 10:55:08,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:08,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:08,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-19 10:55:08,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:08,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:55:08,362 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-19 10:55:08,362 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:55:08,362 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:55:08,362 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-19 10:55:08,362 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-19 10:55:08,362 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:55:08,364 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-19 10:55:08,364 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:55:08,364 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-19 10:55:08,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-19 10:55:08,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-19 10:55:08,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-19 10:55:08,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:08,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:55:08,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:55:08,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:55:08,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:08,364 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:08,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-19 10:55:08,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-19 10:55:08,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:08,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-19 10:55:08,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:08,366 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:08,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:08,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-19 10:55:08,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:08,369 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:08,369 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-19 10:55:08,369 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:55:08,369 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-19 10:55:08,369 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-19 10:55:08,369 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:55:08,369 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:08,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:55:08,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:55:08,369 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:55:08,369 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:55:08,369 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-19 10:55:08,369 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-19 10:55:08,369 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:55:08,369 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-19 10:55:08,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:55:08,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:55:08,369 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-19 10:55:08,469 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:55:08,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:55:08,480 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb-1700391308470 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-19 10:55:08,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1700391308480 (current time:1700391308480). 2023-11-19 10:55:08,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-11-19 10:55:08,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] zookeeper.ReadOnlyZKClient(139): Connect 0x0171fe7a to 127.0.0.1:60497 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-19 10:55:08,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a69e8a2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-19 10:55:08,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-19 10:55:08,494 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43184, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-19 10:55:08,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0171fe7a to 127.0.0.1:60497 2023-11-19 10:55:08,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-19 10:55:08,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-11-19 10:55:08,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb-1700391308470 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-19 10:55:08,510 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.hbase-snapshot, current working dir path: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.hbase-snapshot/.tmp/snaptb-1700391308470 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-11-19 10:55:08,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure2.ProcedureExecutor(1028): Stored pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-19 10:55:08,517 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-19 10:55:08,518 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=86, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1700391908518 2023-11-19 10:55:08,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb-1700391308470 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-19 10:55:08,518 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb-1700391308470 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-11-19 10:55:08,521 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=86, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-19 10:55:08,521 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-11-19 10:55:08,522 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=86, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 5 msec 2023-11-19 10:55:08,522 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-11-19 10:55:08,523 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=87, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED; timeout=600000, timestamp=1700391908523 2023-11-19 10:55:08,525 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb-1700391308470 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-11-19 10:55:08,525 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-11-19 10:55:08,626 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-19 10:55:08,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1700391308470 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-19 10:55:08,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1700391308470 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-19 10:55:08,629 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-11-19 10:55:08,830 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-19 10:55:08,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1700391308470 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-19 10:55:08,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1700391308470 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-19 10:55:08,831 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-11-19 10:55:08,930 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb-1700391308470 2023-11-19 10:55:08,931 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb-1700391308470' 2023-11-19 10:55:08,931 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-11-19 10:55:08,931 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb-1700391308470' starting 'acquire' 2023-11-19 10:55:08,931 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb-1700391308470', kicking off acquire phase on members. 2023-11-19 10:55:08,931 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1700391308470 2023-11-19 10:55:08,931 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb-1700391308470 2023-11-19 10:55:08,932 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-11-19 10:55:08,932 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb-1700391308470/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:08,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-11-19 10:55:08,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-11-19 10:55:08,933 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb-1700391308470/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:08,933 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:55:08,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb-1700391308470 2023-11-19 10:55:08,933 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1700391308470 2023-11-19 10:55:08,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-11-19 10:55:08,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb-1700391308470 2023-11-19 10:55:08,934 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb-1700391308470 from table testCompactionWithHFileLink type FLUSH 2023-11-19 10:55:08,936 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb-1700391308470 2023-11-19 10:55:08,936 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb-1700391308470' with timeout 300000ms 2023-11-19 10:55:08,936 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-11-19 10:55:08,936 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb-1700391308470' starting 'acquire' stage 2023-11-19 10:55:08,936 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb-1700391308470' locally acquired 2023-11-19 10:55:08,936 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (snaptb-1700391308470) in zk 2023-11-19 10:55:08,937 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb-1700391308470 2023-11-19 10:55:08,937 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1700391308470/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:08,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb-1700391308470/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:08,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:08,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-11-19 10:55:08,938 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1700391308470 2023-11-19 10:55:08,938 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb-1700391308470' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:55:08,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:08,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:08,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1700391308470 2023-11-19 10:55:08,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:08,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:08,939 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'snaptb-1700391308470' on coordinator 2023-11-19 10:55:08,939 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@32f83f1[Count = 0] remaining members to acquire global barrier 2023-11-19 10:55:08,939 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb-1700391308470' starting 'in-barrier' execution. 2023-11-19 10:55:08,939 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb-1700391308470 2023-11-19 10:55:08,941 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1700391308470 2023-11-19 10:55:08,941 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb-1700391308470 2023-11-19 10:55:08,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb-1700391308470 2023-11-19 10:55:08,941 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb-1700391308470' received 'reached' from coordinator. 2023-11-19 10:55:08,941 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1700391308470/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:08,941 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:55:08,942 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332. 2023-11-19 10:55:08,942 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0. 2023-11-19 10:55:08,942 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 3 regions 2023-11-19 10:55:08,942 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d. 2023-11-19 10:55:08,942 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-11-19 10:55:08,943 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d. started... 2023-11-19 10:55:08,943 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0. started... 2023-11-19 10:55:08,943 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332. started... 2023-11-19 10:55:08,943 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-snapshot-pool-2] regionserver.HRegion(2446): Flush status journal for 637f0b3884286bfcfceb56152d715e9d: 2023-11-19 10:55:08,943 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4a83e887540ecadca9444556fadfc332: 2023-11-19 10:55:08,943 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-snapshot-pool-1] regionserver.HRegion(2446): Flush status journal for 3bb6c0b2c9863082d1a21587d98896c0: 2023-11-19 10:55:08,944 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332.' region-info for snapshot=snaptb-1700391308470 2023-11-19 10:55:08,944 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0.' region-info for snapshot=snaptb-1700391308470 2023-11-19 10:55:08,944 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d.' region-info for snapshot=snaptb-1700391308470 2023-11-19 10:55:08,949 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-11-19 10:55:08,949 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-11-19 10:55:08,949 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-11-19 10:55:08,953 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/e50fef40dd3c40128bc0fa95885d7dab, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/1a192ccf5c384a4b9227c6be349c1cdb, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/3a6ace9e1d19485c9163859fc4342e66, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/50cfabdebac34a6a88ee5aab65fb8770] hfiles 2023-11-19 10:55:08,953 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/0372b9105a144b4a8aaef5a3dc101a63, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/bfcb67f7218c4938aa6226f4b310974c, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/b5f58cf5e2f5425e9430630e361758ce, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/4c5188c6e778445caff4c373976479e9] hfiles 2023-11-19 10:55:08,953 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/6ce54f57ed0d4ff3be15c835afea0542, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/e6f86413cc15400981952800b7cd63ba, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/ac2fe88928b040f1abd62cc82dd57b34, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/05c787f40212496d9d807f1c78e870dc] hfiles 2023-11-19 10:55:08,953 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/0372b9105a144b4a8aaef5a3dc101a63 for snapshot=snaptb-1700391308470 2023-11-19 10:55:08,953 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/e50fef40dd3c40128bc0fa95885d7dab for snapshot=snaptb-1700391308470 2023-11-19 10:55:08,953 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/6ce54f57ed0d4ff3be15c835afea0542 for snapshot=snaptb-1700391308470 2023-11-19 10:55:08,956 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/1a192ccf5c384a4b9227c6be349c1cdb for snapshot=snaptb-1700391308470 2023-11-19 10:55:08,956 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/bfcb67f7218c4938aa6226f4b310974c for snapshot=snaptb-1700391308470 2023-11-19 10:55:08,956 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/e6f86413cc15400981952800b7cd63ba for snapshot=snaptb-1700391308470 2023-11-19 10:55:08,956 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/b5f58cf5e2f5425e9430630e361758ce for snapshot=snaptb-1700391308470 2023-11-19 10:55:08,956 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/3a6ace9e1d19485c9163859fc4342e66 for snapshot=snaptb-1700391308470 2023-11-19 10:55:08,956 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/4c5188c6e778445caff4c373976479e9 for snapshot=snaptb-1700391308470 2023-11-19 10:55:08,956 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/50cfabdebac34a6a88ee5aab65fb8770 for snapshot=snaptb-1700391308470 2023-11-19 10:55:08,956 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/ac2fe88928b040f1abd62cc82dd57b34 for snapshot=snaptb-1700391308470 2023-11-19 10:55:08,956 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family2/5e1ddebf717143dd894f0cda6b80e167, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family2/4845a1ccc26a493ba944c124fee0873d, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family2/65763493d9b84815a761f0299a47abfa, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family2/c628e404e9d6494db8abb403651cbd06] hfiles 2023-11-19 10:55:08,956 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family2/d88c375eb41c48309e3230ffee5ac927, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family2/87683fada1bc4361bef06981be006667, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family2/8bfd838e615a4158b81518f03b3d4f70, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family2/bc0941dc9bb04974a011a607c8cd6d95] hfiles 2023-11-19 10:55:08,956 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family2/5e1ddebf717143dd894f0cda6b80e167 for snapshot=snaptb-1700391308470 2023-11-19 10:55:08,956 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/05c787f40212496d9d807f1c78e870dc for snapshot=snaptb-1700391308470 2023-11-19 10:55:08,956 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family2/4845a1ccc26a493ba944c124fee0873d for snapshot=snaptb-1700391308470 2023-11-19 10:55:08,956 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family2/4514248a5e4c40a18c2176148afa3a70, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family2/f110b6db2dc64eeb9eb40bee5be84288, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family2/ba44e63e3aab4a2696e51a294c0e959d, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family2/e2bd97573076422091726d2553c6895e] hfiles 2023-11-19 10:55:08,956 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family2/d88c375eb41c48309e3230ffee5ac927 for snapshot=snaptb-1700391308470 2023-11-19 10:55:08,957 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family2/4514248a5e4c40a18c2176148afa3a70 for snapshot=snaptb-1700391308470 2023-11-19 10:55:08,957 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family2/65763493d9b84815a761f0299a47abfa for snapshot=snaptb-1700391308470 2023-11-19 10:55:08,957 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family2/f110b6db2dc64eeb9eb40bee5be84288 for snapshot=snaptb-1700391308470 2023-11-19 10:55:08,957 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family2/c628e404e9d6494db8abb403651cbd06 for snapshot=snaptb-1700391308470 2023-11-19 10:55:08,957 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family2/ba44e63e3aab4a2696e51a294c0e959d for snapshot=snaptb-1700391308470 2023-11-19 10:55:08,957 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family2/87683fada1bc4361bef06981be006667 for snapshot=snaptb-1700391308470 2023-11-19 10:55:08,957 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family2/e2bd97573076422091726d2553c6895e for snapshot=snaptb-1700391308470 2023-11-19 10:55:08,957 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family2/8bfd838e615a4158b81518f03b3d4f70 for snapshot=snaptb-1700391308470 2023-11-19 10:55:08,957 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family2/bc0941dc9bb04974a011a607c8cd6d95 for snapshot=snaptb-1700391308470 2023-11-19 10:55:08,972 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0. completed. 2023-11-19 10:55:08,972 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0. 2023-11-19 10:55:08,973 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/3 local region snapshots. 2023-11-19 10:55:09,131 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-19 10:55:09,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1700391308470 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-19 10:55:09,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1700391308470 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-19 10:55:09,132 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-11-19 10:55:09,368 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d. completed. 2023-11-19 10:55:09,368 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332. completed. 2023-11-19 10:55:09,368 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332. 2023-11-19 10:55:09,368 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d. 2023-11-19 10:55:09,368 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/3 local region snapshots. 2023-11-19 10:55:09,368 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/3 local region snapshots. 2023-11-19 10:55:09,368 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 3 local region snapshots. 2023-11-19 10:55:09,368 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:09,368 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb-1700391308470' locally completed 2023-11-19 10:55:09,368 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb-1700391308470' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:55:09,370 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1700391308470/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:09,370 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb-1700391308470' has notified controller of completion 2023-11-19 10:55:09,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb-1700391308470/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:09,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:09,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-11-19 10:55:09,370 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:55:09,370 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb-1700391308470' completed. 2023-11-19 10:55:09,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:09,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:09,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1700391308470 2023-11-19 10:55:09,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:09,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:09,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1700391308470 2023-11-19 10:55:09,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:09,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb-1700391308470' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:55:09,372 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'snaptb-1700391308470', counting down latch. Waiting for 0 more 2023-11-19 10:55:09,372 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb-1700391308470' execution completed 2023-11-19 10:55:09,372 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:55:09,373 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:55:09,373 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb-1700391308470 2023-11-19 10:55:09,373 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb-1700391308470including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-11-19 10:55:09,374 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1700391308470 2023-11-19 10:55:09,374 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1700391308470 2023-11-19 10:55:09,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb-1700391308470 2023-11-19 10:55:09,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb-1700391308470 2023-11-19 10:55:09,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:09,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-11-19 10:55:09,374 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-11-19 10:55:09,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1700391308470 2023-11-19 10:55:09,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:09,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-11-19 10:55:09,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-11-19 10:55:09,375 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb-1700391308470/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:09,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1700391308470 2023-11-19 10:55:09,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1700391308470 2023-11-19 10:55:09,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:09,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1700391308470 2023-11-19 10:55:09,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:09,376 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb-1700391308470/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:09,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:09,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1700391308470 2023-11-19 10:55:09,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:09,378 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-11-19 10:55:09,378 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1700391308470/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:09,379 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-11-19 10:55:09,379 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1700391308470 2023-11-19 10:55:09,379 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:55:09,379 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1700391308470 2023-11-19 10:55:09,379 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb-1700391308470 2023-11-19 10:55:09,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-11-19 10:55:09,379 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testCompactionWithHFileLink 2023-11-19 10:55:09,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-11-19 10:55:09,379 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 0e7b6fa9e81bd62588edd7d77d6165e4, NAME => 'testCompactionWithHFileLink,.mob,0.0e7b6fa9e81bd62588edd7d77d6165e4.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb-1700391308470 2023-11-19 10:55:09,379 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1700391308470/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:09,379 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-11-19 10:55:09,379 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1700391308470 2023-11-19 10:55:09,379 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1700391308470 2023-11-19 10:55:09,379 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1700391308470 2023-11-19 10:55:09,379 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-11-19 10:55:09,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-11-19 10:55:09,380 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023111941569f188b6f438a9805fe018e660ff6, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311197c4d4dbcefaf4730a6b094a06d1a1610, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231119ad49a6e2e2f04861aa39bb7d1c84a9d1, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231119d36e7f2d34364bdc8fb49339fb2de294, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311194d02a0bf91464cde99c2cf0119bd6cac, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311196239bac53d134db79a5c84de2f7daf56, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311198762411ff2534743bb3aefeef885cc70, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231119ef0f22069d204985939432fd3e807d7c, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311190980babcd5a04424bddc05cf5c3462ea, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311192bf23f9cf93e47bcb5dff8874611341c, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231119a597da2e193f44fcb76cc5cae46d94d0, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231119a8af52671e4e4cb4bbc0dbbc1e850e3c] mob files 2023-11-19 10:55:09,380 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023111941569f188b6f438a9805fe018e660ff6 2023-11-19 10:55:09,380 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311197c4d4dbcefaf4730a6b094a06d1a1610 2023-11-19 10:55:09,380 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231119ad49a6e2e2f04861aa39bb7d1c84a9d1 2023-11-19 10:55:09,380 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231119d36e7f2d34364bdc8fb49339fb2de294 2023-11-19 10:55:09,380 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311194d02a0bf91464cde99c2cf0119bd6cac 2023-11-19 10:55:09,380 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311196239bac53d134db79a5c84de2f7daf56 2023-11-19 10:55:09,380 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311198762411ff2534743bb3aefeef885cc70 2023-11-19 10:55:09,380 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231119ef0f22069d204985939432fd3e807d7c 2023-11-19 10:55:09,380 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311190980babcd5a04424bddc05cf5c3462ea 2023-11-19 10:55:09,380 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311192bf23f9cf93e47bcb5dff8874611341c 2023-11-19 10:55:09,380 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231119a597da2e193f44fcb76cc5cae46d94d0 2023-11-19 10:55:09,380 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231119a8af52671e4e4cb4bbc0dbbc1e850e3c 2023-11-19 10:55:09,381 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023111924ebccfaae33428b85a4315ff54c382c, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023111955a42fdbce5b479dbb0d2c04d8b5cd31, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311197fa17086a2924b7587f689ed4404b312, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231119bea3fe6087dd4568aad3f9266b1da482, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311192c908dd4a8304c60afcf7867653e1d26, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311195b8670b102fc4b909cbe489ae0a66395, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311199c132e83723846f08c79fc6a7b3e7296, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231119f5d6a458d10a4d5b966a6a4248c301d3, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231119292a84ddcfbe4b3aae81c253546b6ac0, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023111951cd1c0b130e4709a801f87037625642, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231119c4b422c32dac47a1910bcd923fbeab81, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231119da78e20f10184426ae754ff38533b694] mob files 2023-11-19 10:55:09,381 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023111924ebccfaae33428b85a4315ff54c382c 2023-11-19 10:55:09,381 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023111955a42fdbce5b479dbb0d2c04d8b5cd31 2023-11-19 10:55:09,381 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311197fa17086a2924b7587f689ed4404b312 2023-11-19 10:55:09,381 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231119bea3fe6087dd4568aad3f9266b1da482 2023-11-19 10:55:09,382 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311192c908dd4a8304c60afcf7867653e1d26 2023-11-19 10:55:09,382 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311195b8670b102fc4b909cbe489ae0a66395 2023-11-19 10:55:09,382 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311199c132e83723846f08c79fc6a7b3e7296 2023-11-19 10:55:09,382 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231119f5d6a458d10a4d5b966a6a4248c301d3 2023-11-19 10:55:09,382 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231119292a84ddcfbe4b3aae81c253546b6ac0 2023-11-19 10:55:09,382 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023111951cd1c0b130e4709a801f87037625642 2023-11-19 10:55:09,382 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231119c4b422c32dac47a1910bcd923fbeab81 2023-11-19 10:55:09,382 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231119da78e20f10184426ae754ff38533b694 2023-11-19 10:55:09,632 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-19 10:55:09,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1700391308470 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-19 10:55:09,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1700391308470 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-19 10:55:09,633 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-11-19 10:55:09,787 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb-1700391308470 2023-11-19 10:55:09,789 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.hbase-snapshot/.tmp/snaptb-1700391308470 2023-11-19 10:55:10,230 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.hbase-snapshot/.tmp/snaptb-1700391308470 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.hbase-snapshot/snaptb-1700391308470 2023-11-19 10:55:10,231 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb-1700391308470 of table testCompactionWithHFileLink completed 2023-11-19 10:55:10,231 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.hbase-snapshot/.tmp/snaptb-1700391308470 2023-11-19 10:55:10,231 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.hbase-snapshot/.tmp/snaptb-1700391308470 2023-11-19 10:55:10,232 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb-1700391308470 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1700391308518Completed referencing HFiles for the mob region of table: testCompactionWithHFileLink at 1700391309787 (+1269 ms)Consolidate snapshot: snaptb-1700391308470 at 1700391309787Loading Region manifests for snaptb-1700391308470 at 1700391309787Writing data manifest for snaptb-1700391308470 at 1700391309796 (+9 ms)Verifying snapshot: snaptb-1700391308470 at 1700391310203 (+407 ms)Snapshot snaptb-1700391308470 of table testCompactionWithHFileLink completed at 1700391310231 (+28 ms) 2023-11-19 10:55:10,233 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=87, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-11-19 10:55:10,234 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=87, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED in 1.7120 sec 2023-11-19 10:55:10,633 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-19 10:55:10,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1700391308470 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-19 10:55:10,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb-1700391308470 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-11-19 10:55:10,662 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:55:10,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-19 10:55:10,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-19 10:55:10,663 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-19 10:55:10,663 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:55:10,663 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-19 10:55:10,663 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-19 10:55:10,664 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-19 10:55:10,664 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-19 10:55:10,666 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:10,666 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:55:10,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:55:10,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:55:10,667 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:10,667 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:55:10,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-19 10:55:10,667 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-19 10:55:10,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:55:10,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-19 10:55:10,668 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-19 10:55:10,668 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-19 10:55:10,668 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-19 10:55:10,668 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-19 10:55:10,668 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:55:10,668 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-19 10:55:10,668 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332. 2023-11-19 10:55:10,668 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0. 2023-11-19 10:55:10,668 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d. 2023-11-19 10:55:10,668 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332. started... 2023-11-19 10:55:10,668 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-19 10:55:10,669 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:55:10,668 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d. started... 2023-11-19 10:55:10,669 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4a83e887540ecadca9444556fadfc332 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-19 10:55:10,669 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 637f0b3884286bfcfceb56152d715e9d 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-19 10:55:10,668 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0. started... 2023-11-19 10:55:10,669 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 3bb6c0b2c9863082d1a21587d98896c0 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-19 10:55:11,487 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/.tmp/family1/1d4ee2fb308c460492b4c74cfa21ab56 2023-11-19 10:55:11,488 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/.tmp/family1/096b2b21fac74661845821396f17bfdc 2023-11-19 10:55:11,490 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/.tmp/family1/367c97f7c06d4d0cbe2923acc44ef265 2023-11-19 10:55:11,491 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1d4ee2fb308c460492b4c74cfa21ab56 2023-11-19 10:55:11,492 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 096b2b21fac74661845821396f17bfdc 2023-11-19 10:55:11,494 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 367c97f7c06d4d0cbe2923acc44ef265 2023-11-19 10:55:11,905 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/.tmp/family2/b3f34c606cd64cf08e5f0f28505e8534 2023-11-19 10:55:11,907 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/.tmp/family2/fa2c8df01f45496cbe3554525ad1ed07 2023-11-19 10:55:11,910 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b3f34c606cd64cf08e5f0f28505e8534 2023-11-19 10:55:11,910 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/.tmp/family1/096b2b21fac74661845821396f17bfdc as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/096b2b21fac74661845821396f17bfdc 2023-11-19 10:55:11,911 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fa2c8df01f45496cbe3554525ad1ed07 2023-11-19 10:55:11,911 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/.tmp/family1/367c97f7c06d4d0cbe2923acc44ef265 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/367c97f7c06d4d0cbe2923acc44ef265 2023-11-19 10:55:11,915 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 096b2b21fac74661845821396f17bfdc 2023-11-19 10:55:11,915 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/096b2b21fac74661845821396f17bfdc, entries=3, sequenceid=24, filesize=5.0 K 2023-11-19 10:55:11,916 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/.tmp/family2/b3f34c606cd64cf08e5f0f28505e8534 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family2/b3f34c606cd64cf08e5f0f28505e8534 2023-11-19 10:55:11,916 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 367c97f7c06d4d0cbe2923acc44ef265 2023-11-19 10:55:11,916 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/367c97f7c06d4d0cbe2923acc44ef265, entries=3, sequenceid=24, filesize=5.0 K 2023-11-19 10:55:11,917 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/.tmp/family2/fa2c8df01f45496cbe3554525ad1ed07 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family2/fa2c8df01f45496cbe3554525ad1ed07 2023-11-19 10:55:11,919 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b3f34c606cd64cf08e5f0f28505e8534 2023-11-19 10:55:11,920 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family2/b3f34c606cd64cf08e5f0f28505e8534, entries=1, sequenceid=24, filesize=5.0 K 2023-11-19 10:55:11,920 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 4a83e887540ecadca9444556fadfc332 in 1251ms, sequenceid=24, compaction requested=true 2023-11-19 10:55:11,920 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4a83e887540ecadca9444556fadfc332: 2023-11-19 10:55:11,920 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332. 2023-11-19 10:55:11,921 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-19 10:55:11,921 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fa2c8df01f45496cbe3554525ad1ed07 2023-11-19 10:55:11,921 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family2/fa2c8df01f45496cbe3554525ad1ed07, entries=1, sequenceid=24, filesize=5.0 K 2023-11-19 10:55:11,922 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 3bb6c0b2c9863082d1a21587d98896c0 in 1253ms, sequenceid=24, compaction requested=true 2023-11-19 10:55:11,922 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 3bb6c0b2c9863082d1a21587d98896c0: 2023-11-19 10:55:11,922 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0. 2023-11-19 10:55:11,922 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-19 10:55:12,308 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/.tmp/family2/e46bb7d3999144c59d1de940d6332479 2023-11-19 10:55:12,311 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e46bb7d3999144c59d1de940d6332479 2023-11-19 10:55:12,312 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/.tmp/family1/1d4ee2fb308c460492b4c74cfa21ab56 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/1d4ee2fb308c460492b4c74cfa21ab56 2023-11-19 10:55:12,315 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1d4ee2fb308c460492b4c74cfa21ab56 2023-11-19 10:55:12,315 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/1d4ee2fb308c460492b4c74cfa21ab56, entries=3, sequenceid=24, filesize=5.0 K 2023-11-19 10:55:12,315 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/.tmp/family2/e46bb7d3999144c59d1de940d6332479 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family2/e46bb7d3999144c59d1de940d6332479 2023-11-19 10:55:12,319 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e46bb7d3999144c59d1de940d6332479 2023-11-19 10:55:12,319 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family2/e46bb7d3999144c59d1de940d6332479, entries=1, sequenceid=24, filesize=5.0 K 2023-11-19 10:55:12,320 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 637f0b3884286bfcfceb56152d715e9d in 1651ms, sequenceid=24, compaction requested=true 2023-11-19 10:55:12,320 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 637f0b3884286bfcfceb56152d715e9d: 2023-11-19 10:55:12,320 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d. 2023-11-19 10:55:12,320 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-19 10:55:12,320 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-19 10:55:12,320 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:12,320 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-19 10:55:12,320 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-19 10:55:12,322 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:12,322 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-19 10:55:12,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:12,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:12,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:55:12,322 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-19 10:55:12,322 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:55:12,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:12,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:12,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-19 10:55:12,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:12,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:12,324 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-19 10:55:12,324 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4e25b4bd[Count = 0] remaining members to acquire global barrier 2023-11-19 10:55:12,324 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-19 10:55:12,324 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-19 10:55:12,325 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-19 10:55:12,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-19 10:55:12,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-19 10:55:12,325 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-19 10:55:12,325 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-19 10:55:12,325 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:55:12,325 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:12,325 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:55:12,326 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-19 10:55:12,326 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:55:12,326 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:12,326 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-19 10:55:12,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:12,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:12,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:55:12,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:12,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:12,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-19 10:55:12,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:12,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:12,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-19 10:55:12,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:12,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:55:12,329 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-19 10:55:12,329 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-19 10:55:12,330 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:55:12,330 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:55:12,330 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-19 10:55:12,330 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:55:12,332 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-19 10:55:12,332 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-19 10:55:12,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-19 10:55:12,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-19 10:55:12,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:12,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:55:12,332 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:55:12,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-19 10:55:12,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:12,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:55:12,332 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:12,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:55:12,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-19 10:55:12,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-19 10:55:12,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:12,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-19 10:55:12,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:12,334 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:12,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:12,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-19 10:55:12,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:12,335 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:12,335 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-19 10:55:12,335 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-19 10:55:12,336 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:12,336 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:55:12,335 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:55:12,336 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-19 10:55:12,336 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-19 10:55:12,336 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-19 10:55:12,336 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-19 10:55:12,336 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:55:12,336 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-11-19 10:55:12,336 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:55:12,336 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:55:12,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:55:12,336 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-19 10:55:12,336 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:55:12,336 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:55:12,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:55:12,436 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:55:12,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:55:12,438 DEBUG [Listener at localhost/42675] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-19 10:55:12,438 DEBUG [Listener at localhost/42675] regionserver.HStore(1912): 4a83e887540ecadca9444556fadfc332/family1 is initiating major compaction (all files) 2023-11-19 10:55:12,438 INFO [Listener at localhost/42675] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-19 10:55:12,438 INFO [Listener at localhost/42675] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-19 10:55:12,438 INFO [Listener at localhost/42675] regionserver.HRegion(2259): Starting compaction of 4a83e887540ecadca9444556fadfc332/family1 in testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332. 2023-11-19 10:55:12,438 INFO [Listener at localhost/42675] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/0372b9105a144b4a8aaef5a3dc101a63, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/bfcb67f7218c4938aa6226f4b310974c, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/b5f58cf5e2f5425e9430630e361758ce, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/4c5188c6e778445caff4c373976479e9, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/096b2b21fac74661845821396f17bfdc] into tmpdir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/.tmp, totalSize=26.7 K 2023-11-19 10:55:12,439 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting 0372b9105a144b4a8aaef5a3dc101a63, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700391301645 2023-11-19 10:55:12,439 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting bfcb67f7218c4938aa6226f4b310974c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700391303455 2023-11-19 10:55:12,439 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting b5f58cf5e2f5425e9430630e361758ce, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700391304868 2023-11-19 10:55:12,440 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting 4c5188c6e778445caff4c373976479e9, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700391306670 2023-11-19 10:55:12,440 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting 096b2b21fac74661845821396f17bfdc, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-19 10:55:12,451 INFO [Listener at localhost/42675] throttle.PressureAwareThroughputController(145): 4a83e887540ecadca9444556fadfc332#family1#compaction#108 average throughput is 0.85 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-19 10:55:12,859 INFO [Listener at localhost/42675] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023111974ee2e3c327d4774a9ca07cc5493d0ed_del 2023-11-19 10:55:12,859 INFO [Listener at localhost/42675] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023111974ee2e3c327d4774a9ca07cc5493d0ed_del to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023111974ee2e3c327d4774a9ca07cc5493d0ed_del 2023-11-19 10:55:13,672 INFO [Listener at localhost/42675] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2a2a30f328e04a90bc32fc47ec0dda4f 2023-11-19 10:55:13,673 DEBUG [Listener at localhost/42675] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/.tmp/family1/2a2a30f328e04a90bc32fc47ec0dda4f as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/2a2a30f328e04a90bc32fc47ec0dda4f 2023-11-19 10:55:13,677 INFO [Listener at localhost/42675] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2a2a30f328e04a90bc32fc47ec0dda4f 2023-11-19 10:55:13,677 INFO [Listener at localhost/42675] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 4a83e887540ecadca9444556fadfc332/family1 of 4a83e887540ecadca9444556fadfc332 into 2a2a30f328e04a90bc32fc47ec0dda4f(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-19 10:55:13,678 DEBUG [Listener at localhost/42675] regionserver.HRegion(2289): Compaction status journal for 4a83e887540ecadca9444556fadfc332: 2023-11-19 10:55:13,678 DEBUG [Listener at localhost/42675] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-19 10:55:13,678 DEBUG [Listener at localhost/42675] regionserver.HStore(1912): 4a83e887540ecadca9444556fadfc332/family2 is initiating major compaction (all files) 2023-11-19 10:55:13,678 INFO [Listener at localhost/42675] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-19 10:55:13,678 INFO [Listener at localhost/42675] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-19 10:55:13,679 INFO [Listener at localhost/42675] regionserver.HRegion(2259): Starting compaction of 4a83e887540ecadca9444556fadfc332/family2 in testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332. 2023-11-19 10:55:13,679 INFO [Listener at localhost/42675] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family2/d88c375eb41c48309e3230ffee5ac927, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family2/87683fada1bc4361bef06981be006667, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family2/8bfd838e615a4158b81518f03b3d4f70, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family2/bc0941dc9bb04974a011a607c8cd6d95, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family2/b3f34c606cd64cf08e5f0f28505e8534] into tmpdir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/.tmp, totalSize=25.4 K 2023-11-19 10:55:13,679 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting d88c375eb41c48309e3230ffee5ac927, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700391301645 2023-11-19 10:55:13,679 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting 87683fada1bc4361bef06981be006667, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700391303455 2023-11-19 10:55:13,680 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting 8bfd838e615a4158b81518f03b3d4f70, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700391304868 2023-11-19 10:55:13,680 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting bc0941dc9bb04974a011a607c8cd6d95, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700391306670 2023-11-19 10:55:13,680 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting b3f34c606cd64cf08e5f0f28505e8534, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-19 10:55:13,691 INFO [Listener at localhost/42675] throttle.PressureAwareThroughputController(145): 4a83e887540ecadca9444556fadfc332#family2#compaction#109 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-19 10:55:13,727 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/0372b9105a144b4a8aaef5a3dc101a63, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/bfcb67f7218c4938aa6226f4b310974c, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/b5f58cf5e2f5425e9430630e361758ce, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/4c5188c6e778445caff4c373976479e9, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/096b2b21fac74661845821396f17bfdc] to archive 2023-11-19 10:55:13,727 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:55:13,729 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/0372b9105a144b4a8aaef5a3dc101a63 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/0372b9105a144b4a8aaef5a3dc101a63 2023-11-19 10:55:13,730 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/bfcb67f7218c4938aa6226f4b310974c to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/bfcb67f7218c4938aa6226f4b310974c 2023-11-19 10:55:13,730 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/b5f58cf5e2f5425e9430630e361758ce to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/b5f58cf5e2f5425e9430630e361758ce 2023-11-19 10:55:13,731 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/4c5188c6e778445caff4c373976479e9 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/4c5188c6e778445caff4c373976479e9 2023-11-19 10:55:13,732 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/096b2b21fac74661845821396f17bfdc to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/096b2b21fac74661845821396f17bfdc 2023-11-19 10:55:14,099 INFO [Listener at localhost/42675] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231119eff8e4184b3c48bf82e5db89bb5cb1c4_del 2023-11-19 10:55:14,099 INFO [Listener at localhost/42675] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231119eff8e4184b3c48bf82e5db89bb5cb1c4_del to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231119eff8e4184b3c48bf82e5db89bb5cb1c4_del 2023-11-19 10:55:14,912 INFO [Listener at localhost/42675] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 94f75d392e2749db9d025e58c2bf9c05 2023-11-19 10:55:14,913 DEBUG [Listener at localhost/42675] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/.tmp/family2/94f75d392e2749db9d025e58c2bf9c05 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family2/94f75d392e2749db9d025e58c2bf9c05 2023-11-19 10:55:14,917 INFO [Listener at localhost/42675] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 94f75d392e2749db9d025e58c2bf9c05 2023-11-19 10:55:14,918 INFO [Listener at localhost/42675] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 4a83e887540ecadca9444556fadfc332/family2 of 4a83e887540ecadca9444556fadfc332 into 94f75d392e2749db9d025e58c2bf9c05(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-19 10:55:14,918 DEBUG [Listener at localhost/42675] regionserver.HRegion(2289): Compaction status journal for 4a83e887540ecadca9444556fadfc332: 2023-11-19 10:55:14,918 DEBUG [Listener at localhost/42675] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-19 10:55:14,918 DEBUG [Listener at localhost/42675] regionserver.HStore(1912): 3bb6c0b2c9863082d1a21587d98896c0/family1 is initiating major compaction (all files) 2023-11-19 10:55:14,918 INFO [Listener at localhost/42675] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-19 10:55:14,918 INFO [Listener at localhost/42675] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-19 10:55:14,918 INFO [Listener at localhost/42675] regionserver.HRegion(2259): Starting compaction of 3bb6c0b2c9863082d1a21587d98896c0/family1 in testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0. 2023-11-19 10:55:14,918 INFO [Listener at localhost/42675] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/e50fef40dd3c40128bc0fa95885d7dab, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/1a192ccf5c384a4b9227c6be349c1cdb, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/3a6ace9e1d19485c9163859fc4342e66, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/50cfabdebac34a6a88ee5aab65fb8770, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/367c97f7c06d4d0cbe2923acc44ef265] into tmpdir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/.tmp, totalSize=26.7 K 2023-11-19 10:55:14,919 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting e50fef40dd3c40128bc0fa95885d7dab, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700391301646 2023-11-19 10:55:14,919 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting 1a192ccf5c384a4b9227c6be349c1cdb, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700391303455 2023-11-19 10:55:14,920 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting 3a6ace9e1d19485c9163859fc4342e66, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700391304868 2023-11-19 10:55:14,920 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting 50cfabdebac34a6a88ee5aab65fb8770, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700391306670 2023-11-19 10:55:14,921 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting 367c97f7c06d4d0cbe2923acc44ef265, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-19 10:55:14,927 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family2/d88c375eb41c48309e3230ffee5ac927, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family2/87683fada1bc4361bef06981be006667, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family2/8bfd838e615a4158b81518f03b3d4f70, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family2/bc0941dc9bb04974a011a607c8cd6d95, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family2/b3f34c606cd64cf08e5f0f28505e8534] to archive 2023-11-19 10:55:14,927 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:55:14,929 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family2/d88c375eb41c48309e3230ffee5ac927 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family2/d88c375eb41c48309e3230ffee5ac927 2023-11-19 10:55:14,931 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family2/87683fada1bc4361bef06981be006667 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family2/87683fada1bc4361bef06981be006667 2023-11-19 10:55:14,932 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family2/8bfd838e615a4158b81518f03b3d4f70 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family2/8bfd838e615a4158b81518f03b3d4f70 2023-11-19 10:55:14,933 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family2/bc0941dc9bb04974a011a607c8cd6d95 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family2/bc0941dc9bb04974a011a607c8cd6d95 2023-11-19 10:55:14,933 INFO [Listener at localhost/42675] throttle.PressureAwareThroughputController(145): 3bb6c0b2c9863082d1a21587d98896c0#family1#compaction#110 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-19 10:55:14,934 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family2/b3f34c606cd64cf08e5f0f28505e8534 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family2/b3f34c606cd64cf08e5f0f28505e8534 2023-11-19 10:55:15,341 INFO [Listener at localhost/42675] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202311195e2866387034488ba7bdffa43343e981_del 2023-11-19 10:55:15,342 INFO [Listener at localhost/42675] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311195e2866387034488ba7bdffa43343e981_del to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311195e2866387034488ba7bdffa43343e981_del 2023-11-19 10:55:16,156 INFO [Listener at localhost/42675] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 15f16f356d174ad6971d825477e0b68e 2023-11-19 10:55:16,157 DEBUG [Listener at localhost/42675] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/.tmp/family1/15f16f356d174ad6971d825477e0b68e as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/15f16f356d174ad6971d825477e0b68e 2023-11-19 10:55:16,160 INFO [Listener at localhost/42675] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 15f16f356d174ad6971d825477e0b68e 2023-11-19 10:55:16,161 INFO [Listener at localhost/42675] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 3bb6c0b2c9863082d1a21587d98896c0/family1 of 3bb6c0b2c9863082d1a21587d98896c0 into 15f16f356d174ad6971d825477e0b68e(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-19 10:55:16,161 DEBUG [Listener at localhost/42675] regionserver.HRegion(2289): Compaction status journal for 3bb6c0b2c9863082d1a21587d98896c0: 2023-11-19 10:55:16,161 DEBUG [Listener at localhost/42675] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-19 10:55:16,161 DEBUG [Listener at localhost/42675] regionserver.HStore(1912): 3bb6c0b2c9863082d1a21587d98896c0/family2 is initiating major compaction (all files) 2023-11-19 10:55:16,161 INFO [Listener at localhost/42675] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-19 10:55:16,161 INFO [Listener at localhost/42675] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-19 10:55:16,161 INFO [Listener at localhost/42675] regionserver.HRegion(2259): Starting compaction of 3bb6c0b2c9863082d1a21587d98896c0/family2 in testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0. 2023-11-19 10:55:16,161 INFO [Listener at localhost/42675] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family2/5e1ddebf717143dd894f0cda6b80e167, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family2/4845a1ccc26a493ba944c124fee0873d, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family2/65763493d9b84815a761f0299a47abfa, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family2/c628e404e9d6494db8abb403651cbd06, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family2/fa2c8df01f45496cbe3554525ad1ed07] into tmpdir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/.tmp, totalSize=25.4 K 2023-11-19 10:55:16,162 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting 5e1ddebf717143dd894f0cda6b80e167, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700391301646 2023-11-19 10:55:16,162 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting 4845a1ccc26a493ba944c124fee0873d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700391303455 2023-11-19 10:55:16,162 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting 65763493d9b84815a761f0299a47abfa, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700391304868 2023-11-19 10:55:16,162 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting c628e404e9d6494db8abb403651cbd06, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700391306670 2023-11-19 10:55:16,163 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting fa2c8df01f45496cbe3554525ad1ed07, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-19 10:55:16,172 INFO [Listener at localhost/42675] throttle.PressureAwareThroughputController(145): 3bb6c0b2c9863082d1a21587d98896c0#family2#compaction#111 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-19 10:55:16,227 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/e50fef40dd3c40128bc0fa95885d7dab, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/1a192ccf5c384a4b9227c6be349c1cdb, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/3a6ace9e1d19485c9163859fc4342e66, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/50cfabdebac34a6a88ee5aab65fb8770, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/367c97f7c06d4d0cbe2923acc44ef265] to archive 2023-11-19 10:55:16,228 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:55:16,229 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/e50fef40dd3c40128bc0fa95885d7dab to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/e50fef40dd3c40128bc0fa95885d7dab 2023-11-19 10:55:16,230 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/1a192ccf5c384a4b9227c6be349c1cdb to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/1a192ccf5c384a4b9227c6be349c1cdb 2023-11-19 10:55:16,231 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/3a6ace9e1d19485c9163859fc4342e66 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/3a6ace9e1d19485c9163859fc4342e66 2023-11-19 10:55:16,232 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/50cfabdebac34a6a88ee5aab65fb8770 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/50cfabdebac34a6a88ee5aab65fb8770 2023-11-19 10:55:16,233 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/367c97f7c06d4d0cbe2923acc44ef265 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/367c97f7c06d4d0cbe2923acc44ef265 2023-11-19 10:55:16,581 INFO [Listener at localhost/42675] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231119e590ae542d594a848d4db6867f83e9d1_del 2023-11-19 10:55:16,581 INFO [Listener at localhost/42675] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231119e590ae542d594a848d4db6867f83e9d1_del to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231119e590ae542d594a848d4db6867f83e9d1_del 2023-11-19 10:55:17,398 INFO [Listener at localhost/42675] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0ea557d7d3134c18b36dddd547829a99 2023-11-19 10:55:17,399 DEBUG [Listener at localhost/42675] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/.tmp/family2/0ea557d7d3134c18b36dddd547829a99 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family2/0ea557d7d3134c18b36dddd547829a99 2023-11-19 10:55:17,404 INFO [Listener at localhost/42675] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0ea557d7d3134c18b36dddd547829a99 2023-11-19 10:55:17,405 INFO [Listener at localhost/42675] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 3bb6c0b2c9863082d1a21587d98896c0/family2 of 3bb6c0b2c9863082d1a21587d98896c0 into 0ea557d7d3134c18b36dddd547829a99(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-19 10:55:17,405 DEBUG [Listener at localhost/42675] regionserver.HRegion(2289): Compaction status journal for 3bb6c0b2c9863082d1a21587d98896c0: 2023-11-19 10:55:17,405 DEBUG [Listener at localhost/42675] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-19 10:55:17,405 DEBUG [Listener at localhost/42675] regionserver.HStore(1912): 637f0b3884286bfcfceb56152d715e9d/family1 is initiating major compaction (all files) 2023-11-19 10:55:17,405 INFO [Listener at localhost/42675] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-19 10:55:17,405 INFO [Listener at localhost/42675] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-19 10:55:17,405 INFO [Listener at localhost/42675] regionserver.HRegion(2259): Starting compaction of 637f0b3884286bfcfceb56152d715e9d/family1 in testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d. 2023-11-19 10:55:17,406 INFO [Listener at localhost/42675] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/6ce54f57ed0d4ff3be15c835afea0542, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/e6f86413cc15400981952800b7cd63ba, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/ac2fe88928b040f1abd62cc82dd57b34, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/05c787f40212496d9d807f1c78e870dc, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/1d4ee2fb308c460492b4c74cfa21ab56] into tmpdir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/.tmp, totalSize=26.7 K 2023-11-19 10:55:17,406 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting 6ce54f57ed0d4ff3be15c835afea0542, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700391301644 2023-11-19 10:55:17,406 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting e6f86413cc15400981952800b7cd63ba, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700391303455 2023-11-19 10:55:17,409 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting ac2fe88928b040f1abd62cc82dd57b34, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700391304867 2023-11-19 10:55:17,409 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting 05c787f40212496d9d807f1c78e870dc, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700391306670 2023-11-19 10:55:17,409 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting 1d4ee2fb308c460492b4c74cfa21ab56, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-19 10:55:17,424 INFO [Listener at localhost/42675] throttle.PressureAwareThroughputController(145): 637f0b3884286bfcfceb56152d715e9d#family1#compaction#112 average throughput is 0.85 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-19 10:55:17,428 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family2/5e1ddebf717143dd894f0cda6b80e167, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family2/4845a1ccc26a493ba944c124fee0873d, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family2/65763493d9b84815a761f0299a47abfa, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family2/c628e404e9d6494db8abb403651cbd06, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family2/fa2c8df01f45496cbe3554525ad1ed07] to archive 2023-11-19 10:55:17,429 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:55:17,431 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family2/5e1ddebf717143dd894f0cda6b80e167 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family2/5e1ddebf717143dd894f0cda6b80e167 2023-11-19 10:55:17,435 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family2/4845a1ccc26a493ba944c124fee0873d to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family2/4845a1ccc26a493ba944c124fee0873d 2023-11-19 10:55:17,437 INFO [Listener at localhost/42675] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202311196d24fe70ce3849cdabe680768c438e97_del 2023-11-19 10:55:17,438 INFO [Listener at localhost/42675] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311196d24fe70ce3849cdabe680768c438e97_del to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311196d24fe70ce3849cdabe680768c438e97_del 2023-11-19 10:55:17,438 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family2/65763493d9b84815a761f0299a47abfa to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family2/65763493d9b84815a761f0299a47abfa 2023-11-19 10:55:17,442 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family2/c628e404e9d6494db8abb403651cbd06 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family2/c628e404e9d6494db8abb403651cbd06 2023-11-19 10:55:17,443 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family2/fa2c8df01f45496cbe3554525ad1ed07 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family2/fa2c8df01f45496cbe3554525ad1ed07 2023-11-19 10:55:17,879 INFO [Listener at localhost/42675] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3c764cf1370346ccbceb6c88ae028535 2023-11-19 10:55:17,880 DEBUG [Listener at localhost/42675] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/.tmp/family1/3c764cf1370346ccbceb6c88ae028535 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/3c764cf1370346ccbceb6c88ae028535 2023-11-19 10:55:17,884 INFO [Listener at localhost/42675] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3c764cf1370346ccbceb6c88ae028535 2023-11-19 10:55:17,885 INFO [Listener at localhost/42675] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 637f0b3884286bfcfceb56152d715e9d/family1 of 637f0b3884286bfcfceb56152d715e9d into 3c764cf1370346ccbceb6c88ae028535(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-19 10:55:17,886 DEBUG [Listener at localhost/42675] regionserver.HRegion(2289): Compaction status journal for 637f0b3884286bfcfceb56152d715e9d: 2023-11-19 10:55:17,886 DEBUG [Listener at localhost/42675] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-19 10:55:17,886 DEBUG [Listener at localhost/42675] regionserver.HStore(1912): 637f0b3884286bfcfceb56152d715e9d/family2 is initiating major compaction (all files) 2023-11-19 10:55:17,886 INFO [Listener at localhost/42675] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-19 10:55:17,886 INFO [Listener at localhost/42675] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-19 10:55:17,886 INFO [Listener at localhost/42675] regionserver.HRegion(2259): Starting compaction of 637f0b3884286bfcfceb56152d715e9d/family2 in testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d. 2023-11-19 10:55:17,886 INFO [Listener at localhost/42675] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family2/4514248a5e4c40a18c2176148afa3a70, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family2/f110b6db2dc64eeb9eb40bee5be84288, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family2/ba44e63e3aab4a2696e51a294c0e959d, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family2/e2bd97573076422091726d2553c6895e, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family2/e46bb7d3999144c59d1de940d6332479] into tmpdir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/.tmp, totalSize=25.4 K 2023-11-19 10:55:17,887 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting 4514248a5e4c40a18c2176148afa3a70, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700391301644 2023-11-19 10:55:17,887 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting f110b6db2dc64eeb9eb40bee5be84288, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700391303455 2023-11-19 10:55:17,888 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting ba44e63e3aab4a2696e51a294c0e959d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700391304867 2023-11-19 10:55:17,888 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting e2bd97573076422091726d2553c6895e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700391306670 2023-11-19 10:55:17,889 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting e46bb7d3999144c59d1de940d6332479, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-19 10:55:17,917 INFO [Listener at localhost/42675] throttle.PressureAwareThroughputController(145): 637f0b3884286bfcfceb56152d715e9d#family2#compaction#113 average throughput is 0.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-19 10:55:17,927 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/6ce54f57ed0d4ff3be15c835afea0542, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/e6f86413cc15400981952800b7cd63ba, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/ac2fe88928b040f1abd62cc82dd57b34, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/05c787f40212496d9d807f1c78e870dc, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/1d4ee2fb308c460492b4c74cfa21ab56] to archive 2023-11-19 10:55:17,928 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:55:17,929 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/6ce54f57ed0d4ff3be15c835afea0542 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/6ce54f57ed0d4ff3be15c835afea0542 2023-11-19 10:55:17,930 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/e6f86413cc15400981952800b7cd63ba to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/e6f86413cc15400981952800b7cd63ba 2023-11-19 10:55:17,931 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/ac2fe88928b040f1abd62cc82dd57b34 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/ac2fe88928b040f1abd62cc82dd57b34 2023-11-19 10:55:17,932 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/05c787f40212496d9d807f1c78e870dc to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/05c787f40212496d9d807f1c78e870dc 2023-11-19 10:55:17,933 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/1d4ee2fb308c460492b4c74cfa21ab56 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/1d4ee2fb308c460492b4c74cfa21ab56 2023-11-19 10:55:18,332 INFO [Listener at localhost/42675] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231119d998096e07f0417582cff939e85c4e29_del 2023-11-19 10:55:18,332 INFO [Listener at localhost/42675] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231119d998096e07f0417582cff939e85c4e29_del to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231119d998096e07f0417582cff939e85c4e29_del 2023-11-19 10:55:19,149 INFO [Listener at localhost/42675] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 79ad0cea84934aefaa2fe73d1304645c 2023-11-19 10:55:19,150 DEBUG [Listener at localhost/42675] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/.tmp/family2/79ad0cea84934aefaa2fe73d1304645c as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family2/79ad0cea84934aefaa2fe73d1304645c 2023-11-19 10:55:19,154 INFO [Listener at localhost/42675] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 79ad0cea84934aefaa2fe73d1304645c 2023-11-19 10:55:19,155 INFO [Listener at localhost/42675] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 637f0b3884286bfcfceb56152d715e9d/family2 of 637f0b3884286bfcfceb56152d715e9d into 79ad0cea84934aefaa2fe73d1304645c(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-19 10:55:19,155 DEBUG [Listener at localhost/42675] regionserver.HRegion(2289): Compaction status journal for 637f0b3884286bfcfceb56152d715e9d: 2023-11-19 10:55:19,161 DEBUG [Listener at localhost/42675] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-19 10:55:19,165 DEBUG [Listener at localhost/42675] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-19 10:55:19,170 DEBUG [Listener at localhost/42675] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-19 10:55:19,171 DEBUG [Listener at localhost/42675] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-19 10:55:19,184 INFO [Listener at localhost/42675] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-19 10:55:19,227 INFO [Listener at localhost/42675] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-11-19 10:55:19,227 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family2/4514248a5e4c40a18c2176148afa3a70, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family2/f110b6db2dc64eeb9eb40bee5be84288, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family2/ba44e63e3aab4a2696e51a294c0e959d, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family2/e2bd97573076422091726d2553c6895e, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family2/e46bb7d3999144c59d1de940d6332479] to archive 2023-11-19 10:55:19,228 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:55:19,230 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family2/4514248a5e4c40a18c2176148afa3a70 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family2/4514248a5e4c40a18c2176148afa3a70 2023-11-19 10:55:19,231 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family2/f110b6db2dc64eeb9eb40bee5be84288 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family2/f110b6db2dc64eeb9eb40bee5be84288 2023-11-19 10:55:19,232 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family2/ba44e63e3aab4a2696e51a294c0e959d to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family2/ba44e63e3aab4a2696e51a294c0e959d 2023-11-19 10:55:19,233 INFO [Listener at localhost/42675] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202311196d24fe70ce3849cdabe680768c438e97_del 2023-11-19 10:55:19,234 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family2/e2bd97573076422091726d2553c6895e to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family2/e2bd97573076422091726d2553c6895e 2023-11-19 10:55:19,235 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family2/e46bb7d3999144c59d1de940d6332479 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family2/e46bb7d3999144c59d1de940d6332479 2023-11-19 10:55:19,237 INFO [Listener at localhost/42675] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023111974ee2e3c327d4774a9ca07cc5493d0ed_del 2023-11-19 10:55:19,244 INFO [Listener at localhost/42675] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202311195e2866387034488ba7bdffa43343e981_del 2023-11-19 10:55:19,244 INFO [Listener at localhost/42675] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testCompactionWithHFileLink' column='family1' 2023-11-19 10:55:19,245 DEBUG [Listener at localhost/42675] zookeeper.ReadOnlyZKClient(139): Connect 0x08a9b2af to 127.0.0.1:60497 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-19 10:55:19,259 DEBUG [Listener at localhost/42675] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7be1fa8b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-19 10:55:19,260 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231119 for table='testCompactionWithHFileLink' and column='family1' 2023-11-19 10:55:19,260 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231119 for table='testCompactionWithHFileLink' and column='family1' 2023-11-19 10:55:19,264 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231119 for table='testCompactionWithHFileLink' and column='family1' 2023-11-19 10:55:19,396 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311197d23d24f28124f068f2aff76ab2bcb6c to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311197d23d24f28124f068f2aff76ab2bcb6c 2023-11-19 10:55:19,397 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231119 table='testCompactionWithHFileLink' column='family1' 2023-11-19 10:55:19,414 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-19 10:55:19,419 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34284, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-19 10:55:19,429 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-19 10:55:19,431 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50906, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-19 10:55:19,443 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231119/family1/d4b7a4c871554affb0e22c36340d5747 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-11-19 10:55:19,444 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332., hostname=jenkins-hbase4.apache.org,46035,1700391201579, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231119/family1/d4b7a4c871554affb0e22c36340d5747}] 2023-11-19 10:55:19,449 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(763): Validating hfile at hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231119/family1/d4b7a4c871554affb0e22c36340d5747 for inclusion in 4a83e887540ecadca9444556fadfc332/family1 2023-11-19 10:55:19,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-11-19 10:55:19,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-19 10:55:19,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegion(2446): Flush status journal for 4a83e887540ecadca9444556fadfc332: 2023-11-19 10:55:19,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231119/family1/d4b7a4c871554affb0e22c36340d5747 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testCompactionWithHFileLink__rk4062m59itmmmvtsqibit2t6k8o1ldjvbam5h648ocpgkk7pa6mocj9bs9buotf/family1/d4b7a4c871554affb0e22c36340d5747 2023-11-19 10:55:19,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testCompactionWithHFileLink__rk4062m59itmmmvtsqibit2t6k8o1ldjvbam5h648ocpgkk7pa6mocj9bs9buotf/family1/d4b7a4c871554affb0e22c36340d5747 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/f770c1060c204996a805b9e3f91fd832_SeqId_29_ 2023-11-19 10:55:19,454 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(849): Loaded HFile hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testCompactionWithHFileLink__rk4062m59itmmmvtsqibit2t6k8o1ldjvbam5h648ocpgkk7pa6mocj9bs9buotf/family1/d4b7a4c871554affb0e22c36340d5747 into 4a83e887540ecadca9444556fadfc332/family1 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/f770c1060c204996a805b9e3f91fd832_SeqId_29_ - updating store file list. 2023-11-19 10:55:19,457 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(882): Loaded HFile hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/f770c1060c204996a805b9e3f91fd832_SeqId_29_ into 4a83e887540ecadca9444556fadfc332/family1 2023-11-19 10:55:19,457 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(855): Successfully loaded hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testCompactionWithHFileLink__rk4062m59itmmmvtsqibit2t6k8o1ldjvbam5h648ocpgkk7pa6mocj9bs9buotf/family1/d4b7a4c871554affb0e22c36340d5747 into 4a83e887540ecadca9444556fadfc332/family1 (new location: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/f770c1060c204996a805b9e3f91fd832_SeqId_29_) 2023-11-19 10:55:19,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testCompactionWithHFileLink__rk4062m59itmmmvtsqibit2t6k8o1ldjvbam5h648ocpgkk7pa6mocj9bs9buotf/family1/d4b7a4c871554affb0e22c36340d5747 2023-11-19 10:55:19,459 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231119 table='testCompactionWithHFileLink' column='family1' 2023-11-19 10:55:19,460 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:55:19,461 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023111941569f188b6f438a9805fe018e660ff6 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023111941569f188b6f438a9805fe018e660ff6 2023-11-19 10:55:19,462 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311197c4d4dbcefaf4730a6b094a06d1a1610 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311197c4d4dbcefaf4730a6b094a06d1a1610 2023-11-19 10:55:19,463 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231119ad49a6e2e2f04861aa39bb7d1c84a9d1 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231119ad49a6e2e2f04861aa39bb7d1c84a9d1 2023-11-19 10:55:19,464 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231119d36e7f2d34364bdc8fb49339fb2de294 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231119d36e7f2d34364bdc8fb49339fb2de294 2023-11-19 10:55:19,465 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-19 10:55:19,465 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231119' 2023-11-19 10:55:19,465 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231119 for table='testCompactionWithHFileLink' and column='family1' 2023-11-19 10:55:20,195 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311194f2fc27bdb764fda8f75977af512d400 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311194f2fc27bdb764fda8f75977af512d400 2023-11-19 10:55:20,196 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231119970f730fdaab4742aead5e42f13cb199 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231119970f730fdaab4742aead5e42f13cb199 2023-11-19 10:55:20,196 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231119 table='testCompactionWithHFileLink' column='family1' 2023-11-19 10:55:20,197 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231119 table='testCompactionWithHFileLink' column='family1' 2023-11-19 10:55:20,224 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231119/family1/e413d428ca474ee3b54286390c6b13eb first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-11-19 10:55:20,224 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231119/family1/b69c90748ca641b4b3a82b04fd47fd60 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-11-19 10:55:20,227 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0., hostname=jenkins-hbase4.apache.org,46035,1700391201579, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231119/family1/b69c90748ca641b4b3a82b04fd47fd60}] 2023-11-19 10:55:20,227 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d., hostname=jenkins-hbase4.apache.org,46035,1700391201579, seqNum=2 for row with hfile group [{family1,hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231119/family1/e413d428ca474ee3b54286390c6b13eb}] 2023-11-19 10:55:20,229 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46035] regionserver.HStore(763): Validating hfile at hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231119/family1/b69c90748ca641b4b3a82b04fd47fd60 for inclusion in 3bb6c0b2c9863082d1a21587d98896c0/family1 2023-11-19 10:55:20,230 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(763): Validating hfile at hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231119/family1/e413d428ca474ee3b54286390c6b13eb for inclusion in 637f0b3884286bfcfceb56152d715e9d/family1 2023-11-19 10:55:20,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46035] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-11-19 10:55:20,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46035] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-19 10:55:20,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46035] regionserver.HRegion(2446): Flush status journal for 3bb6c0b2c9863082d1a21587d98896c0: 2023-11-19 10:55:20,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46035] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231119/family1/b69c90748ca641b4b3a82b04fd47fd60 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testCompactionWithHFileLink__va5t4k1raadkeonaloqmab9r4nmnu377vdp8mrn4uqom6h6un8c023jcdmkbhipq/family1/b69c90748ca641b4b3a82b04fd47fd60 2023-11-19 10:55:20,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-11-19 10:55:20,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(777): Region bounds: first= last=1 2023-11-19 10:55:20,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegion(2446): Flush status journal for 637f0b3884286bfcfceb56152d715e9d: 2023-11-19 10:55:20,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231119/family1/e413d428ca474ee3b54286390c6b13eb to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testCompactionWithHFileLink__rgoge1c7otfb0sotpt3o67hqd00tugogcm57age4qhgnhbo5jkh8ahidhfi2qr2t/family1/e413d428ca474ee3b54286390c6b13eb 2023-11-19 10:55:20,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46035] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testCompactionWithHFileLink__va5t4k1raadkeonaloqmab9r4nmnu377vdp8mrn4uqom6h6un8c023jcdmkbhipq/family1/b69c90748ca641b4b3a82b04fd47fd60 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/4bef3d9e6f2a4aebb579e1eff1be7a37_SeqId_29_ 2023-11-19 10:55:20,239 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46035] regionserver.HStore(849): Loaded HFile hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testCompactionWithHFileLink__va5t4k1raadkeonaloqmab9r4nmnu377vdp8mrn4uqom6h6un8c023jcdmkbhipq/family1/b69c90748ca641b4b3a82b04fd47fd60 into 3bb6c0b2c9863082d1a21587d98896c0/family1 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/4bef3d9e6f2a4aebb579e1eff1be7a37_SeqId_29_ - updating store file list. 2023-11-19 10:55:20,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testCompactionWithHFileLink__rgoge1c7otfb0sotpt3o67hqd00tugogcm57age4qhgnhbo5jkh8ahidhfi2qr2t/family1/e413d428ca474ee3b54286390c6b13eb as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/24a35227514149debce40818ef455be4_SeqId_29_ 2023-11-19 10:55:20,243 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(849): Loaded HFile hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testCompactionWithHFileLink__rgoge1c7otfb0sotpt3o67hqd00tugogcm57age4qhgnhbo5jkh8ahidhfi2qr2t/family1/e413d428ca474ee3b54286390c6b13eb into 637f0b3884286bfcfceb56152d715e9d/family1 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/24a35227514149debce40818ef455be4_SeqId_29_ - updating store file list. 2023-11-19 10:55:20,243 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46035] regionserver.HStore(882): Loaded HFile hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/4bef3d9e6f2a4aebb579e1eff1be7a37_SeqId_29_ into 3bb6c0b2c9863082d1a21587d98896c0/family1 2023-11-19 10:55:20,243 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46035] regionserver.HStore(855): Successfully loaded hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testCompactionWithHFileLink__va5t4k1raadkeonaloqmab9r4nmnu377vdp8mrn4uqom6h6un8c023jcdmkbhipq/family1/b69c90748ca641b4b3a82b04fd47fd60 into 3bb6c0b2c9863082d1a21587d98896c0/family1 (new location: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/4bef3d9e6f2a4aebb579e1eff1be7a37_SeqId_29_) 2023-11-19 10:55:20,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46035] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testCompactionWithHFileLink__va5t4k1raadkeonaloqmab9r4nmnu377vdp8mrn4uqom6h6un8c023jcdmkbhipq/family1/b69c90748ca641b4b3a82b04fd47fd60 2023-11-19 10:55:20,248 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(882): Loaded HFile hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/24a35227514149debce40818ef455be4_SeqId_29_ into 637f0b3884286bfcfceb56152d715e9d/family1 2023-11-19 10:55:20,248 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(855): Successfully loaded hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testCompactionWithHFileLink__rgoge1c7otfb0sotpt3o67hqd00tugogcm57age4qhgnhbo5jkh8ahidhfi2qr2t/family1/e413d428ca474ee3b54286390c6b13eb into 637f0b3884286bfcfceb56152d715e9d/family1 (new location: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/24a35227514149debce40818ef455be4_SeqId_29_) 2023-11-19 10:55:20,248 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231119 table='testCompactionWithHFileLink' column='family1' 2023-11-19 10:55:20,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testCompactionWithHFileLink__rgoge1c7otfb0sotpt3o67hqd00tugogcm57age4qhgnhbo5jkh8ahidhfi2qr2t/family1/e413d428ca474ee3b54286390c6b13eb 2023-11-19 10:55:20,249 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:55:20,251 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231119 table='testCompactionWithHFileLink' column='family1' 2023-11-19 10:55:20,252 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311194d02a0bf91464cde99c2cf0119bd6cac to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311194d02a0bf91464cde99c2cf0119bd6cac 2023-11-19 10:55:20,252 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:55:20,253 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311196239bac53d134db79a5c84de2f7daf56 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311196239bac53d134db79a5c84de2f7daf56 2023-11-19 10:55:20,254 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311190980babcd5a04424bddc05cf5c3462ea to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311190980babcd5a04424bddc05cf5c3462ea 2023-11-19 10:55:20,255 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311198762411ff2534743bb3aefeef885cc70 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311198762411ff2534743bb3aefeef885cc70 2023-11-19 10:55:20,256 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311192bf23f9cf93e47bcb5dff8874611341c to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311192bf23f9cf93e47bcb5dff8874611341c 2023-11-19 10:55:20,256 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231119ef0f22069d204985939432fd3e807d7c to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231119ef0f22069d204985939432fd3e807d7c 2023-11-19 10:55:20,256 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-19 10:55:20,256 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231119' 2023-11-19 10:55:20,257 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231119 for table='testCompactionWithHFileLink' and column='family1' 2023-11-19 10:55:20,257 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231119a597da2e193f44fcb76cc5cae46d94d0 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231119a597da2e193f44fcb76cc5cae46d94d0 2023-11-19 10:55:20,259 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231119a8af52671e4e4cb4bbc0dbbc1e850e3c to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231119a8af52671e4e4cb4bbc0dbbc1e850e3c 2023-11-19 10:55:20,259 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-19 10:55:20,259 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231119' 2023-11-19 10:55:20,259 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231119 for table='testCompactionWithHFileLink' and column='family1' 2023-11-19 10:55:20,259 INFO [Listener at localhost/42675] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-11-19 10:55:20,259 INFO [Listener at localhost/42675] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testCompactionWithHFileLink' and column='family1' 2023-11-19 10:55:20,260 INFO [Listener at localhost/42675] compactions.PartitionedMobCompactor(367): [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311196d24fe70ce3849cdabe680768c438e97_del] 2023-11-19 10:55:20,260 DEBUG [Listener at localhost/42675] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:55:20,262 DEBUG [Listener at localhost/42675] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311196d24fe70ce3849cdabe680768c438e97_del to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311196d24fe70ce3849cdabe680768c438e97_del 2023-11-19 10:55:20,262 INFO [Listener at localhost/42675] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-11-19 10:55:20,262 INFO [Listener at localhost/42675] compactions.PartitionedMobCompactor(367): [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023111974ee2e3c327d4774a9ca07cc5493d0ed_del] 2023-11-19 10:55:20,262 DEBUG [Listener at localhost/42675] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:55:20,264 DEBUG [Listener at localhost/42675] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023111974ee2e3c327d4774a9ca07cc5493d0ed_del to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023111974ee2e3c327d4774a9ca07cc5493d0ed_del 2023-11-19 10:55:20,264 INFO [Listener at localhost/42675] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-11-19 10:55:20,264 INFO [Listener at localhost/42675] compactions.PartitionedMobCompactor(367): [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311195e2866387034488ba7bdffa43343e981_del] 2023-11-19 10:55:20,265 DEBUG [Listener at localhost/42675] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:55:20,266 DEBUG [Listener at localhost/42675] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311195e2866387034488ba7bdffa43343e981_del to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311195e2866387034488ba7bdffa43343e981_del 2023-11-19 10:55:20,266 INFO [Listener at localhost/42675] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-11-19 10:55:20,269 DEBUG [Listener at localhost/42675] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-19 10:55:20,271 DEBUG [Listener at localhost/42675] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-19 10:55:20,278 DEBUG [Listener at localhost/42675] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-19 10:55:20,279 DEBUG [Listener at localhost/42675] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-19 10:55:20,287 INFO [Listener at localhost/42675] client.HBaseAdmin$15(890): Started disable of testCompactionWithHFileLink 2023-11-19 10:55:20,287 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testCompactionWithHFileLink 2023-11-19 10:55:20,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] procedure2.ProcedureExecutor(1028): Stored pid=88, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testCompactionWithHFileLink 2023-11-19 10:55:20,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-11-19 10:55:20,290 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700391320290"}]},"ts":"1700391320290"} 2023-11-19 10:55:20,292 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLING in hbase:meta 2023-11-19 10:55:20,294 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testCompactionWithHFileLink to state=DISABLING 2023-11-19 10:55:20,295 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=637f0b3884286bfcfceb56152d715e9d, UNASSIGN}, {pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=4a83e887540ecadca9444556fadfc332, UNASSIGN}, {pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=3bb6c0b2c9863082d1a21587d98896c0, UNASSIGN}] 2023-11-19 10:55:20,296 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=637f0b3884286bfcfceb56152d715e9d, UNASSIGN 2023-11-19 10:55:20,296 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=4a83e887540ecadca9444556fadfc332, UNASSIGN 2023-11-19 10:55:20,296 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=3bb6c0b2c9863082d1a21587d98896c0, UNASSIGN 2023-11-19 10:55:20,297 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=637f0b3884286bfcfceb56152d715e9d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:20,297 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700391320297"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700391320297"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700391320297"}]},"ts":"1700391320297"} 2023-11-19 10:55:20,297 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=4a83e887540ecadca9444556fadfc332, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:20,297 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=3bb6c0b2c9863082d1a21587d98896c0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:20,297 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700391320297"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700391320297"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700391320297"}]},"ts":"1700391320297"} 2023-11-19 10:55:20,297 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700391320297"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700391320297"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700391320297"}]},"ts":"1700391320297"} 2023-11-19 10:55:20,298 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=92, ppid=89, state=RUNNABLE; CloseRegionProcedure 637f0b3884286bfcfceb56152d715e9d, server=jenkins-hbase4.apache.org,46035,1700391201579}] 2023-11-19 10:55:20,299 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=90, state=RUNNABLE; CloseRegionProcedure 4a83e887540ecadca9444556fadfc332, server=jenkins-hbase4.apache.org,46035,1700391201579}] 2023-11-19 10:55:20,299 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; CloseRegionProcedure 3bb6c0b2c9863082d1a21587d98896c0, server=jenkins-hbase4.apache.org,46035,1700391201579}] 2023-11-19 10:55:20,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-11-19 10:55:20,450 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:20,451 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 637f0b3884286bfcfceb56152d715e9d 2023-11-19 10:55:20,451 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 637f0b3884286bfcfceb56152d715e9d, disabling compactions & flushes 2023-11-19 10:55:20,451 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d. 2023-11-19 10:55:20,451 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d. 2023-11-19 10:55:20,451 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d. after waiting 0 ms 2023-11-19 10:55:20,451 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d. 2023-11-19 10:55:20,456 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-11-19 10:55:20,457 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d. 2023-11-19 10:55:20,457 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 637f0b3884286bfcfceb56152d715e9d: 2023-11-19 10:55:20,458 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 637f0b3884286bfcfceb56152d715e9d 2023-11-19 10:55:20,459 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 3bb6c0b2c9863082d1a21587d98896c0 2023-11-19 10:55:20,459 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3bb6c0b2c9863082d1a21587d98896c0, disabling compactions & flushes 2023-11-19 10:55:20,459 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0. 2023-11-19 10:55:20,459 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0. 2023-11-19 10:55:20,459 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0. after waiting 0 ms 2023-11-19 10:55:20,459 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0. 2023-11-19 10:55:20,459 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=637f0b3884286bfcfceb56152d715e9d, regionState=CLOSED 2023-11-19 10:55:20,459 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700391320459"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700391320459"}]},"ts":"1700391320459"} 2023-11-19 10:55:20,462 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=92, resume processing ppid=89 2023-11-19 10:55:20,462 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=89, state=SUCCESS; CloseRegionProcedure 637f0b3884286bfcfceb56152d715e9d, server=jenkins-hbase4.apache.org,46035,1700391201579 in 163 msec 2023-11-19 10:55:20,462 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-11-19 10:55:20,464 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0. 2023-11-19 10:55:20,464 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3bb6c0b2c9863082d1a21587d98896c0: 2023-11-19 10:55:20,464 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=89, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=637f0b3884286bfcfceb56152d715e9d, UNASSIGN in 167 msec 2023-11-19 10:55:20,465 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 3bb6c0b2c9863082d1a21587d98896c0 2023-11-19 10:55:20,465 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4a83e887540ecadca9444556fadfc332 2023-11-19 10:55:20,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4a83e887540ecadca9444556fadfc332, disabling compactions & flushes 2023-11-19 10:55:20,465 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332. 2023-11-19 10:55:20,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332. 2023-11-19 10:55:20,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332. after waiting 0 ms 2023-11-19 10:55:20,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332. 2023-11-19 10:55:20,465 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=3bb6c0b2c9863082d1a21587d98896c0, regionState=CLOSED 2023-11-19 10:55:20,465 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700391320465"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700391320465"}]},"ts":"1700391320465"} 2023-11-19 10:55:20,468 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=91 2023-11-19 10:55:20,468 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=91, state=SUCCESS; CloseRegionProcedure 3bb6c0b2c9863082d1a21587d98896c0, server=jenkins-hbase4.apache.org,46035,1700391201579 in 167 msec 2023-11-19 10:55:20,469 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-11-19 10:55:20,469 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=3bb6c0b2c9863082d1a21587d98896c0, UNASSIGN in 173 msec 2023-11-19 10:55:20,470 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332. 2023-11-19 10:55:20,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4a83e887540ecadca9444556fadfc332: 2023-11-19 10:55:20,471 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4a83e887540ecadca9444556fadfc332 2023-11-19 10:55:20,471 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=4a83e887540ecadca9444556fadfc332, regionState=CLOSED 2023-11-19 10:55:20,471 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700391320471"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700391320471"}]},"ts":"1700391320471"} 2023-11-19 10:55:20,473 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=90 2023-11-19 10:55:20,473 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=90, state=SUCCESS; CloseRegionProcedure 4a83e887540ecadca9444556fadfc332, server=jenkins-hbase4.apache.org,46035,1700391201579 in 173 msec 2023-11-19 10:55:20,474 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=90, resume processing ppid=88 2023-11-19 10:55:20,474 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=90, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=4a83e887540ecadca9444556fadfc332, UNASSIGN in 178 msec 2023-11-19 10:55:20,475 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700391320475"}]},"ts":"1700391320475"} 2023-11-19 10:55:20,476 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLED in hbase:meta 2023-11-19 10:55:20,477 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testCompactionWithHFileLink to state=DISABLED 2023-11-19 10:55:20,479 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=88, state=SUCCESS; DisableTableProcedure table=testCompactionWithHFileLink in 191 msec 2023-11-19 10:55:20,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-11-19 10:55:20,593 INFO [Listener at localhost/42675] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testCompactionWithHFileLink, procId: 88 completed 2023-11-19 10:55:20,605 INFO [Listener at localhost/42675] client.HBaseAdmin(2586): Taking restore-failsafe snapshot: hbase-failsafe-snaptb-1700391308470-1700391320605 2023-11-19 10:55:20,606 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=hbase-failsafe-snaptb-1700391308470-1700391320605 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-19 10:55:20,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1700391320606 (current time:1700391320606). 2023-11-19 10:55:20,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-11-19 10:55:20,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] zookeeper.ReadOnlyZKClient(139): Connect 0x51efa2db to 127.0.0.1:60497 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-19 10:55:20,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@42a34083, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-19 10:55:20,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-19 10:55:20,618 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34286, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-19 10:55:20,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x51efa2db to 127.0.0.1:60497 2023-11-19 10:55:20,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-19 10:55:20,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-11-19 10:55:20,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] snapshot.SnapshotManager(695): Table is disabled, running snapshot entirely on master for { ss=hbase-failsafe-snaptb-1700391308470-1700391320605 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-19 10:55:20,621 WARN [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.hbase-snapshot, current working dir path: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1700391308470-1700391320605 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotDisabledTable(SnapshotManager.java:541) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:698) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-11-19 10:55:20,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-19 10:55:20,623 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-19 10:55:20,624 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1700391920624 2023-11-19 10:55:20,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] snapshot.SnapshotManager(700): Started snapshot: { ss=hbase-failsafe-snaptb-1700391308470-1700391320605 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-19 10:55:20,624 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running DISABLED table snapshot hbase-failsafe-snaptb-1700391308470-1700391320605 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-11-19 10:55:20,624 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase-failsafe-snaptb-1700391308470-1700391320605 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-11-19 10:55:20,624 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-11-19 10:55:20,725 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-19 10:55:20,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1700391308470-1700391320605 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-19 10:55:20,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1700391308470-1700391320605 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-19 10:55:20,726 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-11-19 10:55:20,926 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-19 10:55:20,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1700391308470-1700391320605 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-19 10:55:20,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1700391308470-1700391320605 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-19 10:55:20,928 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-11-19 10:55:21,031 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.DisabledTableSnapshotHandler(97): Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1700391308470-1700391320605 table=testCompactionWithHFileLink type=DISABLED ttl=0 } 2023-11-19 10:55:21,033 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-19 10:55:21,033 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-19 10:55:21,033 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-19 10:55:21,033 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-19 10:55:21,033 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-19 10:55:21,033 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-19 10:55:21,033 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-19 10:55:21,033 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-19 10:55:21,036 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/24a35227514149debce40818ef455be4_SeqId_29_, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/3c764cf1370346ccbceb6c88ae028535] hfiles 2023-11-19 10:55:21,036 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/24a35227514149debce40818ef455be4_SeqId_29_ 2023-11-19 10:55:21,036 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/2a2a30f328e04a90bc32fc47ec0dda4f, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/f770c1060c204996a805b9e3f91fd832_SeqId_29_] hfiles 2023-11-19 10:55:21,036 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/3c764cf1370346ccbceb6c88ae028535 2023-11-19 10:55:21,036 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/2a2a30f328e04a90bc32fc47ec0dda4f 2023-11-19 10:55:21,036 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/15f16f356d174ad6971d825477e0b68e, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/4bef3d9e6f2a4aebb579e1eff1be7a37_SeqId_29_] hfiles 2023-11-19 10:55:21,036 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/f770c1060c204996a805b9e3f91fd832_SeqId_29_ 2023-11-19 10:55:21,037 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/15f16f356d174ad6971d825477e0b68e 2023-11-19 10:55:21,037 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/4bef3d9e6f2a4aebb579e1eff1be7a37_SeqId_29_ 2023-11-19 10:55:21,037 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311197d23d24f28124f068f2aff76ab2bcb6c, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231119970f730fdaab4742aead5e42f13cb199, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311194f2fc27bdb764fda8f75977af512d400] hfiles 2023-11-19 10:55:21,037 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/3): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311197d23d24f28124f068f2aff76ab2bcb6c 2023-11-19 10:55:21,037 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/3): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231119970f730fdaab4742aead5e42f13cb199 2023-11-19 10:55:21,037 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (3/3): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311194f2fc27bdb764fda8f75977af512d400 2023-11-19 10:55:21,038 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family2/79ad0cea84934aefaa2fe73d1304645c] hfiles 2023-11-19 10:55:21,038 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family2/79ad0cea84934aefaa2fe73d1304645c 2023-11-19 10:55:21,038 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family2/94f75d392e2749db9d025e58c2bf9c05] hfiles 2023-11-19 10:55:21,038 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family2/94f75d392e2749db9d025e58c2bf9c05 2023-11-19 10:55:21,038 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family2/0ea557d7d3134c18b36dddd547829a99] hfiles 2023-11-19 10:55:21,038 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family2/0ea557d7d3134c18b36dddd547829a99 2023-11-19 10:55:21,045 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023111924ebccfaae33428b85a4315ff54c382c, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023111955a42fdbce5b479dbb0d2c04d8b5cd31, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311197fa17086a2924b7587f689ed4404b312, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231119bea3fe6087dd4568aad3f9266b1da482, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231119eff8e4184b3c48bf82e5db89bb5cb1c4_del, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311192c908dd4a8304c60afcf7867653e1d26, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311195b8670b102fc4b909cbe489ae0a66395, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311199c132e83723846f08c79fc6a7b3e7296, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231119e590ae542d594a848d4db6867f83e9d1_del, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231119f5d6a458d10a4d5b966a6a4248c301d3, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231119292a84ddcfbe4b3aae81c253546b6ac0, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023111951cd1c0b130e4709a801f87037625642, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231119c4b422c32dac47a1910bcd923fbeab81, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231119d998096e07f0417582cff939e85c4e29_del, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231119da78e20f10184426ae754ff38533b694] hfiles 2023-11-19 10:55:21,045 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/15): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023111924ebccfaae33428b85a4315ff54c382c 2023-11-19 10:55:21,045 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/15): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023111955a42fdbce5b479dbb0d2c04d8b5cd31 2023-11-19 10:55:21,045 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (3/15): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311197fa17086a2924b7587f689ed4404b312 2023-11-19 10:55:21,045 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (4/15): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231119bea3fe6087dd4568aad3f9266b1da482 2023-11-19 10:55:21,045 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (5/15): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231119eff8e4184b3c48bf82e5db89bb5cb1c4_del 2023-11-19 10:55:21,045 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (6/15): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311192c908dd4a8304c60afcf7867653e1d26 2023-11-19 10:55:21,045 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (7/15): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311195b8670b102fc4b909cbe489ae0a66395 2023-11-19 10:55:21,045 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (8/15): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311199c132e83723846f08c79fc6a7b3e7296 2023-11-19 10:55:21,045 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (9/15): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231119e590ae542d594a848d4db6867f83e9d1_del 2023-11-19 10:55:21,046 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (10/15): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231119f5d6a458d10a4d5b966a6a4248c301d3 2023-11-19 10:55:21,046 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (11/15): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231119292a84ddcfbe4b3aae81c253546b6ac0 2023-11-19 10:55:21,046 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (12/15): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023111951cd1c0b130e4709a801f87037625642 2023-11-19 10:55:21,046 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (13/15): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231119c4b422c32dac47a1910bcd923fbeab81 2023-11-19 10:55:21,046 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (14/15): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231119d998096e07f0417582cff939e85c4e29_del 2023-11-19 10:55:21,046 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (15/15): hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231119da78e20f10184426ae754ff38533b694 2023-11-19 10:55:21,228 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-19 10:55:21,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1700391308470-1700391320605 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-19 10:55:21,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1700391308470-1700391320605 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-19 10:55:21,229 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-11-19 10:55:21,444 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.DisabledTableSnapshotHandler(120): Marking snapshot{ ss=hbase-failsafe-snaptb-1700391308470-1700391320605 table=testCompactionWithHFileLink type=DISABLED ttl=0 } as finished. 2023-11-19 10:55:21,444 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase-failsafe-snaptb-1700391308470-1700391320605 2023-11-19 10:55:21,445 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1700391308470-1700391320605 2023-11-19 10:55:21,480 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1700391308470-1700391320605 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.hbase-snapshot/hbase-failsafe-snaptb-1700391308470-1700391320605 2023-11-19 10:55:21,481 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase-failsafe-snaptb-1700391308470-1700391320605 of table testCompactionWithHFileLink completed 2023-11-19 10:55:21,481 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1700391308470-1700391320605 2023-11-19 10:55:21,481 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1700391308470-1700391320605 2023-11-19 10:55:21,481 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running DISABLED table snapshot hbase-failsafe-snaptb-1700391308470-1700391320605 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1700391320624Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1700391308470-1700391320605 table=testCompactionWithHFileLink type=DISABLED ttl=0 } at 1700391321031 (+407 ms)Consolidate snapshot: hbase-failsafe-snaptb-1700391308470-1700391320605 at 1700391321444 (+413 ms)Loading Region manifests for hbase-failsafe-snaptb-1700391308470-1700391320605 at 1700391321444Writing data manifest for hbase-failsafe-snaptb-1700391308470-1700391320605 at 1700391321447 (+3 ms)Verifying snapshot: hbase-failsafe-snaptb-1700391308470-1700391320605 at 1700391321457 (+10 ms)Snapshot hbase-failsafe-snaptb-1700391308470-1700391320605 of table testCompactionWithHFileLink completed at 1700391321481 (+24 ms) 2023-11-19 10:55:21,483 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-19 10:55:21,484 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 861 msec 2023-11-19 10:55:21,729 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-19 10:55:21,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1700391308470-1700391320605 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-19 10:55:21,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] snapshot.SnapshotManager(403): Snapshot '{ ss=hbase-failsafe-snaptb-1700391308470-1700391320605 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-11-19 10:55:21,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE:RESTORE_SNAPSHOT_PRE_OPERATION; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1700391308470" table: "testCompactionWithHFileLink" creation_time: 1700391308480 type: FLUSH version: 2 ttl: 0 ) 2023-11-19 10:55:21,778 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] snapshot.SnapshotManager(916): Restore snapshot=snaptb-1700391308470 as table=testCompactionWithHFileLink 2023-11-19 10:55:21,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-19 10:55:21,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-19 10:55:22,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-19 10:55:22,188 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-11-19 10:55:22,189 DEBUG [PEWorker-4] util.FSTableDescriptors(519): Deleted hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-11-19 10:55:22,189 INFO [PEWorker-4] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-11-19 10:55:22,190 INFO [PEWorker-4] procedure.RestoreSnapshotProcedure(384): Starting restore snapshot={ ss=snaptb-1700391308470 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-19 10:55:22,195 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "snaptb-1700391308470" table: "testCompactionWithHFileLink" creation_time: 1700391308480 type: FLUSH version: 2 ttl: 0 2023-11-19 10:55:22,195 DEBUG [PEWorker-4] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink 2023-11-19 10:55:22,200 DEBUG [PEWorker-4] snapshot.RestoreSnapshotHelper(797): found 3 regions for table=testCompactionWithHFileLink 2023-11-19 10:55:22,204 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311197d23d24f28124f068f2aff76ab2bcb6c to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311197d23d24f28124f068f2aff76ab2bcb6c 2023-11-19 10:55:22,205 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231119970f730fdaab4742aead5e42f13cb199 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231119970f730fdaab4742aead5e42f13cb199 2023-11-19 10:55:22,206 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311194f2fc27bdb764fda8f75977af512d400 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311194f2fc27bdb764fda8f75977af512d400 2023-11-19 10:55:22,206 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b2023111941569f188b6f438a9805fe018e660ff6 of snapshot=snaptb-1700391308470 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-19 10:55:22,210 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b202311197c4d4dbcefaf4730a6b094a06d1a1610 of snapshot=snaptb-1700391308470 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-19 10:55:22,213 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20231119ad49a6e2e2f04861aa39bb7d1c84a9d1 of snapshot=snaptb-1700391308470 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-19 10:55:22,215 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20231119d36e7f2d34364bdc8fb49339fb2de294 of snapshot=snaptb-1700391308470 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-19 10:55:22,218 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202311194d02a0bf91464cde99c2cf0119bd6cac of snapshot=snaptb-1700391308470 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-19 10:55:22,221 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202311196239bac53d134db79a5c84de2f7daf56 of snapshot=snaptb-1700391308470 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-19 10:55:22,224 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202311198762411ff2534743bb3aefeef885cc70 of snapshot=snaptb-1700391308470 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-19 10:55:22,226 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20231119ef0f22069d204985939432fd3e807d7c of snapshot=snaptb-1700391308470 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-19 10:55:22,229 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202311190980babcd5a04424bddc05cf5c3462ea of snapshot=snaptb-1700391308470 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-19 10:55:22,232 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202311192bf23f9cf93e47bcb5dff8874611341c of snapshot=snaptb-1700391308470 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-19 10:55:22,235 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20231119a597da2e193f44fcb76cc5cae46d94d0 of snapshot=snaptb-1700391308470 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-19 10:55:22,238 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20231119a8af52671e4e4cb4bbc0dbbc1e850e3c of snapshot=snaptb-1700391308470 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-19 10:55:22,243 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231119e590ae542d594a848d4db6867f83e9d1_del to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231119e590ae542d594a848d4db6867f83e9d1_del 2023-11-19 10:55:22,244 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231119eff8e4184b3c48bf82e5db89bb5cb1c4_del to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231119eff8e4184b3c48bf82e5db89bb5cb1c4_del 2023-11-19 10:55:22,245 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231119d998096e07f0417582cff939e85c4e29_del to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231119d998096e07f0417582cff939e85c4e29_del 2023-11-19 10:55:22,245 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(223): region to restore: 3bb6c0b2c9863082d1a21587d98896c0 2023-11-19 10:55:22,245 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(223): region to restore: 4a83e887540ecadca9444556fadfc332 2023-11-19 10:55:22,245 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(223): region to restore: 637f0b3884286bfcfceb56152d715e9d 2023-11-19 10:55:22,249 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/15f16f356d174ad6971d825477e0b68e to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/15f16f356d174ad6971d825477e0b68e 2023-11-19 10:55:22,249 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/24a35227514149debce40818ef455be4_SeqId_29_ to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/24a35227514149debce40818ef455be4_SeqId_29_ 2023-11-19 10:55:22,250 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/f770c1060c204996a805b9e3f91fd832_SeqId_29_ to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/f770c1060c204996a805b9e3f91fd832_SeqId_29_ 2023-11-19 10:55:22,250 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/4bef3d9e6f2a4aebb579e1eff1be7a37_SeqId_29_ to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/4bef3d9e6f2a4aebb579e1eff1be7a37_SeqId_29_ 2023-11-19 10:55:22,250 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink e50fef40dd3c40128bc0fa95885d7dab of snapshot=snaptb-1700391308470 to region=3bb6c0b2c9863082d1a21587d98896c0 table=testCompactionWithHFileLink 2023-11-19 10:55:22,250 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/3c764cf1370346ccbceb6c88ae028535 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/3c764cf1370346ccbceb6c88ae028535 2023-11-19 10:55:22,250 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 6ce54f57ed0d4ff3be15c835afea0542 of snapshot=snaptb-1700391308470 to region=637f0b3884286bfcfceb56152d715e9d table=testCompactionWithHFileLink 2023-11-19 10:55:22,251 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/2a2a30f328e04a90bc32fc47ec0dda4f to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/2a2a30f328e04a90bc32fc47ec0dda4f 2023-11-19 10:55:22,251 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 0372b9105a144b4a8aaef5a3dc101a63 of snapshot=snaptb-1700391308470 to region=4a83e887540ecadca9444556fadfc332 table=testCompactionWithHFileLink 2023-11-19 10:55:22,257 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 1a192ccf5c384a4b9227c6be349c1cdb of snapshot=snaptb-1700391308470 to region=3bb6c0b2c9863082d1a21587d98896c0 table=testCompactionWithHFileLink 2023-11-19 10:55:22,257 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink e6f86413cc15400981952800b7cd63ba of snapshot=snaptb-1700391308470 to region=637f0b3884286bfcfceb56152d715e9d table=testCompactionWithHFileLink 2023-11-19 10:55:22,258 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink bfcb67f7218c4938aa6226f4b310974c of snapshot=snaptb-1700391308470 to region=4a83e887540ecadca9444556fadfc332 table=testCompactionWithHFileLink 2023-11-19 10:55:22,262 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 3a6ace9e1d19485c9163859fc4342e66 of snapshot=snaptb-1700391308470 to region=3bb6c0b2c9863082d1a21587d98896c0 table=testCompactionWithHFileLink 2023-11-19 10:55:22,262 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink b5f58cf5e2f5425e9430630e361758ce of snapshot=snaptb-1700391308470 to region=4a83e887540ecadca9444556fadfc332 table=testCompactionWithHFileLink 2023-11-19 10:55:22,262 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink ac2fe88928b040f1abd62cc82dd57b34 of snapshot=snaptb-1700391308470 to region=637f0b3884286bfcfceb56152d715e9d table=testCompactionWithHFileLink 2023-11-19 10:55:22,265 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 4c5188c6e778445caff4c373976479e9 of snapshot=snaptb-1700391308470 to region=4a83e887540ecadca9444556fadfc332 table=testCompactionWithHFileLink 2023-11-19 10:55:22,266 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 50cfabdebac34a6a88ee5aab65fb8770 of snapshot=snaptb-1700391308470 to region=3bb6c0b2c9863082d1a21587d98896c0 table=testCompactionWithHFileLink 2023-11-19 10:55:22,266 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 05c787f40212496d9d807f1c78e870dc of snapshot=snaptb-1700391308470 to region=637f0b3884286bfcfceb56152d715e9d table=testCompactionWithHFileLink 2023-11-19 10:55:22,271 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family2/0ea557d7d3134c18b36dddd547829a99 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family2/0ea557d7d3134c18b36dddd547829a99 2023-11-19 10:55:22,271 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 5e1ddebf717143dd894f0cda6b80e167 of snapshot=snaptb-1700391308470 to region=3bb6c0b2c9863082d1a21587d98896c0 table=testCompactionWithHFileLink 2023-11-19 10:55:22,271 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family2/94f75d392e2749db9d025e58c2bf9c05 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family2/94f75d392e2749db9d025e58c2bf9c05 2023-11-19 10:55:22,271 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d88c375eb41c48309e3230ffee5ac927 of snapshot=snaptb-1700391308470 to region=4a83e887540ecadca9444556fadfc332 table=testCompactionWithHFileLink 2023-11-19 10:55:22,272 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family2/79ad0cea84934aefaa2fe73d1304645c to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family2/79ad0cea84934aefaa2fe73d1304645c 2023-11-19 10:55:22,272 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 4514248a5e4c40a18c2176148afa3a70 of snapshot=snaptb-1700391308470 to region=637f0b3884286bfcfceb56152d715e9d table=testCompactionWithHFileLink 2023-11-19 10:55:22,288 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink f110b6db2dc64eeb9eb40bee5be84288 of snapshot=snaptb-1700391308470 to region=637f0b3884286bfcfceb56152d715e9d table=testCompactionWithHFileLink 2023-11-19 10:55:22,288 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 87683fada1bc4361bef06981be006667 of snapshot=snaptb-1700391308470 to region=4a83e887540ecadca9444556fadfc332 table=testCompactionWithHFileLink 2023-11-19 10:55:22,289 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 4845a1ccc26a493ba944c124fee0873d of snapshot=snaptb-1700391308470 to region=3bb6c0b2c9863082d1a21587d98896c0 table=testCompactionWithHFileLink 2023-11-19 10:55:22,292 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 65763493d9b84815a761f0299a47abfa of snapshot=snaptb-1700391308470 to region=3bb6c0b2c9863082d1a21587d98896c0 table=testCompactionWithHFileLink 2023-11-19 10:55:22,292 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink ba44e63e3aab4a2696e51a294c0e959d of snapshot=snaptb-1700391308470 to region=637f0b3884286bfcfceb56152d715e9d table=testCompactionWithHFileLink 2023-11-19 10:55:22,292 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 8bfd838e615a4158b81518f03b3d4f70 of snapshot=snaptb-1700391308470 to region=4a83e887540ecadca9444556fadfc332 table=testCompactionWithHFileLink 2023-11-19 10:55:22,296 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink e2bd97573076422091726d2553c6895e of snapshot=snaptb-1700391308470 to region=637f0b3884286bfcfceb56152d715e9d table=testCompactionWithHFileLink 2023-11-19 10:55:22,296 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c628e404e9d6494db8abb403651cbd06 of snapshot=snaptb-1700391308470 to region=3bb6c0b2c9863082d1a21587d98896c0 table=testCompactionWithHFileLink 2023-11-19 10:55:22,296 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink bc0941dc9bb04974a011a607c8cd6d95 of snapshot=snaptb-1700391308470 to region=4a83e887540ecadca9444556fadfc332 table=testCompactionWithHFileLink 2023-11-19 10:55:22,300 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "snaptb-1700391308470" table: "testCompactionWithHFileLink" creation_time: 1700391308480 type: FLUSH version: 2 ttl: 0 2023-11-19 10:55:22,301 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1700391322301"}]},"ts":"9223372036854775807"} 2023-11-19 10:55:22,301 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1700391322301"}]},"ts":"9223372036854775807"} 2023-11-19 10:55:22,301 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1700391322301"}]},"ts":"9223372036854775807"} 2023-11-19 10:55:22,303 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-11-19 10:55:22,303 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 3bb6c0b2c9863082d1a21587d98896c0, NAME => 'testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => 4a83e887540ecadca9444556fadfc332, NAME => 'testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => 637f0b3884286bfcfceb56152d715e9d, NAME => 'testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d.', STARTKEY => '', ENDKEY => '1'}] 2023-11-19 10:55:22,303 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700391322302"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700391322302"}]},"ts":"1700391322302"} 2023-11-19 10:55:22,303 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700391322302"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700391322302"}]},"ts":"1700391322302"} 2023-11-19 10:55:22,303 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700391322302"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700391322302"}]},"ts":"1700391322302"} 2023-11-19 10:55:22,305 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-19 10:55:22,305 INFO [PEWorker-4] hbase.MetaTableAccessor(1810): Overwritten 3 regions to Meta 2023-11-19 10:55:22,305 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1811): Overwritten regions: [{ENCODED => 3bb6c0b2c9863082d1a21587d98896c0, NAME => 'testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => 4a83e887540ecadca9444556fadfc332, NAME => 'testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => 637f0b3884286bfcfceb56152d715e9d, NAME => 'testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d.', STARTKEY => '', ENDKEY => '1'}] 2023-11-19 10:55:22,305 INFO [PEWorker-4] procedure.RestoreSnapshotProcedure(457): Restore snapshot={ ss=snaptb-1700391308470 table=testCompactionWithHFileLink type=FLUSH ttl=0 } on table=testCompactionWithHFileLink completed! 2023-11-19 10:55:22,307 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1700391308470" table: "testCompactionWithHFileLink" creation_time: 1700391308480 type: FLUSH version: 2 ttl: 0 ) in 541 msec 2023-11-19 10:55:22,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-19 10:55:22,384 INFO [Listener at localhost/42675] client.HBaseAdmin$TableFuture(3541): Operation: MODIFY, Table Name: default:testCompactionWithHFileLink, procId: 96 completed 2023-11-19 10:55:22,384 INFO [Listener at localhost/42675] client.HBaseAdmin(2618): Deleting restore-failsafe snapshot: hbase-failsafe-snaptb-1700391308470-1700391320605 2023-11-19 10:55:22,388 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "hbase-failsafe-snaptb-1700391308470-1700391320605" 2023-11-19 10:55:22,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] snapshot.SnapshotManager(335): Deleting snapshot: hbase-failsafe-snaptb-1700391308470-1700391320605 2023-11-19 10:55:22,394 INFO [Listener at localhost/42675] client.HBaseAdmin$14(830): Started enable of testCompactionWithHFileLink 2023-11-19 10:55:22,398 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.HMaster$10(2385): Client=jenkins//172.31.14.131 enable testCompactionWithHFileLink 2023-11-19 10:55:22,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE:ENABLE_TABLE_PREPARE; EnableTableProcedure table=testCompactionWithHFileLink 2023-11-19 10:55:22,406 INFO [PEWorker-1] procedure.EnableTableProcedure(296): Attempting to enable the table testCompactionWithHFileLink 2023-11-19 10:55:22,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-19 10:55:22,406 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700391322406"}]},"ts":"1700391322406"} 2023-11-19 10:55:22,407 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-11-19 10:55:22,410 DEBUG [PEWorker-1] procedure.EnableTableProcedure(107): No change in number of region replicas (configuredReplicaCount=1); assigning. 2023-11-19 10:55:22,410 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=637f0b3884286bfcfceb56152d715e9d, ASSIGN}, {pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=4a83e887540ecadca9444556fadfc332, ASSIGN}, {pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=3bb6c0b2c9863082d1a21587d98896c0, ASSIGN}] 2023-11-19 10:55:22,411 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=4a83e887540ecadca9444556fadfc332, ASSIGN 2023-11-19 10:55:22,411 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=637f0b3884286bfcfceb56152d715e9d, ASSIGN 2023-11-19 10:55:22,411 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=3bb6c0b2c9863082d1a21587d98896c0, ASSIGN 2023-11-19 10:55:22,411 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=637f0b3884286bfcfceb56152d715e9d, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-11-19 10:55:22,411 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=4a83e887540ecadca9444556fadfc332, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-11-19 10:55:22,412 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=3bb6c0b2c9863082d1a21587d98896c0, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-11-19 10:55:22,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-19 10:55:22,563 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=3bb6c0b2c9863082d1a21587d98896c0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:22,563 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=4a83e887540ecadca9444556fadfc332, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:22,563 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=637f0b3884286bfcfceb56152d715e9d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:22,563 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700391322563"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700391322563"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700391322563"}]},"ts":"1700391322563"} 2023-11-19 10:55:22,563 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700391322563"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700391322563"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700391322563"}]},"ts":"1700391322563"} 2023-11-19 10:55:22,563 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700391322563"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700391322563"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700391322563"}]},"ts":"1700391322563"} 2023-11-19 10:55:22,565 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=101, ppid=100, state=RUNNABLE; OpenRegionProcedure 3bb6c0b2c9863082d1a21587d98896c0, server=jenkins-hbase4.apache.org,46035,1700391201579}] 2023-11-19 10:55:22,565 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=98, state=RUNNABLE; OpenRegionProcedure 637f0b3884286bfcfceb56152d715e9d, server=jenkins-hbase4.apache.org,46035,1700391201579}] 2023-11-19 10:55:22,566 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=99, state=RUNNABLE; OpenRegionProcedure 4a83e887540ecadca9444556fadfc332, server=jenkins-hbase4.apache.org,46035,1700391201579}] 2023-11-19 10:55:22,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-19 10:55:22,716 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:22,719 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d. 2023-11-19 10:55:22,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 637f0b3884286bfcfceb56152d715e9d, NAME => 'testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d.', STARTKEY => '', ENDKEY => '1'} 2023-11-19 10:55:22,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 637f0b3884286bfcfceb56152d715e9d 2023-11-19 10:55:22,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-19 10:55:22,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 637f0b3884286bfcfceb56152d715e9d 2023-11-19 10:55:22,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 637f0b3884286bfcfceb56152d715e9d 2023-11-19 10:55:22,720 INFO [StoreOpener-637f0b3884286bfcfceb56152d715e9d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 637f0b3884286bfcfceb56152d715e9d 2023-11-19 10:55:22,721 DEBUG [StoreOpener-637f0b3884286bfcfceb56152d715e9d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1 2023-11-19 10:55:22,721 DEBUG [StoreOpener-637f0b3884286bfcfceb56152d715e9d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1 2023-11-19 10:55:22,721 INFO [StoreOpener-637f0b3884286bfcfceb56152d715e9d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 637f0b3884286bfcfceb56152d715e9d columnFamilyName family1 2023-11-19 10:55:22,731 DEBUG [StoreOpener-637f0b3884286bfcfceb56152d715e9d-1] regionserver.HStore(539): loaded hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/testCompactionWithHFileLink=637f0b3884286bfcfceb56152d715e9d-05c787f40212496d9d807f1c78e870dc 2023-11-19 10:55:22,737 DEBUG [StoreOpener-637f0b3884286bfcfceb56152d715e9d-1] regionserver.HStore(539): loaded hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/testCompactionWithHFileLink=637f0b3884286bfcfceb56152d715e9d-6ce54f57ed0d4ff3be15c835afea0542 2023-11-19 10:55:22,741 DEBUG [StoreOpener-637f0b3884286bfcfceb56152d715e9d-1] regionserver.HStore(539): loaded hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/testCompactionWithHFileLink=637f0b3884286bfcfceb56152d715e9d-ac2fe88928b040f1abd62cc82dd57b34 2023-11-19 10:55:22,746 DEBUG [StoreOpener-637f0b3884286bfcfceb56152d715e9d-1] regionserver.HStore(539): loaded hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/testCompactionWithHFileLink=637f0b3884286bfcfceb56152d715e9d-e6f86413cc15400981952800b7cd63ba 2023-11-19 10:55:22,746 INFO [StoreOpener-637f0b3884286bfcfceb56152d715e9d-1] regionserver.HStore(310): Store=637f0b3884286bfcfceb56152d715e9d/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-19 10:55:22,746 INFO [StoreOpener-637f0b3884286bfcfceb56152d715e9d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 637f0b3884286bfcfceb56152d715e9d 2023-11-19 10:55:22,747 DEBUG [StoreOpener-637f0b3884286bfcfceb56152d715e9d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family2 2023-11-19 10:55:22,747 DEBUG [StoreOpener-637f0b3884286bfcfceb56152d715e9d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family2 2023-11-19 10:55:22,747 INFO [StoreOpener-637f0b3884286bfcfceb56152d715e9d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 637f0b3884286bfcfceb56152d715e9d columnFamilyName family2 2023-11-19 10:55:22,753 DEBUG [StoreOpener-637f0b3884286bfcfceb56152d715e9d-1] regionserver.HStore(539): loaded hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family2/testCompactionWithHFileLink=637f0b3884286bfcfceb56152d715e9d-4514248a5e4c40a18c2176148afa3a70 2023-11-19 10:55:22,758 DEBUG [StoreOpener-637f0b3884286bfcfceb56152d715e9d-1] regionserver.HStore(539): loaded hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family2/testCompactionWithHFileLink=637f0b3884286bfcfceb56152d715e9d-ba44e63e3aab4a2696e51a294c0e959d 2023-11-19 10:55:22,763 DEBUG [StoreOpener-637f0b3884286bfcfceb56152d715e9d-1] regionserver.HStore(539): loaded hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family2/testCompactionWithHFileLink=637f0b3884286bfcfceb56152d715e9d-e2bd97573076422091726d2553c6895e 2023-11-19 10:55:22,767 DEBUG [StoreOpener-637f0b3884286bfcfceb56152d715e9d-1] regionserver.HStore(539): loaded hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family2/testCompactionWithHFileLink=637f0b3884286bfcfceb56152d715e9d-f110b6db2dc64eeb9eb40bee5be84288 2023-11-19 10:55:22,768 INFO [StoreOpener-637f0b3884286bfcfceb56152d715e9d-1] regionserver.HStore(310): Store=637f0b3884286bfcfceb56152d715e9d/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-19 10:55:22,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d 2023-11-19 10:55:22,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d 2023-11-19 10:55:22,771 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-19 10:55:22,772 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 637f0b3884286bfcfceb56152d715e9d 2023-11-19 10:55:22,773 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 637f0b3884286bfcfceb56152d715e9d; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63534679, jitterRate=-0.053259506821632385}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-19 10:55:22,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 637f0b3884286bfcfceb56152d715e9d: 2023-11-19 10:55:22,774 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d., pid=102, masterSystemTime=1700391322716 2023-11-19 10:55:22,774 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-19 10:55:22,774 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-19 10:55:22,774 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-11-19 10:55:22,774 DEBUG [RS:0;jenkins-hbase4:46035-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-19 10:55:22,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d. 2023-11-19 10:55:22,776 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d. 2023-11-19 10:55:22,776 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0. 2023-11-19 10:55:22,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3bb6c0b2c9863082d1a21587d98896c0, NAME => 'testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0.', STARTKEY => '2', ENDKEY => ''} 2023-11-19 10:55:22,776 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=637f0b3884286bfcfceb56152d715e9d, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:22,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 3bb6c0b2c9863082d1a21587d98896c0 2023-11-19 10:55:22,776 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700391322776"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700391322776"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700391322776"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700391322776"}]},"ts":"1700391322776"} 2023-11-19 10:55:22,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-19 10:55:22,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3bb6c0b2c9863082d1a21587d98896c0 2023-11-19 10:55:22,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3bb6c0b2c9863082d1a21587d98896c0 2023-11-19 10:55:22,778 DEBUG [RS:0;jenkins-hbase4:46035-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-19 10:55:22,778 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-19 10:55:22,778 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HStore(1912): 637f0b3884286bfcfceb56152d715e9d/family1 is initiating minor compaction (all files) 2023-11-19 10:55:22,778 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 637f0b3884286bfcfceb56152d715e9d/family1 in testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d. 2023-11-19 10:55:22,778 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/testCompactionWithHFileLink=637f0b3884286bfcfceb56152d715e9d-6ce54f57ed0d4ff3be15c835afea0542, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/testCompactionWithHFileLink=637f0b3884286bfcfceb56152d715e9d-e6f86413cc15400981952800b7cd63ba, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/testCompactionWithHFileLink=637f0b3884286bfcfceb56152d715e9d-ac2fe88928b040f1abd62cc82dd57b34, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/testCompactionWithHFileLink=637f0b3884286bfcfceb56152d715e9d-05c787f40212496d9d807f1c78e870dc] into tmpdir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/.tmp, totalSize=21.6 K 2023-11-19 10:55:22,778 DEBUG [RS:0;jenkins-hbase4:46035-longCompactions-0] regionserver.HStore(1912): 637f0b3884286bfcfceb56152d715e9d/family2 is initiating minor compaction (all files) 2023-11-19 10:55:22,778 INFO [RS:0;jenkins-hbase4:46035-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 637f0b3884286bfcfceb56152d715e9d/family2 in testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d. 2023-11-19 10:55:22,778 INFO [RS:0;jenkins-hbase4:46035-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family2/testCompactionWithHFileLink=637f0b3884286bfcfceb56152d715e9d-4514248a5e4c40a18c2176148afa3a70, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family2/testCompactionWithHFileLink=637f0b3884286bfcfceb56152d715e9d-f110b6db2dc64eeb9eb40bee5be84288, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family2/testCompactionWithHFileLink=637f0b3884286bfcfceb56152d715e9d-ba44e63e3aab4a2696e51a294c0e959d, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family2/testCompactionWithHFileLink=637f0b3884286bfcfceb56152d715e9d-e2bd97573076422091726d2553c6895e] into tmpdir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/.tmp, totalSize=20.4 K 2023-11-19 10:55:22,779 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=98 2023-11-19 10:55:22,779 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=98, state=SUCCESS; OpenRegionProcedure 637f0b3884286bfcfceb56152d715e9d, server=jenkins-hbase4.apache.org,46035,1700391201579 in 213 msec 2023-11-19 10:55:22,779 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=637f0b3884286bfcfceb56152d715e9d-6ce54f57ed0d4ff3be15c835afea0542, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700391301644 2023-11-19 10:55:22,780 DEBUG [RS:0;jenkins-hbase4:46035-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=637f0b3884286bfcfceb56152d715e9d-4514248a5e4c40a18c2176148afa3a70, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700391301644 2023-11-19 10:55:22,780 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=98, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=637f0b3884286bfcfceb56152d715e9d, ASSIGN in 369 msec 2023-11-19 10:55:22,780 INFO [StoreOpener-3bb6c0b2c9863082d1a21587d98896c0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 3bb6c0b2c9863082d1a21587d98896c0 2023-11-19 10:55:22,781 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=637f0b3884286bfcfceb56152d715e9d-e6f86413cc15400981952800b7cd63ba, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700391303455 2023-11-19 10:55:22,781 DEBUG [RS:0;jenkins-hbase4:46035-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=637f0b3884286bfcfceb56152d715e9d-f110b6db2dc64eeb9eb40bee5be84288, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700391303455 2023-11-19 10:55:22,781 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=637f0b3884286bfcfceb56152d715e9d-ac2fe88928b040f1abd62cc82dd57b34, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700391304867 2023-11-19 10:55:22,782 DEBUG [RS:0;jenkins-hbase4:46035-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=637f0b3884286bfcfceb56152d715e9d-ba44e63e3aab4a2696e51a294c0e959d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700391304867 2023-11-19 10:55:22,782 DEBUG [StoreOpener-3bb6c0b2c9863082d1a21587d98896c0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1 2023-11-19 10:55:22,782 DEBUG [StoreOpener-3bb6c0b2c9863082d1a21587d98896c0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1 2023-11-19 10:55:22,782 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=637f0b3884286bfcfceb56152d715e9d-05c787f40212496d9d807f1c78e870dc, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700391306670 2023-11-19 10:55:22,783 INFO [StoreOpener-3bb6c0b2c9863082d1a21587d98896c0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3bb6c0b2c9863082d1a21587d98896c0 columnFamilyName family1 2023-11-19 10:55:22,783 DEBUG [RS:0;jenkins-hbase4:46035-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=637f0b3884286bfcfceb56152d715e9d-e2bd97573076422091726d2553c6895e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700391306670 2023-11-19 10:55:22,806 DEBUG [StoreOpener-3bb6c0b2c9863082d1a21587d98896c0-1] regionserver.HStore(539): loaded hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/testCompactionWithHFileLink=3bb6c0b2c9863082d1a21587d98896c0-1a192ccf5c384a4b9227c6be349c1cdb 2023-11-19 10:55:22,821 DEBUG [StoreOpener-3bb6c0b2c9863082d1a21587d98896c0-1] regionserver.HStore(539): loaded hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/testCompactionWithHFileLink=3bb6c0b2c9863082d1a21587d98896c0-3a6ace9e1d19485c9163859fc4342e66 2023-11-19 10:55:22,837 INFO [RS:0;jenkins-hbase4:46035-longCompactions-0] throttle.PressureAwareThroughputController(145): 637f0b3884286bfcfceb56152d715e9d#family2#compaction#115 average throughput is 0.19 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-19 10:55:22,837 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] throttle.PressureAwareThroughputController(145): 637f0b3884286bfcfceb56152d715e9d#family1#compaction#114 average throughput is 0.39 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-19 10:55:22,839 DEBUG [StoreOpener-3bb6c0b2c9863082d1a21587d98896c0-1] regionserver.HStore(539): loaded hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/testCompactionWithHFileLink=3bb6c0b2c9863082d1a21587d98896c0-50cfabdebac34a6a88ee5aab65fb8770 2023-11-19 10:55:22,851 DEBUG [StoreOpener-3bb6c0b2c9863082d1a21587d98896c0-1] regionserver.HStore(539): loaded hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/testCompactionWithHFileLink=3bb6c0b2c9863082d1a21587d98896c0-e50fef40dd3c40128bc0fa95885d7dab 2023-11-19 10:55:22,851 INFO [StoreOpener-3bb6c0b2c9863082d1a21587d98896c0-1] regionserver.HStore(310): Store=3bb6c0b2c9863082d1a21587d98896c0/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-19 10:55:22,852 INFO [StoreOpener-3bb6c0b2c9863082d1a21587d98896c0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 3bb6c0b2c9863082d1a21587d98896c0 2023-11-19 10:55:22,852 DEBUG [StoreOpener-3bb6c0b2c9863082d1a21587d98896c0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family2 2023-11-19 10:55:22,853 DEBUG [StoreOpener-3bb6c0b2c9863082d1a21587d98896c0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family2 2023-11-19 10:55:22,853 INFO [StoreOpener-3bb6c0b2c9863082d1a21587d98896c0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3bb6c0b2c9863082d1a21587d98896c0 columnFamilyName family2 2023-11-19 10:55:22,859 DEBUG [StoreOpener-3bb6c0b2c9863082d1a21587d98896c0-1] regionserver.HStore(539): loaded hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family2/testCompactionWithHFileLink=3bb6c0b2c9863082d1a21587d98896c0-4845a1ccc26a493ba944c124fee0873d 2023-11-19 10:55:22,864 DEBUG [StoreOpener-3bb6c0b2c9863082d1a21587d98896c0-1] regionserver.HStore(539): loaded hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family2/testCompactionWithHFileLink=3bb6c0b2c9863082d1a21587d98896c0-5e1ddebf717143dd894f0cda6b80e167 2023-11-19 10:55:22,868 DEBUG [StoreOpener-3bb6c0b2c9863082d1a21587d98896c0-1] regionserver.HStore(539): loaded hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family2/testCompactionWithHFileLink=3bb6c0b2c9863082d1a21587d98896c0-65763493d9b84815a761f0299a47abfa 2023-11-19 10:55:22,873 DEBUG [StoreOpener-3bb6c0b2c9863082d1a21587d98896c0-1] regionserver.HStore(539): loaded hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family2/testCompactionWithHFileLink=3bb6c0b2c9863082d1a21587d98896c0-c628e404e9d6494db8abb403651cbd06 2023-11-19 10:55:22,873 INFO [StoreOpener-3bb6c0b2c9863082d1a21587d98896c0-1] regionserver.HStore(310): Store=3bb6c0b2c9863082d1a21587d98896c0/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-19 10:55:22,874 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0 2023-11-19 10:55:22,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0 2023-11-19 10:55:22,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-19 10:55:22,879 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3bb6c0b2c9863082d1a21587d98896c0 2023-11-19 10:55:22,880 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3bb6c0b2c9863082d1a21587d98896c0; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65488518, jitterRate=-0.024145036935806274}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-19 10:55:22,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3bb6c0b2c9863082d1a21587d98896c0: 2023-11-19 10:55:22,881 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0., pid=101, masterSystemTime=1700391322716 2023-11-19 10:55:22,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-11-19 10:55:22,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-11-19 10:55:22,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0. 2023-11-19 10:55:22,882 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0. 2023-11-19 10:55:22,883 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332. 2023-11-19 10:55:22,883 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4a83e887540ecadca9444556fadfc332, NAME => 'testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332.', STARTKEY => '1', ENDKEY => '2'} 2023-11-19 10:55:22,883 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=3bb6c0b2c9863082d1a21587d98896c0, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:22,883 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 4a83e887540ecadca9444556fadfc332 2023-11-19 10:55:22,883 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-19 10:55:22,883 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700391322883"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700391322883"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700391322883"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700391322883"}]},"ts":"1700391322883"} 2023-11-19 10:55:22,883 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4a83e887540ecadca9444556fadfc332 2023-11-19 10:55:22,883 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4a83e887540ecadca9444556fadfc332 2023-11-19 10:55:22,885 INFO [StoreOpener-4a83e887540ecadca9444556fadfc332-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 4a83e887540ecadca9444556fadfc332 2023-11-19 10:55:22,886 DEBUG [StoreOpener-4a83e887540ecadca9444556fadfc332-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1 2023-11-19 10:55:22,886 DEBUG [StoreOpener-4a83e887540ecadca9444556fadfc332-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1 2023-11-19 10:55:22,886 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=101, resume processing ppid=100 2023-11-19 10:55:22,886 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=100, state=SUCCESS; OpenRegionProcedure 3bb6c0b2c9863082d1a21587d98896c0, server=jenkins-hbase4.apache.org,46035,1700391201579 in 320 msec 2023-11-19 10:55:22,887 INFO [StoreOpener-4a83e887540ecadca9444556fadfc332-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4a83e887540ecadca9444556fadfc332 columnFamilyName family1 2023-11-19 10:55:22,888 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=3bb6c0b2c9863082d1a21587d98896c0, ASSIGN in 476 msec 2023-11-19 10:55:22,894 DEBUG [StoreOpener-4a83e887540ecadca9444556fadfc332-1] regionserver.HStore(539): loaded hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/testCompactionWithHFileLink=4a83e887540ecadca9444556fadfc332-0372b9105a144b4a8aaef5a3dc101a63 2023-11-19 10:55:22,901 DEBUG [StoreOpener-4a83e887540ecadca9444556fadfc332-1] regionserver.HStore(539): loaded hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/testCompactionWithHFileLink=4a83e887540ecadca9444556fadfc332-4c5188c6e778445caff4c373976479e9 2023-11-19 10:55:22,908 DEBUG [StoreOpener-4a83e887540ecadca9444556fadfc332-1] regionserver.HStore(539): loaded hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/testCompactionWithHFileLink=4a83e887540ecadca9444556fadfc332-b5f58cf5e2f5425e9430630e361758ce 2023-11-19 10:55:22,915 DEBUG [StoreOpener-4a83e887540ecadca9444556fadfc332-1] regionserver.HStore(539): loaded hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/testCompactionWithHFileLink=4a83e887540ecadca9444556fadfc332-bfcb67f7218c4938aa6226f4b310974c 2023-11-19 10:55:22,915 INFO [StoreOpener-4a83e887540ecadca9444556fadfc332-1] regionserver.HStore(310): Store=4a83e887540ecadca9444556fadfc332/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-19 10:55:22,915 INFO [StoreOpener-4a83e887540ecadca9444556fadfc332-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 4a83e887540ecadca9444556fadfc332 2023-11-19 10:55:22,916 DEBUG [StoreOpener-4a83e887540ecadca9444556fadfc332-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family2 2023-11-19 10:55:22,916 DEBUG [StoreOpener-4a83e887540ecadca9444556fadfc332-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family2 2023-11-19 10:55:22,917 INFO [StoreOpener-4a83e887540ecadca9444556fadfc332-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4a83e887540ecadca9444556fadfc332 columnFamilyName family2 2023-11-19 10:55:22,925 DEBUG [StoreOpener-4a83e887540ecadca9444556fadfc332-1] regionserver.HStore(539): loaded hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family2/testCompactionWithHFileLink=4a83e887540ecadca9444556fadfc332-87683fada1bc4361bef06981be006667 2023-11-19 10:55:22,936 DEBUG [StoreOpener-4a83e887540ecadca9444556fadfc332-1] regionserver.HStore(539): loaded hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family2/testCompactionWithHFileLink=4a83e887540ecadca9444556fadfc332-8bfd838e615a4158b81518f03b3d4f70 2023-11-19 10:55:22,943 DEBUG [StoreOpener-4a83e887540ecadca9444556fadfc332-1] regionserver.HStore(539): loaded hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family2/testCompactionWithHFileLink=4a83e887540ecadca9444556fadfc332-bc0941dc9bb04974a011a607c8cd6d95 2023-11-19 10:55:22,949 DEBUG [StoreOpener-4a83e887540ecadca9444556fadfc332-1] regionserver.HStore(539): loaded hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family2/testCompactionWithHFileLink=4a83e887540ecadca9444556fadfc332-d88c375eb41c48309e3230ffee5ac927 2023-11-19 10:55:22,949 INFO [StoreOpener-4a83e887540ecadca9444556fadfc332-1] regionserver.HStore(310): Store=4a83e887540ecadca9444556fadfc332/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-19 10:55:22,950 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332 2023-11-19 10:55:22,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332 2023-11-19 10:55:22,952 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-19 10:55:22,953 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4a83e887540ecadca9444556fadfc332 2023-11-19 10:55:22,954 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4a83e887540ecadca9444556fadfc332; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71890307, jitterRate=0.07124905288219452}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-19 10:55:22,954 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4a83e887540ecadca9444556fadfc332: 2023-11-19 10:55:22,955 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332., pid=103, masterSystemTime=1700391322716 2023-11-19 10:55:22,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-11-19 10:55:22,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-11-19 10:55:22,956 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332. 2023-11-19 10:55:22,956 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332. 2023-11-19 10:55:22,956 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=4a83e887540ecadca9444556fadfc332, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:22,957 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700391322956"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700391322956"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700391322956"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700391322956"}]},"ts":"1700391322956"} 2023-11-19 10:55:22,959 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=99 2023-11-19 10:55:22,959 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=99, state=SUCCESS; OpenRegionProcedure 4a83e887540ecadca9444556fadfc332, server=jenkins-hbase4.apache.org,46035,1700391201579 in 392 msec 2023-11-19 10:55:22,960 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=99, resume processing ppid=97 2023-11-19 10:55:22,960 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=99, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=4a83e887540ecadca9444556fadfc332, ASSIGN in 549 msec 2023-11-19 10:55:22,961 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700391322961"}]},"ts":"1700391322961"} 2023-11-19 10:55:22,962 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-11-19 10:55:22,963 INFO [PEWorker-1] procedure.EnableTableProcedure(310): Table 'testCompactionWithHFileLink' was successfully enabled. 2023-11-19 10:55:22,964 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; EnableTableProcedure table=testCompactionWithHFileLink in 565 msec 2023-11-19 10:55:23,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-19 10:55:23,009 INFO [Listener at localhost/42675] client.HBaseAdmin$TableFuture(3541): Operation: ENABLE, Table Name: default:testCompactionWithHFileLink, procId: 97 completed 2023-11-19 10:55:23,021 DEBUG [Listener at localhost/42675] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-19 10:55:23,028 DEBUG [Listener at localhost/42675] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-19 10:55:23,036 DEBUG [Listener at localhost/42675] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-19 10:55:23,037 DEBUG [Listener at localhost/42675] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-19 10:55:23,043 INFO [Listener at localhost/42675] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-19 10:55:23,058 INFO [Listener at localhost/42675] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-11-19 10:55:23,059 INFO [Listener at localhost/42675] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testCompactionWithHFileLink' column='family1' 2023-11-19 10:55:23,060 DEBUG [Listener at localhost/42675] zookeeper.ReadOnlyZKClient(139): Connect 0x470ae4dc to 127.0.0.1:60497 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-19 10:55:23,065 DEBUG [Listener at localhost/42675] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@236e2c1d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-19 10:55:23,065 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231119 for table='testCompactionWithHFileLink' and column='family1' 2023-11-19 10:55:23,065 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231119 for table='testCompactionWithHFileLink' and column='family1' 2023-11-19 10:55:23,065 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231119 for table='testCompactionWithHFileLink' and column='family1' 2023-11-19 10:55:23,329 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.07692307692307693, tune throughput to 53.85 MB/second 2023-11-19 10:55:23,546 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311196856e3efda494bec8435a7948dd3c69c to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311196856e3efda494bec8435a7948dd3c69c 2023-11-19 10:55:23,546 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231119d2dde11047934407a71f30648bcd5c5f to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231119d2dde11047934407a71f30648bcd5c5f 2023-11-19 10:55:23,547 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231119 table='testCompactionWithHFileLink' column='family1' 2023-11-19 10:55:23,547 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231119 table='testCompactionWithHFileLink' column='family1' 2023-11-19 10:55:23,559 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-19 10:55:23,562 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33224, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-19 10:55:23,568 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-19 10:55:23,571 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51738, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-19 10:55:23,591 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231119/family1/f7a35e0f1c8e45aea173f4b5dd2476f6 first=Optional[0\x00\x00\x00\x00] last=Optional[0\x00\x00\x00\x07] 2023-11-19 10:55:23,591 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231119/family1/2c6ae3b23b954eb4a94e96a43791773e first=Optional[2\x00\x00\x00\x00] last=Optional[2\x00\x00\x00\x07] 2023-11-19 10:55:23,592 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d., hostname=jenkins-hbase4.apache.org,46035,1700391201579, seqNum=32 for row with hfile group [{family1,hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231119/family1/f7a35e0f1c8e45aea173f4b5dd2476f6}] 2023-11-19 10:55:23,592 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0., hostname=jenkins-hbase4.apache.org,46035,1700391201579, seqNum=32 for row 2 with hfile group [{family1,hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231119/family1/2c6ae3b23b954eb4a94e96a43791773e}] 2023-11-19 10:55:23,602 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(763): Validating hfile at hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231119/family1/2c6ae3b23b954eb4a94e96a43791773e for inclusion in 3bb6c0b2c9863082d1a21587d98896c0/family1 2023-11-19 10:55:23,602 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46035] regionserver.HStore(763): Validating hfile at hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231119/family1/f7a35e0f1c8e45aea173f4b5dd2476f6 for inclusion in 637f0b3884286bfcfceb56152d715e9d/family1 2023-11-19 10:55:23,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46035] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x00 last=0\x00\x00\x00\x07 2023-11-19 10:55:23,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46035] regionserver.HStore(777): Region bounds: first= last=1 2023-11-19 10:55:23,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x00 last=2\x00\x00\x00\x07 2023-11-19 10:55:23,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-19 10:55:23,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46035] regionserver.HRegion(2446): Flush status journal for 637f0b3884286bfcfceb56152d715e9d: 2023-11-19 10:55:23,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegion(2446): Flush status journal for 3bb6c0b2c9863082d1a21587d98896c0: 2023-11-19 10:55:23,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46035] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231119/family1/f7a35e0f1c8e45aea173f4b5dd2476f6 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testCompactionWithHFileLink__7h4ifofdn37drrh562a1nueuki19g9ev352o9ikc9j3khiik5gtle35t7q5idbp5/family1/f7a35e0f1c8e45aea173f4b5dd2476f6 2023-11-19 10:55:23,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231119/family1/2c6ae3b23b954eb4a94e96a43791773e to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testCompactionWithHFileLink__pp8d4s1pio055a1ji7scaatu7bl473v1hngnjngig3rhnt4m7mm40t71co77601m/family1/2c6ae3b23b954eb4a94e96a43791773e 2023-11-19 10:55:23,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46035] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testCompactionWithHFileLink__7h4ifofdn37drrh562a1nueuki19g9ev352o9ikc9j3khiik5gtle35t7q5idbp5/family1/f7a35e0f1c8e45aea173f4b5dd2476f6 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/3632f2db6c32481abd00182585de78eb_SeqId_34_ 2023-11-19 10:55:23,609 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46035] regionserver.HStore(849): Loaded HFile hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testCompactionWithHFileLink__7h4ifofdn37drrh562a1nueuki19g9ev352o9ikc9j3khiik5gtle35t7q5idbp5/family1/f7a35e0f1c8e45aea173f4b5dd2476f6 into 637f0b3884286bfcfceb56152d715e9d/family1 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/3632f2db6c32481abd00182585de78eb_SeqId_34_ - updating store file list. 2023-11-19 10:55:23,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testCompactionWithHFileLink__pp8d4s1pio055a1ji7scaatu7bl473v1hngnjngig3rhnt4m7mm40t71co77601m/family1/2c6ae3b23b954eb4a94e96a43791773e as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/6a16f82ab0444f30ba59db713b40bf4c_SeqId_34_ 2023-11-19 10:55:23,610 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(849): Loaded HFile hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testCompactionWithHFileLink__pp8d4s1pio055a1ji7scaatu7bl473v1hngnjngig3rhnt4m7mm40t71co77601m/family1/2c6ae3b23b954eb4a94e96a43791773e into 3bb6c0b2c9863082d1a21587d98896c0/family1 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/6a16f82ab0444f30ba59db713b40bf4c_SeqId_34_ - updating store file list. 2023-11-19 10:55:23,615 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46035] regionserver.HStore(882): Loaded HFile hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/3632f2db6c32481abd00182585de78eb_SeqId_34_ into 637f0b3884286bfcfceb56152d715e9d/family1 2023-11-19 10:55:23,616 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46035] regionserver.HStore(855): Successfully loaded hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testCompactionWithHFileLink__7h4ifofdn37drrh562a1nueuki19g9ev352o9ikc9j3khiik5gtle35t7q5idbp5/family1/f7a35e0f1c8e45aea173f4b5dd2476f6 into 637f0b3884286bfcfceb56152d715e9d/family1 (new location: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/3632f2db6c32481abd00182585de78eb_SeqId_34_) 2023-11-19 10:55:23,616 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(882): Loaded HFile hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/6a16f82ab0444f30ba59db713b40bf4c_SeqId_34_ into 3bb6c0b2c9863082d1a21587d98896c0/family1 2023-11-19 10:55:23,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46035] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testCompactionWithHFileLink__7h4ifofdn37drrh562a1nueuki19g9ev352o9ikc9j3khiik5gtle35t7q5idbp5/family1/f7a35e0f1c8e45aea173f4b5dd2476f6 2023-11-19 10:55:23,616 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(855): Successfully loaded hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testCompactionWithHFileLink__pp8d4s1pio055a1ji7scaatu7bl473v1hngnjngig3rhnt4m7mm40t71co77601m/family1/2c6ae3b23b954eb4a94e96a43791773e into 3bb6c0b2c9863082d1a21587d98896c0/family1 (new location: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/6a16f82ab0444f30ba59db713b40bf4c_SeqId_34_) 2023-11-19 10:55:23,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testCompactionWithHFileLink__pp8d4s1pio055a1ji7scaatu7bl473v1hngnjngig3rhnt4m7mm40t71co77601m/family1/2c6ae3b23b954eb4a94e96a43791773e 2023-11-19 10:55:23,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-19 10:55:23,618 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231119 table='testCompactionWithHFileLink' column='family1' 2023-11-19 10:55:23,618 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:55:23,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-11-19 10:55:23,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(1912): 3bb6c0b2c9863082d1a21587d98896c0/family1 is initiating minor compaction (all files) 2023-11-19 10:55:23,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@417f699d; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-11-19 10:55:23,620 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202311190980babcd5a04424bddc05cf5c3462ea to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202311190980babcd5a04424bddc05cf5c3462ea 2023-11-19 10:55:23,621 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231119 table='testCompactionWithHFileLink' column='family1' 2023-11-19 10:55:23,621 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202311192bf23f9cf93e47bcb5dff8874611341c to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202311192bf23f9cf93e47bcb5dff8874611341c 2023-11-19 10:55:23,622 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:55:23,622 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231119a597da2e193f44fcb76cc5cae46d94d0 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231119a597da2e193f44fcb76cc5cae46d94d0 2023-11-19 10:55:23,623 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202311194d02a0bf91464cde99c2cf0119bd6cac to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202311194d02a0bf91464cde99c2cf0119bd6cac 2023-11-19 10:55:23,623 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231119a8af52671e4e4cb4bbc0dbbc1e850e3c to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231119a8af52671e4e4cb4bbc0dbbc1e850e3c 2023-11-19 10:55:23,623 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-19 10:55:23,623 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231119' 2023-11-19 10:55:23,624 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231119 for table='testCompactionWithHFileLink' and column='family1' 2023-11-19 10:55:23,624 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202311196239bac53d134db79a5c84de2f7daf56 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202311196239bac53d134db79a5c84de2f7daf56 2023-11-19 10:55:23,625 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202311198762411ff2534743bb3aefeef885cc70 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202311198762411ff2534743bb3aefeef885cc70 2023-11-19 10:55:23,626 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231119ef0f22069d204985939432fd3e807d7c to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231119ef0f22069d204985939432fd3e807d7c 2023-11-19 10:55:23,626 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-19 10:55:23,626 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231119' 2023-11-19 10:55:23,626 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231119 for table='testCompactionWithHFileLink' and column='family1' 2023-11-19 10:55:23,947 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311197e53985b806f485e806b8b972e5cfc12 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311197e53985b806f485e806b8b972e5cfc12 2023-11-19 10:55:23,948 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231119 table='testCompactionWithHFileLink' column='family1' 2023-11-19 10:55:23,977 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231119/family1/24d040edd2a541848c6424c72f7eb6b6 first=Optional[1\x00\x00\x00\x00] last=Optional[1\x00\x00\x00\x07] 2023-11-19 10:55:23,978 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332., hostname=jenkins-hbase4.apache.org,46035,1700391201579, seqNum=32 for row 1 with hfile group [{family1,hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231119/family1/24d040edd2a541848c6424c72f7eb6b6}] 2023-11-19 10:55:23,980 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(763): Validating hfile at hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231119/family1/24d040edd2a541848c6424c72f7eb6b6 for inclusion in 4a83e887540ecadca9444556fadfc332/family1 2023-11-19 10:55:23,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x00 last=1\x00\x00\x00\x07 2023-11-19 10:55:23,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-19 10:55:23,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegion(2446): Flush status journal for 4a83e887540ecadca9444556fadfc332: 2023-11-19 10:55:23,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231119/family1/24d040edd2a541848c6424c72f7eb6b6 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testCompactionWithHFileLink__ok2t2gi5oe5vet3k9ijotal0uoc4puosv8u3amafumpdp1fhsdv1m9pjforbeh9j/family1/24d040edd2a541848c6424c72f7eb6b6 2023-11-19 10:55:23,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testCompactionWithHFileLink__ok2t2gi5oe5vet3k9ijotal0uoc4puosv8u3amafumpdp1fhsdv1m9pjforbeh9j/family1/24d040edd2a541848c6424c72f7eb6b6 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/cbe11e0e0dca4950b7286d52492b00ee_SeqId_34_ 2023-11-19 10:55:23,986 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(849): Loaded HFile hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testCompactionWithHFileLink__ok2t2gi5oe5vet3k9ijotal0uoc4puosv8u3amafumpdp1fhsdv1m9pjforbeh9j/family1/24d040edd2a541848c6424c72f7eb6b6 into 4a83e887540ecadca9444556fadfc332/family1 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/cbe11e0e0dca4950b7286d52492b00ee_SeqId_34_ - updating store file list. 2023-11-19 10:55:23,990 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(882): Loaded HFile hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/cbe11e0e0dca4950b7286d52492b00ee_SeqId_34_ into 4a83e887540ecadca9444556fadfc332/family1 2023-11-19 10:55:23,990 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(855): Successfully loaded hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testCompactionWithHFileLink__ok2t2gi5oe5vet3k9ijotal0uoc4puosv8u3amafumpdp1fhsdv1m9pjforbeh9j/family1/24d040edd2a541848c6424c72f7eb6b6 into 4a83e887540ecadca9444556fadfc332/family1 (new location: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/cbe11e0e0dca4950b7286d52492b00ee_SeqId_34_) 2023-11-19 10:55:23,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testCompactionWithHFileLink__ok2t2gi5oe5vet3k9ijotal0uoc4puosv8u3amafumpdp1fhsdv1m9pjforbeh9j/family1/24d040edd2a541848c6424c72f7eb6b6 2023-11-19 10:55:23,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-19 10:55:23,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-11-19 10:55:23,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(1912): 4a83e887540ecadca9444556fadfc332/family1 is initiating minor compaction (all files) 2023-11-19 10:55:23,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@15965363; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=6), splitQueue=0 2023-11-19 10:55:23,994 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231119 table='testCompactionWithHFileLink' column='family1' 2023-11-19 10:55:23,995 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:55:23,997 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023111941569f188b6f438a9805fe018e660ff6 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023111941569f188b6f438a9805fe018e660ff6 2023-11-19 10:55:23,998 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202311197c4d4dbcefaf4730a6b094a06d1a1610 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202311197c4d4dbcefaf4730a6b094a06d1a1610 2023-11-19 10:55:23,999 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231119ad49a6e2e2f04861aa39bb7d1c84a9d1 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231119ad49a6e2e2f04861aa39bb7d1c84a9d1 2023-11-19 10:55:24,000 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231119d36e7f2d34364bdc8fb49339fb2de294 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231119d36e7f2d34364bdc8fb49339fb2de294 2023-11-19 10:55:24,000 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-19 10:55:24,000 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231119' 2023-11-19 10:55:24,000 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231119 for table='testCompactionWithHFileLink' and column='family1' 2023-11-19 10:55:24,000 INFO [Listener at localhost/42675] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-11-19 10:55:24,003 DEBUG [Listener at localhost/42675] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-19 10:55:24,005 DEBUG [Listener at localhost/42675] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-19 10:55:24,008 DEBUG [Listener at localhost/42675] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-19 10:55:24,009 DEBUG [Listener at localhost/42675] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-19 10:55:24,014 DEBUG [Listener at localhost/42675] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-19 10:55:24,015 DEBUG [Listener at localhost/42675] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-19 10:55:24,031 INFO [Listener at localhost/42675] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=294 (was 239) - Thread LEAK? -, OpenFileDescriptor=801 (was 626) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=172 (was 158) - SystemLoadAverage LEAK? -, ProcessCount=174 (was 171) - ProcessCount LEAK? -, AvailableMemoryMB=15707 (was 15371) - AvailableMemoryMB LEAK? - 2023-11-19 10:55:24,042 INFO [Listener at localhost/42675] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompaction Thread=293, OpenFileDescriptor=801, MaxFileDescriptor=60000, SystemLoadAverage=172, ProcessCount=174, AvailableMemoryMB=15707 2023-11-19 10:55:24,047 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.HMaster$15(3014): Client=jenkins//172.31.14.131 creating {NAME => 'ns'} 2023-11-19 10:55:24,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=ns 2023-11-19 10:55:24,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-11-19 10:55:24,055 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-11-19 10:55:24,058 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; CreateNamespaceProcedure, namespace=ns in 9 msec 2023-11-19 10:55:24,058 DEBUG [RS:0;jenkins-hbase4:46035-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/.tmp/family2/62add6a6895d4f01b4af5864e1e03215 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family2/62add6a6895d4f01b4af5864e1e03215 2023-11-19 10:55:24,062 INFO [RS:0;jenkins-hbase4:46035-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 637f0b3884286bfcfceb56152d715e9d/family2 of 637f0b3884286bfcfceb56152d715e9d into 62add6a6895d4f01b4af5864e1e03215(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-19 10:55:24,062 DEBUG [RS:0;jenkins-hbase4:46035-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 637f0b3884286bfcfceb56152d715e9d: 2023-11-19 10:55:24,062 INFO [RS:0;jenkins-hbase4:46035-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d., storeName=637f0b3884286bfcfceb56152d715e9d/family2, priority=12, startTime=1700391322774; duration=1sec 2023-11-19 10:55:24,062 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/.tmp/family1/44db1afafdc84a5fb754f699ff2051fe as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/44db1afafdc84a5fb754f699ff2051fe 2023-11-19 10:55:24,063 DEBUG [RS:0;jenkins-hbase4:46035-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=6), splitQueue=0 2023-11-19 10:55:24,063 INFO [RS:0;jenkins-hbase4:46035-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 3bb6c0b2c9863082d1a21587d98896c0/family1 in testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0. 2023-11-19 10:55:24,063 INFO [RS:0;jenkins-hbase4:46035-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/testCompactionWithHFileLink=3bb6c0b2c9863082d1a21587d98896c0-e50fef40dd3c40128bc0fa95885d7dab, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/testCompactionWithHFileLink=3bb6c0b2c9863082d1a21587d98896c0-1a192ccf5c384a4b9227c6be349c1cdb, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/testCompactionWithHFileLink=3bb6c0b2c9863082d1a21587d98896c0-3a6ace9e1d19485c9163859fc4342e66, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/testCompactionWithHFileLink=3bb6c0b2c9863082d1a21587d98896c0-50cfabdebac34a6a88ee5aab65fb8770, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/6a16f82ab0444f30ba59db713b40bf4c_SeqId_34_] into tmpdir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/.tmp, totalSize=28.9 K 2023-11-19 10:55:24,063 DEBUG [RS:0;jenkins-hbase4:46035-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=3bb6c0b2c9863082d1a21587d98896c0-e50fef40dd3c40128bc0fa95885d7dab, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700391301646 2023-11-19 10:55:24,064 DEBUG [RS:0;jenkins-hbase4:46035-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=3bb6c0b2c9863082d1a21587d98896c0-1a192ccf5c384a4b9227c6be349c1cdb, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700391303455 2023-11-19 10:55:24,065 DEBUG [RS:0;jenkins-hbase4:46035-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=3bb6c0b2c9863082d1a21587d98896c0-3a6ace9e1d19485c9163859fc4342e66, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700391304868 2023-11-19 10:55:24,065 DEBUG [RS:0;jenkins-hbase4:46035-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=3bb6c0b2c9863082d1a21587d98896c0-50cfabdebac34a6a88ee5aab65fb8770, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700391306670 2023-11-19 10:55:24,066 DEBUG [RS:0;jenkins-hbase4:46035-longCompactions-0] compactions.Compactor(207): Compacting 6a16f82ab0444f30ba59db713b40bf4c_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1700391301646 2023-11-19 10:55:24,067 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 637f0b3884286bfcfceb56152d715e9d/family1 of 637f0b3884286bfcfceb56152d715e9d into 44db1afafdc84a5fb754f699ff2051fe(size=7.6 K), total size for store is 14.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-19 10:55:24,067 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 637f0b3884286bfcfceb56152d715e9d: 2023-11-19 10:55:24,067 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d., storeName=637f0b3884286bfcfceb56152d715e9d/family1, priority=12, startTime=1700391322774; duration=1sec 2023-11-19 10:55:24,067 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-11-19 10:55:24,067 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 4a83e887540ecadca9444556fadfc332/family1 in testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332. 2023-11-19 10:55:24,067 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/testCompactionWithHFileLink=4a83e887540ecadca9444556fadfc332-0372b9105a144b4a8aaef5a3dc101a63, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/testCompactionWithHFileLink=4a83e887540ecadca9444556fadfc332-bfcb67f7218c4938aa6226f4b310974c, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/testCompactionWithHFileLink=4a83e887540ecadca9444556fadfc332-b5f58cf5e2f5425e9430630e361758ce, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/testCompactionWithHFileLink=4a83e887540ecadca9444556fadfc332-4c5188c6e778445caff4c373976479e9, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/cbe11e0e0dca4950b7286d52492b00ee_SeqId_34_] into tmpdir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/.tmp, totalSize=28.9 K 2023-11-19 10:55:24,067 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=4a83e887540ecadca9444556fadfc332-0372b9105a144b4a8aaef5a3dc101a63, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700391301645 2023-11-19 10:55:24,068 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=4a83e887540ecadca9444556fadfc332-bfcb67f7218c4938aa6226f4b310974c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700391303455 2023-11-19 10:55:24,069 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=4a83e887540ecadca9444556fadfc332-b5f58cf5e2f5425e9430630e361758ce, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700391304868 2023-11-19 10:55:24,070 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=4a83e887540ecadca9444556fadfc332-4c5188c6e778445caff4c373976479e9, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700391306670 2023-11-19 10:55:24,070 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting cbe11e0e0dca4950b7286d52492b00ee_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1700391301645 2023-11-19 10:55:24,080 INFO [RS:0;jenkins-hbase4:46035-longCompactions-0] throttle.PressureAwareThroughputController(145): 3bb6c0b2c9863082d1a21587d98896c0#family1#compaction#116 average throughput is 0.78 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-11-19 10:55:24,083 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] throttle.PressureAwareThroughputController(145): 4a83e887540ecadca9444556fadfc332#family1#compaction#117 average throughput is 1.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-11-19 10:55:24,129 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/testCompactionWithHFileLink=637f0b3884286bfcfceb56152d715e9d-6ce54f57ed0d4ff3be15c835afea0542, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/testCompactionWithHFileLink=637f0b3884286bfcfceb56152d715e9d-e6f86413cc15400981952800b7cd63ba, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/testCompactionWithHFileLink=637f0b3884286bfcfceb56152d715e9d-ac2fe88928b040f1abd62cc82dd57b34, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/testCompactionWithHFileLink=637f0b3884286bfcfceb56152d715e9d-05c787f40212496d9d807f1c78e870dc] to archive 2023-11-19 10:55:24,129 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:55:24,131 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/testCompactionWithHFileLink=637f0b3884286bfcfceb56152d715e9d-6ce54f57ed0d4ff3be15c835afea0542 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/testCompactionWithHFileLink=637f0b3884286bfcfceb56152d715e9d-6ce54f57ed0d4ff3be15c835afea0542 2023-11-19 10:55:24,132 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/testCompactionWithHFileLink=637f0b3884286bfcfceb56152d715e9d-e6f86413cc15400981952800b7cd63ba to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/testCompactionWithHFileLink=637f0b3884286bfcfceb56152d715e9d-e6f86413cc15400981952800b7cd63ba 2023-11-19 10:55:24,133 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/testCompactionWithHFileLink=637f0b3884286bfcfceb56152d715e9d-ac2fe88928b040f1abd62cc82dd57b34 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/testCompactionWithHFileLink=637f0b3884286bfcfceb56152d715e9d-ac2fe88928b040f1abd62cc82dd57b34 2023-11-19 10:55:24,135 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/testCompactionWithHFileLink=637f0b3884286bfcfceb56152d715e9d-05c787f40212496d9d807f1c78e870dc to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family1/testCompactionWithHFileLink=637f0b3884286bfcfceb56152d715e9d-05c787f40212496d9d807f1c78e870dc 2023-11-19 10:55:24,137 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family2/testCompactionWithHFileLink=637f0b3884286bfcfceb56152d715e9d-4514248a5e4c40a18c2176148afa3a70, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family2/testCompactionWithHFileLink=637f0b3884286bfcfceb56152d715e9d-f110b6db2dc64eeb9eb40bee5be84288, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family2/testCompactionWithHFileLink=637f0b3884286bfcfceb56152d715e9d-ba44e63e3aab4a2696e51a294c0e959d, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family2/testCompactionWithHFileLink=637f0b3884286bfcfceb56152d715e9d-e2bd97573076422091726d2553c6895e] to archive 2023-11-19 10:55:24,137 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:55:24,139 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family2/testCompactionWithHFileLink=637f0b3884286bfcfceb56152d715e9d-4514248a5e4c40a18c2176148afa3a70 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family2/testCompactionWithHFileLink=637f0b3884286bfcfceb56152d715e9d-4514248a5e4c40a18c2176148afa3a70 2023-11-19 10:55:24,141 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family2/testCompactionWithHFileLink=637f0b3884286bfcfceb56152d715e9d-f110b6db2dc64eeb9eb40bee5be84288 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family2/testCompactionWithHFileLink=637f0b3884286bfcfceb56152d715e9d-f110b6db2dc64eeb9eb40bee5be84288 2023-11-19 10:55:24,142 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family2/testCompactionWithHFileLink=637f0b3884286bfcfceb56152d715e9d-ba44e63e3aab4a2696e51a294c0e959d to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family2/testCompactionWithHFileLink=637f0b3884286bfcfceb56152d715e9d-ba44e63e3aab4a2696e51a294c0e959d 2023-11-19 10:55:24,143 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family2/testCompactionWithHFileLink=637f0b3884286bfcfceb56152d715e9d-e2bd97573076422091726d2553c6895e to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/family2/testCompactionWithHFileLink=637f0b3884286bfcfceb56152d715e9d-e2bd97573076422091726d2553c6895e 2023-11-19 10:55:24,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-11-19 10:55:24,155 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-19 10:55:24,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=ns:testMinorCompaction 2023-11-19 10:55:24,157 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-11-19 10:55:24,157 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "ns" qualifier: "testMinorCompaction" procId is: 105 2023-11-19 10:55:24,157 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-19 10:55:24,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-19 10:55:24,159 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca 2023-11-19 10:55:24,159 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da 2023-11-19 10:55:24,159 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474 2023-11-19 10:55:24,159 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca empty. 2023-11-19 10:55:24,159 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da empty. 2023-11-19 10:55:24,159 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474 empty. 2023-11-19 10:55:24,160 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca 2023-11-19 10:55:24,160 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da 2023-11-19 10:55:24,160 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474 2023-11-19 10:55:24,160 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived ns:testMinorCompaction regions 2023-11-19 10:55:24,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-19 10:55:24,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-19 10:55:24,496 DEBUG [RS:0;jenkins-hbase4:46035-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/.tmp/family1/6351134f00b44865a0eccf83189cc160 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/6351134f00b44865a0eccf83189cc160 2023-11-19 10:55:24,497 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/.tmp/family1/b03b6adef1de4bb4853674fd4c009db8 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/b03b6adef1de4bb4853674fd4c009db8 2023-11-19 10:55:24,501 INFO [RS:0;jenkins-hbase4:46035-longCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in 3bb6c0b2c9863082d1a21587d98896c0/family1 of 3bb6c0b2c9863082d1a21587d98896c0 into 6351134f00b44865a0eccf83189cc160(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-19 10:55:24,501 DEBUG [RS:0;jenkins-hbase4:46035-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 3bb6c0b2c9863082d1a21587d98896c0: 2023-11-19 10:55:24,501 INFO [RS:0;jenkins-hbase4:46035-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1700391323619; duration=0sec 2023-11-19 10:55:24,501 DEBUG [RS:0;jenkins-hbase4:46035-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-11-19 10:55:24,501 DEBUG [RS:0;jenkins-hbase4:46035-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-19 10:55:24,502 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in 4a83e887540ecadca9444556fadfc332/family1 of 4a83e887540ecadca9444556fadfc332 into b03b6adef1de4bb4853674fd4c009db8(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-19 10:55:24,502 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 4a83e887540ecadca9444556fadfc332: 2023-11-19 10:55:24,502 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1700391323992; duration=0sec 2023-11-19 10:55:24,502 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-11-19 10:55:24,502 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-19 10:55:24,503 DEBUG [RS:0;jenkins-hbase4:46035-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-19 10:55:24,503 DEBUG [RS:0;jenkins-hbase4:46035-longCompactions-0] regionserver.HStore(1912): 3bb6c0b2c9863082d1a21587d98896c0/family2 is initiating minor compaction (all files) 2023-11-19 10:55:24,504 INFO [RS:0;jenkins-hbase4:46035-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 3bb6c0b2c9863082d1a21587d98896c0/family2 in testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0. 2023-11-19 10:55:24,504 INFO [RS:0;jenkins-hbase4:46035-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family2/testCompactionWithHFileLink=3bb6c0b2c9863082d1a21587d98896c0-5e1ddebf717143dd894f0cda6b80e167, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family2/testCompactionWithHFileLink=3bb6c0b2c9863082d1a21587d98896c0-4845a1ccc26a493ba944c124fee0873d, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family2/testCompactionWithHFileLink=3bb6c0b2c9863082d1a21587d98896c0-65763493d9b84815a761f0299a47abfa, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family2/testCompactionWithHFileLink=3bb6c0b2c9863082d1a21587d98896c0-c628e404e9d6494db8abb403651cbd06] into tmpdir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/.tmp, totalSize=20.4 K 2023-11-19 10:55:24,504 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-19 10:55:24,504 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HStore(1912): 4a83e887540ecadca9444556fadfc332/family2 is initiating minor compaction (all files) 2023-11-19 10:55:24,504 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 4a83e887540ecadca9444556fadfc332/family2 in testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332. 2023-11-19 10:55:24,504 DEBUG [RS:0;jenkins-hbase4:46035-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=3bb6c0b2c9863082d1a21587d98896c0-5e1ddebf717143dd894f0cda6b80e167, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700391301646 2023-11-19 10:55:24,504 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family2/testCompactionWithHFileLink=4a83e887540ecadca9444556fadfc332-d88c375eb41c48309e3230ffee5ac927, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family2/testCompactionWithHFileLink=4a83e887540ecadca9444556fadfc332-87683fada1bc4361bef06981be006667, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family2/testCompactionWithHFileLink=4a83e887540ecadca9444556fadfc332-8bfd838e615a4158b81518f03b3d4f70, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family2/testCompactionWithHFileLink=4a83e887540ecadca9444556fadfc332-bc0941dc9bb04974a011a607c8cd6d95] into tmpdir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/.tmp, totalSize=20.4 K 2023-11-19 10:55:24,505 DEBUG [RS:0;jenkins-hbase4:46035-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=3bb6c0b2c9863082d1a21587d98896c0-4845a1ccc26a493ba944c124fee0873d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700391303455 2023-11-19 10:55:24,505 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=4a83e887540ecadca9444556fadfc332-d88c375eb41c48309e3230ffee5ac927, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700391301645 2023-11-19 10:55:24,506 DEBUG [RS:0;jenkins-hbase4:46035-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=3bb6c0b2c9863082d1a21587d98896c0-65763493d9b84815a761f0299a47abfa, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700391304868 2023-11-19 10:55:24,506 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=4a83e887540ecadca9444556fadfc332-87683fada1bc4361bef06981be006667, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700391303455 2023-11-19 10:55:24,506 DEBUG [RS:0;jenkins-hbase4:46035-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=3bb6c0b2c9863082d1a21587d98896c0-c628e404e9d6494db8abb403651cbd06, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700391306670 2023-11-19 10:55:24,506 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=4a83e887540ecadca9444556fadfc332-8bfd838e615a4158b81518f03b3d4f70, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700391304868 2023-11-19 10:55:24,507 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=4a83e887540ecadca9444556fadfc332-bc0941dc9bb04974a011a607c8cd6d95, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700391306670 2023-11-19 10:55:24,520 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] throttle.PressureAwareThroughputController(145): 4a83e887540ecadca9444556fadfc332#family2#compaction#119 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 53.85 MB/second 2023-11-19 10:55:24,523 INFO [RS:0;jenkins-hbase4:46035-longCompactions-0] throttle.PressureAwareThroughputController(145): 3bb6c0b2c9863082d1a21587d98896c0#family2#compaction#118 average throughput is 0.23 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-11-19 10:55:24,534 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/testCompactionWithHFileLink=4a83e887540ecadca9444556fadfc332-0372b9105a144b4a8aaef5a3dc101a63, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/testCompactionWithHFileLink=4a83e887540ecadca9444556fadfc332-bfcb67f7218c4938aa6226f4b310974c, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/testCompactionWithHFileLink=4a83e887540ecadca9444556fadfc332-b5f58cf5e2f5425e9430630e361758ce, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/testCompactionWithHFileLink=4a83e887540ecadca9444556fadfc332-4c5188c6e778445caff4c373976479e9, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/cbe11e0e0dca4950b7286d52492b00ee_SeqId_34_] to archive 2023-11-19 10:55:24,534 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:55:24,535 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/testCompactionWithHFileLink=4a83e887540ecadca9444556fadfc332-0372b9105a144b4a8aaef5a3dc101a63 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/testCompactionWithHFileLink=4a83e887540ecadca9444556fadfc332-0372b9105a144b4a8aaef5a3dc101a63 2023-11-19 10:55:24,536 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/testCompactionWithHFileLink=4a83e887540ecadca9444556fadfc332-bfcb67f7218c4938aa6226f4b310974c to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/testCompactionWithHFileLink=4a83e887540ecadca9444556fadfc332-bfcb67f7218c4938aa6226f4b310974c 2023-11-19 10:55:24,537 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/testCompactionWithHFileLink=4a83e887540ecadca9444556fadfc332-b5f58cf5e2f5425e9430630e361758ce to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/testCompactionWithHFileLink=4a83e887540ecadca9444556fadfc332-b5f58cf5e2f5425e9430630e361758ce 2023-11-19 10:55:24,538 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/testCompactionWithHFileLink=4a83e887540ecadca9444556fadfc332-4c5188c6e778445caff4c373976479e9 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/testCompactionWithHFileLink=4a83e887540ecadca9444556fadfc332-4c5188c6e778445caff4c373976479e9 2023-11-19 10:55:24,539 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/cbe11e0e0dca4950b7286d52492b00ee_SeqId_34_ to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family1/cbe11e0e0dca4950b7286d52492b00ee_SeqId_34_ 2023-11-19 10:55:24,540 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/testCompactionWithHFileLink=3bb6c0b2c9863082d1a21587d98896c0-e50fef40dd3c40128bc0fa95885d7dab, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/testCompactionWithHFileLink=3bb6c0b2c9863082d1a21587d98896c0-1a192ccf5c384a4b9227c6be349c1cdb, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/testCompactionWithHFileLink=3bb6c0b2c9863082d1a21587d98896c0-3a6ace9e1d19485c9163859fc4342e66, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/testCompactionWithHFileLink=3bb6c0b2c9863082d1a21587d98896c0-50cfabdebac34a6a88ee5aab65fb8770, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/6a16f82ab0444f30ba59db713b40bf4c_SeqId_34_] to archive 2023-11-19 10:55:24,541 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:55:24,542 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/testCompactionWithHFileLink=3bb6c0b2c9863082d1a21587d98896c0-e50fef40dd3c40128bc0fa95885d7dab to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/testCompactionWithHFileLink=3bb6c0b2c9863082d1a21587d98896c0-e50fef40dd3c40128bc0fa95885d7dab 2023-11-19 10:55:24,543 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/testCompactionWithHFileLink=3bb6c0b2c9863082d1a21587d98896c0-1a192ccf5c384a4b9227c6be349c1cdb to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/testCompactionWithHFileLink=3bb6c0b2c9863082d1a21587d98896c0-1a192ccf5c384a4b9227c6be349c1cdb 2023-11-19 10:55:24,544 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/testCompactionWithHFileLink=3bb6c0b2c9863082d1a21587d98896c0-3a6ace9e1d19485c9163859fc4342e66 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/testCompactionWithHFileLink=3bb6c0b2c9863082d1a21587d98896c0-3a6ace9e1d19485c9163859fc4342e66 2023-11-19 10:55:24,545 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/testCompactionWithHFileLink=3bb6c0b2c9863082d1a21587d98896c0-50cfabdebac34a6a88ee5aab65fb8770 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/testCompactionWithHFileLink=3bb6c0b2c9863082d1a21587d98896c0-50cfabdebac34a6a88ee5aab65fb8770 2023-11-19 10:55:24,546 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/6a16f82ab0444f30ba59db713b40bf4c_SeqId_34_ to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family1/6a16f82ab0444f30ba59db713b40bf4c_SeqId_34_ 2023-11-19 10:55:24,567 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/ns/testMinorCompaction/.tabledesc/.tableinfo.0000000001 2023-11-19 10:55:24,568 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => cc4d248c67f2406eabe5365c5a2f50ca, NAME => 'ns:testMinorCompaction,,1700391324155.cc4d248c67f2406eabe5365c5a2f50ca.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp 2023-11-19 10:55:24,569 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(7675): creating {ENCODED => b427a1d00a803e63acb916b5a78a19da, NAME => 'ns:testMinorCompaction,1,1700391324155.b427a1d00a803e63acb916b5a78a19da.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp 2023-11-19 10:55:24,569 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(7675): creating {ENCODED => cb7ee8609abfbe5e360af47e0bf92474, NAME => 'ns:testMinorCompaction,2,1700391324155.cb7ee8609abfbe5e360af47e0bf92474.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp 2023-11-19 10:55:24,584 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1700391324155.cc4d248c67f2406eabe5365c5a2f50ca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-19 10:55:24,584 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1604): Closing cc4d248c67f2406eabe5365c5a2f50ca, disabling compactions & flushes 2023-11-19 10:55:24,584 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1700391324155.cc4d248c67f2406eabe5365c5a2f50ca. 2023-11-19 10:55:24,585 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1700391324155.cc4d248c67f2406eabe5365c5a2f50ca. 2023-11-19 10:55:24,585 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1700391324155.cc4d248c67f2406eabe5365c5a2f50ca. after waiting 0 ms 2023-11-19 10:55:24,585 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1700391324155.cc4d248c67f2406eabe5365c5a2f50ca. 2023-11-19 10:55:24,585 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1700391324155.cc4d248c67f2406eabe5365c5a2f50ca. 2023-11-19 10:55:24,585 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1558): Region close journal for cc4d248c67f2406eabe5365c5a2f50ca: 2023-11-19 10:55:24,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-19 10:55:24,978 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1700391324155.cb7ee8609abfbe5e360af47e0bf92474.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-19 10:55:24,979 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1604): Closing cb7ee8609abfbe5e360af47e0bf92474, disabling compactions & flushes 2023-11-19 10:55:24,979 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1700391324155.cb7ee8609abfbe5e360af47e0bf92474. 2023-11-19 10:55:24,979 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1700391324155.cb7ee8609abfbe5e360af47e0bf92474. 2023-11-19 10:55:24,979 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1700391324155.cb7ee8609abfbe5e360af47e0bf92474. after waiting 0 ms 2023-11-19 10:55:24,979 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1700391324155.cb7ee8609abfbe5e360af47e0bf92474. 2023-11-19 10:55:24,979 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1700391324155.cb7ee8609abfbe5e360af47e0bf92474. 2023-11-19 10:55:24,979 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1558): Region close journal for cb7ee8609abfbe5e360af47e0bf92474: 2023-11-19 10:55:24,986 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1700391324155.b427a1d00a803e63acb916b5a78a19da.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-19 10:55:24,986 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1604): Closing b427a1d00a803e63acb916b5a78a19da, disabling compactions & flushes 2023-11-19 10:55:24,986 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1700391324155.b427a1d00a803e63acb916b5a78a19da. 2023-11-19 10:55:24,986 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1700391324155.b427a1d00a803e63acb916b5a78a19da. 2023-11-19 10:55:24,986 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1700391324155.b427a1d00a803e63acb916b5a78a19da. after waiting 0 ms 2023-11-19 10:55:24,986 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1700391324155.b427a1d00a803e63acb916b5a78a19da. 2023-11-19 10:55:24,986 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1700391324155.b427a1d00a803e63acb916b5a78a19da. 2023-11-19 10:55:24,986 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1558): Region close journal for b427a1d00a803e63acb916b5a78a19da: 2023-11-19 10:55:24,988 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-11-19 10:55:24,989 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,,1700391324155.cc4d248c67f2406eabe5365c5a2f50ca.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1700391324989"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700391324989"}]},"ts":"1700391324989"} 2023-11-19 10:55:24,990 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,2,1700391324155.cb7ee8609abfbe5e360af47e0bf92474.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1700391324989"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700391324989"}]},"ts":"1700391324989"} 2023-11-19 10:55:24,990 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,1,1700391324155.b427a1d00a803e63acb916b5a78a19da.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1700391324989"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700391324989"}]},"ts":"1700391324989"} 2023-11-19 10:55:24,991 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-19 10:55:24,992 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-19 10:55:24,992 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700391324992"}]},"ts":"1700391324992"} 2023-11-19 10:55:24,993 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLING in hbase:meta 2023-11-19 10:55:25,001 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=cc4d248c67f2406eabe5365c5a2f50ca, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=b427a1d00a803e63acb916b5a78a19da, ASSIGN}, {pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=cb7ee8609abfbe5e360af47e0bf92474, ASSIGN}] 2023-11-19 10:55:25,003 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=cb7ee8609abfbe5e360af47e0bf92474, ASSIGN 2023-11-19 10:55:25,003 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=cc4d248c67f2406eabe5365c5a2f50ca, ASSIGN 2023-11-19 10:55:25,003 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=b427a1d00a803e63acb916b5a78a19da, ASSIGN 2023-11-19 10:55:25,004 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=cc4d248c67f2406eabe5365c5a2f50ca, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46035,1700391201579; forceNewPlan=false, retain=false 2023-11-19 10:55:25,004 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=b427a1d00a803e63acb916b5a78a19da, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46035,1700391201579; forceNewPlan=false, retain=false 2023-11-19 10:55:25,004 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=cb7ee8609abfbe5e360af47e0bf92474, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46035,1700391201579; forceNewPlan=false, retain=false 2023-11-19 10:55:25,157 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=b427a1d00a803e63acb916b5a78a19da, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:25,157 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=cb7ee8609abfbe5e360af47e0bf92474, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:25,157 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=cc4d248c67f2406eabe5365c5a2f50ca, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:25,157 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,1,1700391324155.b427a1d00a803e63acb916b5a78a19da.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1700391325157"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700391325157"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700391325157"}]},"ts":"1700391325157"} 2023-11-19 10:55:25,157 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,,1700391324155.cc4d248c67f2406eabe5365c5a2f50ca.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1700391325157"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700391325157"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700391325157"}]},"ts":"1700391325157"} 2023-11-19 10:55:25,157 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,2,1700391324155.cb7ee8609abfbe5e360af47e0bf92474.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1700391325157"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700391325157"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700391325157"}]},"ts":"1700391325157"} 2023-11-19 10:55:25,159 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure b427a1d00a803e63acb916b5a78a19da, server=jenkins-hbase4.apache.org,46035,1700391201579}] 2023-11-19 10:55:25,159 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=110, ppid=106, state=RUNNABLE; OpenRegionProcedure cc4d248c67f2406eabe5365c5a2f50ca, server=jenkins-hbase4.apache.org,46035,1700391201579}] 2023-11-19 10:55:25,160 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=111, ppid=108, state=RUNNABLE; OpenRegionProcedure cb7ee8609abfbe5e360af47e0bf92474, server=jenkins-hbase4.apache.org,46035,1700391201579}] 2023-11-19 10:55:25,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-19 10:55:25,311 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:25,313 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,1,1700391324155.b427a1d00a803e63acb916b5a78a19da. 2023-11-19 10:55:25,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b427a1d00a803e63acb916b5a78a19da, NAME => 'ns:testMinorCompaction,1,1700391324155.b427a1d00a803e63acb916b5a78a19da.', STARTKEY => '1', ENDKEY => '2'} 2023-11-19 10:55:25,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction b427a1d00a803e63acb916b5a78a19da 2023-11-19 10:55:25,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1700391324155.b427a1d00a803e63acb916b5a78a19da.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-19 10:55:25,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b427a1d00a803e63acb916b5a78a19da 2023-11-19 10:55:25,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b427a1d00a803e63acb916b5a78a19da 2023-11-19 10:55:25,315 INFO [StoreOpener-b427a1d00a803e63acb916b5a78a19da-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region b427a1d00a803e63acb916b5a78a19da 2023-11-19 10:55:25,316 DEBUG [StoreOpener-b427a1d00a803e63acb916b5a78a19da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/family1 2023-11-19 10:55:25,316 DEBUG [StoreOpener-b427a1d00a803e63acb916b5a78a19da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/family1 2023-11-19 10:55:25,316 INFO [StoreOpener-b427a1d00a803e63acb916b5a78a19da-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b427a1d00a803e63acb916b5a78a19da columnFamilyName family1 2023-11-19 10:55:25,318 INFO [StoreOpener-b427a1d00a803e63acb916b5a78a19da-1] regionserver.HStore(310): Store=b427a1d00a803e63acb916b5a78a19da/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-19 10:55:25,318 INFO [StoreOpener-b427a1d00a803e63acb916b5a78a19da-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region b427a1d00a803e63acb916b5a78a19da 2023-11-19 10:55:25,319 DEBUG [StoreOpener-b427a1d00a803e63acb916b5a78a19da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/family2 2023-11-19 10:55:25,319 DEBUG [StoreOpener-b427a1d00a803e63acb916b5a78a19da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/family2 2023-11-19 10:55:25,319 INFO [StoreOpener-b427a1d00a803e63acb916b5a78a19da-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b427a1d00a803e63acb916b5a78a19da columnFamilyName family2 2023-11-19 10:55:25,320 INFO [StoreOpener-b427a1d00a803e63acb916b5a78a19da-1] regionserver.HStore(310): Store=b427a1d00a803e63acb916b5a78a19da/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-19 10:55:25,321 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da 2023-11-19 10:55:25,321 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da 2023-11-19 10:55:25,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-19 10:55:25,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b427a1d00a803e63acb916b5a78a19da 2023-11-19 10:55:25,325 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-19 10:55:25,326 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b427a1d00a803e63acb916b5a78a19da; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70614574, jitterRate=0.05223914980888367}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-19 10:55:25,326 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b427a1d00a803e63acb916b5a78a19da: 2023-11-19 10:55:25,326 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,1,1700391324155.b427a1d00a803e63acb916b5a78a19da., pid=109, masterSystemTime=1700391325311 2023-11-19 10:55:25,327 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,1,1700391324155.b427a1d00a803e63acb916b5a78a19da. 2023-11-19 10:55:25,327 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,1,1700391324155.b427a1d00a803e63acb916b5a78a19da. 2023-11-19 10:55:25,328 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,,1700391324155.cc4d248c67f2406eabe5365c5a2f50ca. 2023-11-19 10:55:25,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cc4d248c67f2406eabe5365c5a2f50ca, NAME => 'ns:testMinorCompaction,,1700391324155.cc4d248c67f2406eabe5365c5a2f50ca.', STARTKEY => '', ENDKEY => '1'} 2023-11-19 10:55:25,328 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=b427a1d00a803e63acb916b5a78a19da, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:25,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction cc4d248c67f2406eabe5365c5a2f50ca 2023-11-19 10:55:25,328 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,1,1700391324155.b427a1d00a803e63acb916b5a78a19da.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1700391325328"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700391325328"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700391325328"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700391325328"}]},"ts":"1700391325328"} 2023-11-19 10:55:25,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1700391324155.cc4d248c67f2406eabe5365c5a2f50ca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-19 10:55:25,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for cc4d248c67f2406eabe5365c5a2f50ca 2023-11-19 10:55:25,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for cc4d248c67f2406eabe5365c5a2f50ca 2023-11-19 10:55:25,329 INFO [StoreOpener-cc4d248c67f2406eabe5365c5a2f50ca-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region cc4d248c67f2406eabe5365c5a2f50ca 2023-11-19 10:55:25,330 DEBUG [StoreOpener-cc4d248c67f2406eabe5365c5a2f50ca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/family1 2023-11-19 10:55:25,330 DEBUG [StoreOpener-cc4d248c67f2406eabe5365c5a2f50ca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/family1 2023-11-19 10:55:25,330 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=107 2023-11-19 10:55:25,331 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure b427a1d00a803e63acb916b5a78a19da, server=jenkins-hbase4.apache.org,46035,1700391201579 in 170 msec 2023-11-19 10:55:25,331 INFO [StoreOpener-cc4d248c67f2406eabe5365c5a2f50ca-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cc4d248c67f2406eabe5365c5a2f50ca columnFamilyName family1 2023-11-19 10:55:25,331 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=b427a1d00a803e63acb916b5a78a19da, ASSIGN in 329 msec 2023-11-19 10:55:25,332 INFO [StoreOpener-cc4d248c67f2406eabe5365c5a2f50ca-1] regionserver.HStore(310): Store=cc4d248c67f2406eabe5365c5a2f50ca/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-19 10:55:25,332 INFO [StoreOpener-cc4d248c67f2406eabe5365c5a2f50ca-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region cc4d248c67f2406eabe5365c5a2f50ca 2023-11-19 10:55:25,333 DEBUG [StoreOpener-cc4d248c67f2406eabe5365c5a2f50ca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/family2 2023-11-19 10:55:25,333 DEBUG [StoreOpener-cc4d248c67f2406eabe5365c5a2f50ca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/family2 2023-11-19 10:55:25,333 INFO [StoreOpener-cc4d248c67f2406eabe5365c5a2f50ca-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cc4d248c67f2406eabe5365c5a2f50ca columnFamilyName family2 2023-11-19 10:55:25,334 INFO [StoreOpener-cc4d248c67f2406eabe5365c5a2f50ca-1] regionserver.HStore(310): Store=cc4d248c67f2406eabe5365c5a2f50ca/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-19 10:55:25,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca 2023-11-19 10:55:25,336 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca 2023-11-19 10:55:25,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-19 10:55:25,338 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for cc4d248c67f2406eabe5365c5a2f50ca 2023-11-19 10:55:25,338 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/.tmp/family2/6e0ad7d459c14a98b1526e4ebf103d8d as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family2/6e0ad7d459c14a98b1526e4ebf103d8d 2023-11-19 10:55:25,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-19 10:55:25,340 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened cc4d248c67f2406eabe5365c5a2f50ca; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62520129, jitterRate=-0.06837747991085052}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-19 10:55:25,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for cc4d248c67f2406eabe5365c5a2f50ca: 2023-11-19 10:55:25,341 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,,1700391324155.cc4d248c67f2406eabe5365c5a2f50ca., pid=110, masterSystemTime=1700391325311 2023-11-19 10:55:25,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,,1700391324155.cc4d248c67f2406eabe5365c5a2f50ca. 2023-11-19 10:55:25,342 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,,1700391324155.cc4d248c67f2406eabe5365c5a2f50ca. 2023-11-19 10:55:25,342 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,2,1700391324155.cb7ee8609abfbe5e360af47e0bf92474. 2023-11-19 10:55:25,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cb7ee8609abfbe5e360af47e0bf92474, NAME => 'ns:testMinorCompaction,2,1700391324155.cb7ee8609abfbe5e360af47e0bf92474.', STARTKEY => '2', ENDKEY => ''} 2023-11-19 10:55:25,342 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=cc4d248c67f2406eabe5365c5a2f50ca, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:25,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction cb7ee8609abfbe5e360af47e0bf92474 2023-11-19 10:55:25,343 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,,1700391324155.cc4d248c67f2406eabe5365c5a2f50ca.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1700391325342"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700391325342"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700391325342"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700391325342"}]},"ts":"1700391325342"} 2023-11-19 10:55:25,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1700391324155.cb7ee8609abfbe5e360af47e0bf92474.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-19 10:55:25,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for cb7ee8609abfbe5e360af47e0bf92474 2023-11-19 10:55:25,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for cb7ee8609abfbe5e360af47e0bf92474 2023-11-19 10:55:25,343 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 4a83e887540ecadca9444556fadfc332/family2 of 4a83e887540ecadca9444556fadfc332 into 6e0ad7d459c14a98b1526e4ebf103d8d(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-19 10:55:25,343 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 4a83e887540ecadca9444556fadfc332: 2023-11-19 10:55:25,343 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332., storeName=4a83e887540ecadca9444556fadfc332/family2, priority=12, startTime=1700391322955; duration=0sec 2023-11-19 10:55:25,343 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-11-19 10:55:25,343 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-11-19 10:55:25,344 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-11-19 10:55:25,344 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-11-19 10:55:25,344 INFO [StoreOpener-cb7ee8609abfbe5e360af47e0bf92474-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region cb7ee8609abfbe5e360af47e0bf92474 2023-11-19 10:55:25,344 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332. because compaction request was cancelled 2023-11-19 10:55:25,344 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-11-19 10:55:25,344 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-11-19 10:55:25,344 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-11-19 10:55:25,344 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0. because compaction request was cancelled 2023-11-19 10:55:25,345 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=110, resume processing ppid=106 2023-11-19 10:55:25,345 DEBUG [StoreOpener-cb7ee8609abfbe5e360af47e0bf92474-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/family1 2023-11-19 10:55:25,345 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=110, ppid=106, state=SUCCESS; OpenRegionProcedure cc4d248c67f2406eabe5365c5a2f50ca, server=jenkins-hbase4.apache.org,46035,1700391201579 in 185 msec 2023-11-19 10:55:25,345 DEBUG [StoreOpener-cb7ee8609abfbe5e360af47e0bf92474-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/family1 2023-11-19 10:55:25,345 INFO [StoreOpener-cb7ee8609abfbe5e360af47e0bf92474-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cb7ee8609abfbe5e360af47e0bf92474 columnFamilyName family1 2023-11-19 10:55:25,346 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=cc4d248c67f2406eabe5365c5a2f50ca, ASSIGN in 344 msec 2023-11-19 10:55:25,346 INFO [StoreOpener-cb7ee8609abfbe5e360af47e0bf92474-1] regionserver.HStore(310): Store=cb7ee8609abfbe5e360af47e0bf92474/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-19 10:55:25,346 INFO [StoreOpener-cb7ee8609abfbe5e360af47e0bf92474-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region cb7ee8609abfbe5e360af47e0bf92474 2023-11-19 10:55:25,347 DEBUG [StoreOpener-cb7ee8609abfbe5e360af47e0bf92474-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/family2 2023-11-19 10:55:25,347 DEBUG [StoreOpener-cb7ee8609abfbe5e360af47e0bf92474-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/family2 2023-11-19 10:55:25,348 INFO [StoreOpener-cb7ee8609abfbe5e360af47e0bf92474-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cb7ee8609abfbe5e360af47e0bf92474 columnFamilyName family2 2023-11-19 10:55:25,348 INFO [StoreOpener-cb7ee8609abfbe5e360af47e0bf92474-1] regionserver.HStore(310): Store=cb7ee8609abfbe5e360af47e0bf92474/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-19 10:55:25,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474 2023-11-19 10:55:25,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474 2023-11-19 10:55:25,350 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-19 10:55:25,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for cb7ee8609abfbe5e360af47e0bf92474 2023-11-19 10:55:25,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-19 10:55:25,353 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened cb7ee8609abfbe5e360af47e0bf92474; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63551428, jitterRate=-0.05300992727279663}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-19 10:55:25,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for cb7ee8609abfbe5e360af47e0bf92474: 2023-11-19 10:55:25,353 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,2,1700391324155.cb7ee8609abfbe5e360af47e0bf92474., pid=111, masterSystemTime=1700391325311 2023-11-19 10:55:25,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,2,1700391324155.cb7ee8609abfbe5e360af47e0bf92474. 2023-11-19 10:55:25,354 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,2,1700391324155.cb7ee8609abfbe5e360af47e0bf92474. 2023-11-19 10:55:25,355 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=cb7ee8609abfbe5e360af47e0bf92474, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:25,355 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,2,1700391324155.cb7ee8609abfbe5e360af47e0bf92474.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1700391325355"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700391325355"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700391325355"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700391325355"}]},"ts":"1700391325355"} 2023-11-19 10:55:25,357 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=111, resume processing ppid=108 2023-11-19 10:55:25,357 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=111, ppid=108, state=SUCCESS; OpenRegionProcedure cb7ee8609abfbe5e360af47e0bf92474, server=jenkins-hbase4.apache.org,46035,1700391201579 in 196 msec 2023-11-19 10:55:25,358 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=105 2023-11-19 10:55:25,359 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=cb7ee8609abfbe5e360af47e0bf92474, ASSIGN in 356 msec 2023-11-19 10:55:25,359 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-19 10:55:25,359 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700391325359"}]},"ts":"1700391325359"} 2023-11-19 10:55:25,360 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLED in hbase:meta 2023-11-19 10:55:25,362 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-11-19 10:55:25,363 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=ns:testMinorCompaction in 1.2070 sec 2023-11-19 10:55:25,427 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family2/testCompactionWithHFileLink=4a83e887540ecadca9444556fadfc332-d88c375eb41c48309e3230ffee5ac927, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family2/testCompactionWithHFileLink=4a83e887540ecadca9444556fadfc332-87683fada1bc4361bef06981be006667, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family2/testCompactionWithHFileLink=4a83e887540ecadca9444556fadfc332-8bfd838e615a4158b81518f03b3d4f70, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family2/testCompactionWithHFileLink=4a83e887540ecadca9444556fadfc332-bc0941dc9bb04974a011a607c8cd6d95] to archive 2023-11-19 10:55:25,428 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:55:25,429 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family2/testCompactionWithHFileLink=4a83e887540ecadca9444556fadfc332-d88c375eb41c48309e3230ffee5ac927 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family2/testCompactionWithHFileLink=4a83e887540ecadca9444556fadfc332-d88c375eb41c48309e3230ffee5ac927 2023-11-19 10:55:25,430 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family2/testCompactionWithHFileLink=4a83e887540ecadca9444556fadfc332-87683fada1bc4361bef06981be006667 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family2/testCompactionWithHFileLink=4a83e887540ecadca9444556fadfc332-87683fada1bc4361bef06981be006667 2023-11-19 10:55:25,432 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family2/testCompactionWithHFileLink=4a83e887540ecadca9444556fadfc332-8bfd838e615a4158b81518f03b3d4f70 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family2/testCompactionWithHFileLink=4a83e887540ecadca9444556fadfc332-8bfd838e615a4158b81518f03b3d4f70 2023-11-19 10:55:25,433 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family2/testCompactionWithHFileLink=4a83e887540ecadca9444556fadfc332-bc0941dc9bb04974a011a607c8cd6d95 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/family2/testCompactionWithHFileLink=4a83e887540ecadca9444556fadfc332-bc0941dc9bb04974a011a607c8cd6d95 2023-11-19 10:55:25,739 DEBUG [RS:0;jenkins-hbase4:46035-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/.tmp/family2/e24506117744490892613e91b5f28095 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family2/e24506117744490892613e91b5f28095 2023-11-19 10:55:25,744 INFO [RS:0;jenkins-hbase4:46035-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 3bb6c0b2c9863082d1a21587d98896c0/family2 of 3bb6c0b2c9863082d1a21587d98896c0 into e24506117744490892613e91b5f28095(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-19 10:55:25,744 DEBUG [RS:0;jenkins-hbase4:46035-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 3bb6c0b2c9863082d1a21587d98896c0: 2023-11-19 10:55:25,744 INFO [RS:0;jenkins-hbase4:46035-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0., storeName=3bb6c0b2c9863082d1a21587d98896c0/family2, priority=12, startTime=1700391322881; duration=1sec 2023-11-19 10:55:25,744 DEBUG [RS:0;jenkins-hbase4:46035-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-19 10:55:25,834 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family2/testCompactionWithHFileLink=3bb6c0b2c9863082d1a21587d98896c0-5e1ddebf717143dd894f0cda6b80e167, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family2/testCompactionWithHFileLink=3bb6c0b2c9863082d1a21587d98896c0-4845a1ccc26a493ba944c124fee0873d, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family2/testCompactionWithHFileLink=3bb6c0b2c9863082d1a21587d98896c0-65763493d9b84815a761f0299a47abfa, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family2/testCompactionWithHFileLink=3bb6c0b2c9863082d1a21587d98896c0-c628e404e9d6494db8abb403651cbd06] to archive 2023-11-19 10:55:25,835 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:55:25,837 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family2/testCompactionWithHFileLink=3bb6c0b2c9863082d1a21587d98896c0-5e1ddebf717143dd894f0cda6b80e167 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family2/testCompactionWithHFileLink=3bb6c0b2c9863082d1a21587d98896c0-5e1ddebf717143dd894f0cda6b80e167 2023-11-19 10:55:25,838 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family2/testCompactionWithHFileLink=3bb6c0b2c9863082d1a21587d98896c0-4845a1ccc26a493ba944c124fee0873d to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family2/testCompactionWithHFileLink=3bb6c0b2c9863082d1a21587d98896c0-4845a1ccc26a493ba944c124fee0873d 2023-11-19 10:55:25,839 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family2/testCompactionWithHFileLink=3bb6c0b2c9863082d1a21587d98896c0-65763493d9b84815a761f0299a47abfa to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family2/testCompactionWithHFileLink=3bb6c0b2c9863082d1a21587d98896c0-65763493d9b84815a761f0299a47abfa 2023-11-19 10:55:25,839 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family2/testCompactionWithHFileLink=3bb6c0b2c9863082d1a21587d98896c0-c628e404e9d6494db8abb403651cbd06 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/family2/testCompactionWithHFileLink=3bb6c0b2c9863082d1a21587d98896c0-c628e404e9d6494db8abb403651cbd06 2023-11-19 10:55:25,994 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-19 10:55:26,036 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-19 10:55:26,037 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x470ae4dc to 127.0.0.1:60497 2023-11-19 10:55:26,037 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-19 10:55:26,037 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-19 10:55:26,037 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x08a9b2af to 127.0.0.1:60497 2023-11-19 10:55:26,038 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-19 10:55:26,038 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-19 10:55:26,038 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2993319f to 127.0.0.1:60497 2023-11-19 10:55:26,038 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-19 10:55:26,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-19 10:55:26,262 INFO [Listener at localhost/42675] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: ns:testMinorCompaction, procId: 105 completed 2023-11-19 10:55:26,268 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1700391324155.cc4d248c67f2406eabe5365c5a2f50ca. with WAL disabled. Data may be lost in the event of a crash. 2023-11-19 10:55:26,268 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1700391324155.b427a1d00a803e63acb916b5a78a19da. with WAL disabled. Data may be lost in the event of a crash. 2023-11-19 10:55:26,269 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1700391324155.cb7ee8609abfbe5e360af47e0bf92474. with WAL disabled. Data may be lost in the event of a crash. 2023-11-19 10:55:26,271 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:55:26,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-19 10:55:26,272 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-19 10:55:26,272 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:55:26,272 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-19 10:55:26,272 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-19 10:55:26,273 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-19 10:55:26,273 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-19 10:55:26,274 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:26,274 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:55:26,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:55:26,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:55:26,274 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:26,274 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:55:26,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-19 10:55:26,275 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-19 10:55:26,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:55:26,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-19 10:55:26,275 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-19 10:55:26,275 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-19 10:55:26,275 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-19 10:55:26,276 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:55:26,276 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-19 10:55:26,276 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1700391324155.b427a1d00a803e63acb916b5a78a19da. 2023-11-19 10:55:26,276 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-19 10:55:26,276 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:55:26,276 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1700391324155.cb7ee8609abfbe5e360af47e0bf92474. 2023-11-19 10:55:26,276 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1700391324155.b427a1d00a803e63acb916b5a78a19da. started... 2023-11-19 10:55:26,276 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1700391324155.cb7ee8609abfbe5e360af47e0bf92474. started... 2023-11-19 10:55:26,276 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1700391324155.cc4d248c67f2406eabe5365c5a2f50ca. 2023-11-19 10:55:26,278 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b427a1d00a803e63acb916b5a78a19da 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-19 10:55:26,278 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1700391324155.cc4d248c67f2406eabe5365c5a2f50ca. started... 2023-11-19 10:55:26,278 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing cb7ee8609abfbe5e360af47e0bf92474 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-19 10:55:26,278 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing cc4d248c67f2406eabe5365c5a2f50ca 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-19 10:55:26,694 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311195cb1d536d4d5431a9432752aa4a511f3 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202311195cb1d536d4d5431a9432752aa4a511f3 2023-11-19 10:55:26,695 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311195dd3e83c3b4048398ee3bbbaa103ed05 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202311195dd3e83c3b4048398ee3bbbaa103ed05 2023-11-19 10:55:26,695 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231119fb12391db4884e8e91590ef544627e6e to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231119fb12391db4884e8e91590ef544627e6e 2023-11-19 10:55:27,100 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/.tmp/family1/2dc26568af5f48c4af48274e79ef696c 2023-11-19 10:55:27,101 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/.tmp/family1/6ece513247264e158b2652791fc6ba0c 2023-11-19 10:55:27,101 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/.tmp/family1/82e2f6b279344490a31e40f8bed3110b 2023-11-19 10:55:27,517 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231119e69e7eb51e674b48bbf06897d52dedc4 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231119e69e7eb51e674b48bbf06897d52dedc4 2023-11-19 10:55:27,522 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023111946722632a3784faca4016745e5ad4785 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c2023111946722632a3784faca4016745e5ad4785 2023-11-19 10:55:27,522 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231119a75a15d1cf7f468e96067b398522602e to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231119a75a15d1cf7f468e96067b398522602e 2023-11-19 10:55:27,923 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/.tmp/family2/35e2440fb2c749efb69b81361a641fd8 2023-11-19 10:55:27,927 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/.tmp/family1/2dc26568af5f48c4af48274e79ef696c as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/family1/2dc26568af5f48c4af48274e79ef696c 2023-11-19 10:55:27,931 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/family1/2dc26568af5f48c4af48274e79ef696c, entries=4, sequenceid=5, filesize=5.4 K 2023-11-19 10:55:27,931 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/.tmp/family2/35e2440fb2c749efb69b81361a641fd8 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/family2/35e2440fb2c749efb69b81361a641fd8 2023-11-19 10:55:27,935 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/.tmp/family2/169162a8c0d348f6a309f5fafdc14be3 2023-11-19 10:55:27,935 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/family2/35e2440fb2c749efb69b81361a641fd8, entries=2, sequenceid=5, filesize=5.1 K 2023-11-19 10:55:27,935 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/.tmp/family2/a3a53b51f8d04f90b064d7744b621c9f 2023-11-19 10:55:27,936 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for cc4d248c67f2406eabe5365c5a2f50ca in 1658ms, sequenceid=5, compaction requested=false 2023-11-19 10:55:27,936 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-11-19 10:55:27,937 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for cc4d248c67f2406eabe5365c5a2f50ca: 2023-11-19 10:55:27,937 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1700391324155.cc4d248c67f2406eabe5365c5a2f50ca. 2023-11-19 10:55:27,937 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-19 10:55:27,939 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/.tmp/family1/82e2f6b279344490a31e40f8bed3110b as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/family1/82e2f6b279344490a31e40f8bed3110b 2023-11-19 10:55:27,939 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/.tmp/family1/6ece513247264e158b2652791fc6ba0c as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/family1/6ece513247264e158b2652791fc6ba0c 2023-11-19 10:55:27,942 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/family1/82e2f6b279344490a31e40f8bed3110b, entries=4, sequenceid=5, filesize=5.4 K 2023-11-19 10:55:27,942 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/family1/6ece513247264e158b2652791fc6ba0c, entries=4, sequenceid=5, filesize=5.4 K 2023-11-19 10:55:27,943 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/.tmp/family2/a3a53b51f8d04f90b064d7744b621c9f as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/family2/a3a53b51f8d04f90b064d7744b621c9f 2023-11-19 10:55:27,943 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/.tmp/family2/169162a8c0d348f6a309f5fafdc14be3 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/family2/169162a8c0d348f6a309f5fafdc14be3 2023-11-19 10:55:27,947 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/family2/a3a53b51f8d04f90b064d7744b621c9f, entries=2, sequenceid=5, filesize=5.1 K 2023-11-19 10:55:27,947 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/family2/169162a8c0d348f6a309f5fafdc14be3, entries=2, sequenceid=5, filesize=5.1 K 2023-11-19 10:55:27,947 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for cb7ee8609abfbe5e360af47e0bf92474 in 1669ms, sequenceid=5, compaction requested=false 2023-11-19 10:55:27,948 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for cb7ee8609abfbe5e360af47e0bf92474: 2023-11-19 10:55:27,948 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1700391324155.cb7ee8609abfbe5e360af47e0bf92474. 2023-11-19 10:55:27,948 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-19 10:55:27,948 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for b427a1d00a803e63acb916b5a78a19da in 1670ms, sequenceid=5, compaction requested=false 2023-11-19 10:55:27,949 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b427a1d00a803e63acb916b5a78a19da: 2023-11-19 10:55:27,949 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1700391324155.b427a1d00a803e63acb916b5a78a19da. 2023-11-19 10:55:27,949 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-19 10:55:27,949 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-19 10:55:27,949 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:27,949 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-19 10:55:27,949 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-19 10:55:27,951 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:27,951 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-19 10:55:27,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:27,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:27,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:55:27,951 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-19 10:55:27,951 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:55:27,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:27,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:27,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-19 10:55:27,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:27,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:27,953 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-19 10:55:27,953 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1a8ff113[Count = 0] remaining members to acquire global barrier 2023-11-19 10:55:27,953 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-19 10:55:27,953 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-19 10:55:27,955 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-19 10:55:27,955 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-19 10:55:27,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-19 10:55:27,955 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-19 10:55:27,955 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-19 10:55:27,955 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:55:27,955 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:27,955 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:55:27,956 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-19 10:55:27,956 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:27,956 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:55:27,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:27,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:27,956 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-19 10:55:27,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:55:27,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:27,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:27,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-19 10:55:27,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:27,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:27,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-19 10:55:27,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:27,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:55:27,959 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-19 10:55:27,959 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-19 10:55:27,959 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:55:27,959 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:55:27,960 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-19 10:55:27,960 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:55:27,961 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-19 10:55:27,961 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-19 10:55:27,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-19 10:55:27,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:27,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-19 10:55:27,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-19 10:55:27,961 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:55:27,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:55:27,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:55:27,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:55:27,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:27,962 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:27,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-19 10:55:27,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-19 10:55:27,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:27,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-19 10:55:27,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:27,963 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:27,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:27,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-19 10:55:27,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:27,965 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:27,965 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:55:27,965 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-19 10:55:27,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:55:27,966 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:55:27,965 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:55:27,966 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-19 10:55:27,966 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:55:27,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:55:27,965 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-19 10:55:27,966 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:27,966 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-19 10:55:27,966 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-19 10:55:27,966 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-19 10:55:27,966 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-19 10:55:27,966 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:55:27,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:55:27,966 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:55:28,066 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:55:28,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:55:28,069 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1700391324155.cc4d248c67f2406eabe5365c5a2f50ca. with WAL disabled. Data may be lost in the event of a crash. 2023-11-19 10:55:28,069 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1700391324155.b427a1d00a803e63acb916b5a78a19da. with WAL disabled. Data may be lost in the event of a crash. 2023-11-19 10:55:28,069 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1700391324155.cb7ee8609abfbe5e360af47e0bf92474. with WAL disabled. Data may be lost in the event of a crash. 2023-11-19 10:55:28,071 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:55:28,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-19 10:55:28,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-19 10:55:28,073 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-19 10:55:28,073 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:55:28,073 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-19 10:55:28,073 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-19 10:55:28,073 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-19 10:55:28,073 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-19 10:55:28,076 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:28,076 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:55:28,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:55:28,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:55:28,076 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:28,076 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:55:28,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-19 10:55:28,077 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-19 10:55:28,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:55:28,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-19 10:55:28,077 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-19 10:55:28,077 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-19 10:55:28,077 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-19 10:55:28,077 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-19 10:55:28,077 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:55:28,077 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-19 10:55:28,078 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1700391324155.b427a1d00a803e63acb916b5a78a19da. 2023-11-19 10:55:28,078 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-19 10:55:28,078 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1700391324155.cb7ee8609abfbe5e360af47e0bf92474. 2023-11-19 10:55:28,078 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1700391324155.cc4d248c67f2406eabe5365c5a2f50ca. 2023-11-19 10:55:28,078 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:55:28,078 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1700391324155.cc4d248c67f2406eabe5365c5a2f50ca. started... 2023-11-19 10:55:28,078 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1700391324155.cb7ee8609abfbe5e360af47e0bf92474. started... 2023-11-19 10:55:28,078 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing cc4d248c67f2406eabe5365c5a2f50ca 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-19 10:55:28,078 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing cb7ee8609abfbe5e360af47e0bf92474 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-19 10:55:28,080 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1700391324155.b427a1d00a803e63acb916b5a78a19da. started... 2023-11-19 10:55:28,080 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b427a1d00a803e63acb916b5a78a19da 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-19 10:55:28,512 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023111932647b030a854c4399eab13fea8aecae to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023111932647b030a854c4399eab13fea8aecae 2023-11-19 10:55:28,512 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231119a315211982f341b38d92d2ac7d6ded7d to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231119a315211982f341b38d92d2ac7d6ded7d 2023-11-19 10:55:28,512 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023111918eb26e6e73d4bb6bd06fdd69be64f9a to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023111918eb26e6e73d4bb6bd06fdd69be64f9a 2023-11-19 10:55:28,519 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/.tmp/family1/be4876e261794f6d9b598a2833f15d4a 2023-11-19 10:55:28,917 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/.tmp/family1/6e3ecc9d74bb4fc5bdc3dc075999831a 2023-11-19 10:55:28,919 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/.tmp/family1/1e9d89788c0444dd83eb14e2fb184f66 2023-11-19 10:55:28,931 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231119808ff5c5f4e24e2ca4240797b1e8b6fb to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231119808ff5c5f4e24e2ca4240797b1e8b6fb 2023-11-19 10:55:28,932 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311191c23120252e347608c1288d4a4c522b3 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202311191c23120252e347608c1288d4a4c522b3 2023-11-19 10:55:28,936 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311193f731cf4edac4fefb3da2922415bfcdd to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202311193f731cf4edac4fefb3da2922415bfcdd 2023-11-19 10:55:28,948 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/.tmp/family2/3c66e65b8ed94f3c920b92dfe04d4fd6 2023-11-19 10:55:28,951 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/.tmp/family2/8fc76bd6f3624d308f52892da416f970 2023-11-19 10:55:28,953 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/.tmp/family1/be4876e261794f6d9b598a2833f15d4a as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/family1/be4876e261794f6d9b598a2833f15d4a 2023-11-19 10:55:28,955 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/.tmp/family1/1e9d89788c0444dd83eb14e2fb184f66 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/family1/1e9d89788c0444dd83eb14e2fb184f66 2023-11-19 10:55:28,958 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/family1/be4876e261794f6d9b598a2833f15d4a, entries=4, sequenceid=9, filesize=5.4 K 2023-11-19 10:55:28,959 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/.tmp/family2/3c66e65b8ed94f3c920b92dfe04d4fd6 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/family2/3c66e65b8ed94f3c920b92dfe04d4fd6 2023-11-19 10:55:28,960 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/family1/1e9d89788c0444dd83eb14e2fb184f66, entries=4, sequenceid=9, filesize=5.4 K 2023-11-19 10:55:28,961 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/.tmp/family2/8fc76bd6f3624d308f52892da416f970 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/family2/8fc76bd6f3624d308f52892da416f970 2023-11-19 10:55:28,963 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/family2/3c66e65b8ed94f3c920b92dfe04d4fd6, entries=2, sequenceid=9, filesize=5.1 K 2023-11-19 10:55:28,964 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for cc4d248c67f2406eabe5365c5a2f50ca in 886ms, sequenceid=9, compaction requested=false 2023-11-19 10:55:28,965 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for cc4d248c67f2406eabe5365c5a2f50ca: 2023-11-19 10:55:28,965 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1700391324155.cc4d248c67f2406eabe5365c5a2f50ca. 2023-11-19 10:55:28,965 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-19 10:55:28,966 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/family2/8fc76bd6f3624d308f52892da416f970, entries=2, sequenceid=9, filesize=5.1 K 2023-11-19 10:55:28,967 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for cb7ee8609abfbe5e360af47e0bf92474 in 889ms, sequenceid=9, compaction requested=false 2023-11-19 10:55:28,967 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for cb7ee8609abfbe5e360af47e0bf92474: 2023-11-19 10:55:28,967 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1700391324155.cb7ee8609abfbe5e360af47e0bf92474. 2023-11-19 10:55:28,967 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-19 10:55:29,342 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/.tmp/family2/0e6abb63a8b4471ba7666ca6c19a5a6a 2023-11-19 10:55:29,347 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/.tmp/family1/6e3ecc9d74bb4fc5bdc3dc075999831a as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/family1/6e3ecc9d74bb4fc5bdc3dc075999831a 2023-11-19 10:55:29,350 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/family1/6e3ecc9d74bb4fc5bdc3dc075999831a, entries=4, sequenceid=9, filesize=5.4 K 2023-11-19 10:55:29,351 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/.tmp/family2/0e6abb63a8b4471ba7666ca6c19a5a6a as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/family2/0e6abb63a8b4471ba7666ca6c19a5a6a 2023-11-19 10:55:29,355 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/family2/0e6abb63a8b4471ba7666ca6c19a5a6a, entries=2, sequenceid=9, filesize=5.1 K 2023-11-19 10:55:29,355 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for b427a1d00a803e63acb916b5a78a19da in 1275ms, sequenceid=9, compaction requested=false 2023-11-19 10:55:29,356 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b427a1d00a803e63acb916b5a78a19da: 2023-11-19 10:55:29,356 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1700391324155.b427a1d00a803e63acb916b5a78a19da. 2023-11-19 10:55:29,356 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-19 10:55:29,356 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-19 10:55:29,356 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:29,356 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-19 10:55:29,356 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-19 10:55:29,358 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:29,358 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-19 10:55:29,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:29,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:29,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:55:29,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:29,358 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-19 10:55:29,358 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:55:29,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:29,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-19 10:55:29,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:29,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:29,360 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-19 10:55:29,360 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@507c23e8[Count = 0] remaining members to acquire global barrier 2023-11-19 10:55:29,360 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-19 10:55:29,360 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-19 10:55:29,361 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-19 10:55:29,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-19 10:55:29,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-19 10:55:29,361 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-19 10:55:29,361 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-19 10:55:29,361 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:55:29,361 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:29,361 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:55:29,362 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-19 10:55:29,362 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:55:29,362 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:29,362 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-19 10:55:29,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:29,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:29,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:55:29,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:29,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:29,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-19 10:55:29,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:29,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:29,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-19 10:55:29,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:29,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:55:29,365 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-19 10:55:29,365 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-19 10:55:29,365 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:55:29,365 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:55:29,365 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-19 10:55:29,365 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:55:29,370 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-19 10:55:29,370 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-19 10:55:29,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-19 10:55:29,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-19 10:55:29,370 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:55:29,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-19 10:55:29,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:29,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:55:29,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:55:29,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:55:29,371 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:29,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:29,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-19 10:55:29,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-19 10:55:29,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:29,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-19 10:55:29,372 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:29,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:29,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:29,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-19 10:55:29,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:29,375 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:29,375 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:55:29,375 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-19 10:55:29,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:55:29,375 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-19 10:55:29,375 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:55:29,375 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-11-19 10:55:29,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:55:29,375 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-19 10:55:29,375 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:55:29,375 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:55:29,375 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:29,375 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-19 10:55:29,375 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-19 10:55:29,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:55:29,375 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-19 10:55:29,375 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:55:29,375 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-19 10:55:29,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:55:29,475 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:55:29,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:55:29,477 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1700391324155.cc4d248c67f2406eabe5365c5a2f50ca. with WAL disabled. Data may be lost in the event of a crash. 2023-11-19 10:55:29,478 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1700391324155.b427a1d00a803e63acb916b5a78a19da. with WAL disabled. Data may be lost in the event of a crash. 2023-11-19 10:55:29,478 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1700391324155.cb7ee8609abfbe5e360af47e0bf92474. with WAL disabled. Data may be lost in the event of a crash. 2023-11-19 10:55:29,480 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:55:29,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-19 10:55:29,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-19 10:55:29,482 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-19 10:55:29,482 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:55:29,482 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-19 10:55:29,482 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-19 10:55:29,482 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-19 10:55:29,482 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-19 10:55:29,483 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:29,483 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:55:29,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:55:29,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:55:29,483 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:29,483 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:55:29,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-19 10:55:29,484 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-19 10:55:29,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:55:29,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-19 10:55:29,484 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-19 10:55:29,485 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-19 10:55:29,485 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-19 10:55:29,485 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-19 10:55:29,485 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:55:29,485 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-19 10:55:29,485 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1700391324155.b427a1d00a803e63acb916b5a78a19da. 2023-11-19 10:55:29,485 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1700391324155.b427a1d00a803e63acb916b5a78a19da. started... 2023-11-19 10:55:29,485 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b427a1d00a803e63acb916b5a78a19da 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-19 10:55:29,486 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1700391324155.cb7ee8609abfbe5e360af47e0bf92474. 2023-11-19 10:55:29,486 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-19 10:55:29,486 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1700391324155.cc4d248c67f2406eabe5365c5a2f50ca. 2023-11-19 10:55:29,486 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1700391324155.cb7ee8609abfbe5e360af47e0bf92474. started... 2023-11-19 10:55:29,486 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1700391324155.cc4d248c67f2406eabe5365c5a2f50ca. started... 2023-11-19 10:55:29,486 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:55:29,486 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing cb7ee8609abfbe5e360af47e0bf92474 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-19 10:55:29,487 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing cc4d248c67f2406eabe5365c5a2f50ca 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-19 10:55:29,902 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023111934c76fd4b133494580dc7280ed5a3a5a to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023111934c76fd4b133494580dc7280ed5a3a5a 2023-11-19 10:55:29,902 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311191d845448045c4b828a4ae0128e3a1243 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202311191d845448045c4b828a4ae0128e3a1243 2023-11-19 10:55:29,907 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231119184dea5c9568435a8a6f15b373d4bcd8 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231119184dea5c9568435a8a6f15b373d4bcd8 2023-11-19 10:55:29,918 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/.tmp/family1/b652d8cdf334485394744c909fd7fcb2 2023-11-19 10:55:30,315 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/.tmp/family1/ef3be5bb19a44115800c50f660f01494 2023-11-19 10:55:30,318 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/.tmp/family1/458c907c969143059711910e610682c2 2023-11-19 10:55:30,331 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231119b9f254363f9a4322b24a58689ecff12c to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231119b9f254363f9a4322b24a58689ecff12c 2023-11-19 10:55:30,729 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231119fccdfa1771534d438603ffcb7a5ab5be to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20231119fccdfa1771534d438603ffcb7a5ab5be 2023-11-19 10:55:30,730 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311193178c5697a88491c9789b0898c06375b to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202311193178c5697a88491c9789b0898c06375b 2023-11-19 10:55:30,735 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/.tmp/family2/f4ee0d6a7c9c41a0ab9dca42bc80d90b 2023-11-19 10:55:30,738 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/.tmp/family1/b652d8cdf334485394744c909fd7fcb2 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/family1/b652d8cdf334485394744c909fd7fcb2 2023-11-19 10:55:30,741 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/family1/b652d8cdf334485394744c909fd7fcb2, entries=4, sequenceid=13, filesize=5.4 K 2023-11-19 10:55:30,742 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/.tmp/family2/f4ee0d6a7c9c41a0ab9dca42bc80d90b as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/family2/f4ee0d6a7c9c41a0ab9dca42bc80d90b 2023-11-19 10:55:30,744 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/family2/f4ee0d6a7c9c41a0ab9dca42bc80d90b, entries=2, sequenceid=13, filesize=5.1 K 2023-11-19 10:55:30,745 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for b427a1d00a803e63acb916b5a78a19da in 1260ms, sequenceid=13, compaction requested=true 2023-11-19 10:55:30,745 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b427a1d00a803e63acb916b5a78a19da: 2023-11-19 10:55:30,745 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1700391324155.b427a1d00a803e63acb916b5a78a19da. 2023-11-19 10:55:30,745 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-19 10:55:31,134 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/.tmp/family2/09ebd73b81aa4cdca716814df47e9846 2023-11-19 10:55:31,134 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/.tmp/family2/6dccd27059ae4d68a2ad0a82c944d5a3 2023-11-19 10:55:31,139 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/.tmp/family1/ef3be5bb19a44115800c50f660f01494 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/family1/ef3be5bb19a44115800c50f660f01494 2023-11-19 10:55:31,139 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/.tmp/family1/458c907c969143059711910e610682c2 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/family1/458c907c969143059711910e610682c2 2023-11-19 10:55:31,143 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/family1/ef3be5bb19a44115800c50f660f01494, entries=4, sequenceid=13, filesize=5.4 K 2023-11-19 10:55:31,143 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/family1/458c907c969143059711910e610682c2, entries=4, sequenceid=13, filesize=5.4 K 2023-11-19 10:55:31,143 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/.tmp/family2/6dccd27059ae4d68a2ad0a82c944d5a3 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/family2/6dccd27059ae4d68a2ad0a82c944d5a3 2023-11-19 10:55:31,144 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/.tmp/family2/09ebd73b81aa4cdca716814df47e9846 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/family2/09ebd73b81aa4cdca716814df47e9846 2023-11-19 10:55:31,147 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/family2/6dccd27059ae4d68a2ad0a82c944d5a3, entries=2, sequenceid=13, filesize=5.1 K 2023-11-19 10:55:31,147 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/family2/09ebd73b81aa4cdca716814df47e9846, entries=2, sequenceid=13, filesize=5.1 K 2023-11-19 10:55:31,148 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for cc4d248c67f2406eabe5365c5a2f50ca in 1662ms, sequenceid=13, compaction requested=true 2023-11-19 10:55:31,148 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for cb7ee8609abfbe5e360af47e0bf92474 in 1662ms, sequenceid=13, compaction requested=true 2023-11-19 10:55:31,148 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for cc4d248c67f2406eabe5365c5a2f50ca: 2023-11-19 10:55:31,148 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for cb7ee8609abfbe5e360af47e0bf92474: 2023-11-19 10:55:31,148 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1700391324155.cc4d248c67f2406eabe5365c5a2f50ca. 2023-11-19 10:55:31,148 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1700391324155.cb7ee8609abfbe5e360af47e0bf92474. 2023-11-19 10:55:31,148 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-19 10:55:31,149 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-19 10:55:31,149 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-19 10:55:31,149 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:31,149 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-19 10:55:31,149 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-19 10:55:31,150 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-19 10:55:31,150 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:31,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:31,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:31,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:55:31,151 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-19 10:55:31,151 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:55:31,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:31,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:31,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-19 10:55:31,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:31,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:31,154 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-19 10:55:31,154 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2f33121d[Count = 0] remaining members to acquire global barrier 2023-11-19 10:55:31,154 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-19 10:55:31,154 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-19 10:55:31,155 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-19 10:55:31,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-19 10:55:31,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-19 10:55:31,155 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:31,155 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:55:31,155 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-19 10:55:31,155 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-19 10:55:31,155 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:55:31,158 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:31,158 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-19 10:55:31,158 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:55:31,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:31,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:31,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:55:31,158 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-19 10:55:31,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:31,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:31,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-19 10:55:31,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:31,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:31,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-19 10:55:31,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:31,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:55:31,161 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-19 10:55:31,161 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-19 10:55:31,161 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:55:31,161 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:55:31,161 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-19 10:55:31,161 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:55:31,164 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-19 10:55:31,164 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:55:31,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-19 10:55:31,164 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-19 10:55:31,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-19 10:55:31,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-19 10:55:31,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:31,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:55:31,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:55:31,165 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:31,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:55:31,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:31,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-19 10:55:31,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-19 10:55:31,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:31,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-19 10:55:31,166 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:31,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:31,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:31,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-19 10:55:31,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:31,168 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:31,168 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-19 10:55:31,168 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-19 10:55:31,168 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:55:31,168 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:31,168 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-19 10:55:31,168 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-19 10:55:31,168 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:55:31,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:55:31,168 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:55:31,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:55:31,168 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-19 10:55:31,168 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:55:31,169 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-19 10:55:31,169 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-11-19 10:55:31,169 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-19 10:55:31,169 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:55:31,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:55:31,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:55:31,269 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:55:31,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:55:31,271 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1700391324155.cc4d248c67f2406eabe5365c5a2f50ca. with WAL disabled. Data may be lost in the event of a crash. 2023-11-19 10:55:31,271 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1700391324155.b427a1d00a803e63acb916b5a78a19da. with WAL disabled. Data may be lost in the event of a crash. 2023-11-19 10:55:31,271 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1700391324155.cb7ee8609abfbe5e360af47e0bf92474. with WAL disabled. Data may be lost in the event of a crash. 2023-11-19 10:55:31,273 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:55:31,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-19 10:55:31,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-19 10:55:31,275 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-19 10:55:31,275 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:55:31,275 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-19 10:55:31,275 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-19 10:55:31,275 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-19 10:55:31,275 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-19 10:55:31,276 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:31,276 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:55:31,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:55:31,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:55:31,277 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:31,277 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:55:31,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-19 10:55:31,277 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-19 10:55:31,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:55:31,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-19 10:55:31,277 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-19 10:55:31,278 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-19 10:55:31,278 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-19 10:55:31,278 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-19 10:55:31,278 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:55:31,278 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-19 10:55:31,278 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1700391324155.b427a1d00a803e63acb916b5a78a19da. 2023-11-19 10:55:31,278 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1700391324155.b427a1d00a803e63acb916b5a78a19da. started... 2023-11-19 10:55:31,278 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1700391324155.cb7ee8609abfbe5e360af47e0bf92474. 2023-11-19 10:55:31,278 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1700391324155.cb7ee8609abfbe5e360af47e0bf92474. started... 2023-11-19 10:55:31,278 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b427a1d00a803e63acb916b5a78a19da 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-19 10:55:31,278 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-19 10:55:31,278 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing cb7ee8609abfbe5e360af47e0bf92474 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-19 10:55:31,278 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:55:31,278 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1700391324155.cc4d248c67f2406eabe5365c5a2f50ca. 2023-11-19 10:55:31,278 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1700391324155.cc4d248c67f2406eabe5365c5a2f50ca. started... 2023-11-19 10:55:31,278 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing cc4d248c67f2406eabe5365c5a2f50ca 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-19 10:55:31,689 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231119c7dca61df9364de395cfb8699ec43cc7 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231119c7dca61df9364de395cfb8699ec43cc7 2023-11-19 10:55:31,693 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311190fcb1c02dd8446c0b71ba903fb64908f to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202311190fcb1c02dd8446c0b71ba903fb64908f 2023-11-19 10:55:31,694 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231119117aefe4f66b494b9713429e7b84d527 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231119117aefe4f66b494b9713429e7b84d527 2023-11-19 10:55:31,694 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/.tmp/family1/ba7fd7899f334e2d9db85be1a42c999e 2023-11-19 10:55:31,707 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231119d17a86101c264d6cb371da93662f3951 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20231119d17a86101c264d6cb371da93662f3951 2023-11-19 10:55:32,099 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/.tmp/family1/a80f8f1922ea46f08dbb32aa617f1793 2023-11-19 10:55:32,103 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/.tmp/family1/bd8d21125c5f4ff3a8475adfc9e3de39 2023-11-19 10:55:32,112 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/.tmp/family2/408915e52d934b849d0b0976085dab54 2023-11-19 10:55:32,112 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231119e05685ae0c384381a554219062ce37b9 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231119e05685ae0c384381a554219062ce37b9 2023-11-19 10:55:32,115 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311199febc32ebf724a77b1c6c4ce5c2be376 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202311199febc32ebf724a77b1c6c4ce5c2be376 2023-11-19 10:55:32,116 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/.tmp/family1/ba7fd7899f334e2d9db85be1a42c999e as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/family1/ba7fd7899f334e2d9db85be1a42c999e 2023-11-19 10:55:32,117 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/.tmp/family2/3995d02fa9ef491aa57a1f40cd711e16 2023-11-19 10:55:32,120 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/.tmp/family2/c7de6a2b1a4d41dead03ac11f3ff5077 2023-11-19 10:55:32,120 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/family1/ba7fd7899f334e2d9db85be1a42c999e, entries=4, sequenceid=17, filesize=5.4 K 2023-11-19 10:55:32,121 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/.tmp/family1/a80f8f1922ea46f08dbb32aa617f1793 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/family1/a80f8f1922ea46f08dbb32aa617f1793 2023-11-19 10:55:32,121 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/.tmp/family2/408915e52d934b849d0b0976085dab54 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/family2/408915e52d934b849d0b0976085dab54 2023-11-19 10:55:32,124 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/.tmp/family1/bd8d21125c5f4ff3a8475adfc9e3de39 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/family1/bd8d21125c5f4ff3a8475adfc9e3de39 2023-11-19 10:55:32,125 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/family1/a80f8f1922ea46f08dbb32aa617f1793, entries=4, sequenceid=17, filesize=5.4 K 2023-11-19 10:55:32,127 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/family2/408915e52d934b849d0b0976085dab54, entries=2, sequenceid=17, filesize=5.1 K 2023-11-19 10:55:32,128 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for cb7ee8609abfbe5e360af47e0bf92474 in 850ms, sequenceid=17, compaction requested=true 2023-11-19 10:55:32,128 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for cb7ee8609abfbe5e360af47e0bf92474: 2023-11-19 10:55:32,128 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/.tmp/family2/3995d02fa9ef491aa57a1f40cd711e16 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/family2/3995d02fa9ef491aa57a1f40cd711e16 2023-11-19 10:55:32,128 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1700391324155.cb7ee8609abfbe5e360af47e0bf92474. 2023-11-19 10:55:32,128 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-19 10:55:32,128 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/family1/bd8d21125c5f4ff3a8475adfc9e3de39, entries=4, sequenceid=17, filesize=5.4 K 2023-11-19 10:55:32,129 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/.tmp/family2/c7de6a2b1a4d41dead03ac11f3ff5077 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/family2/c7de6a2b1a4d41dead03ac11f3ff5077 2023-11-19 10:55:32,131 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/family2/3995d02fa9ef491aa57a1f40cd711e16, entries=2, sequenceid=17, filesize=5.1 K 2023-11-19 10:55:32,132 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for b427a1d00a803e63acb916b5a78a19da in 854ms, sequenceid=17, compaction requested=true 2023-11-19 10:55:32,132 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b427a1d00a803e63acb916b5a78a19da: 2023-11-19 10:55:32,132 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1700391324155.b427a1d00a803e63acb916b5a78a19da. 2023-11-19 10:55:32,132 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-19 10:55:32,133 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/family2/c7de6a2b1a4d41dead03ac11f3ff5077, entries=2, sequenceid=17, filesize=5.1 K 2023-11-19 10:55:32,133 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for cc4d248c67f2406eabe5365c5a2f50ca in 855ms, sequenceid=17, compaction requested=true 2023-11-19 10:55:32,133 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for cc4d248c67f2406eabe5365c5a2f50ca: 2023-11-19 10:55:32,133 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1700391324155.cc4d248c67f2406eabe5365c5a2f50ca. 2023-11-19 10:55:32,133 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-19 10:55:32,133 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-19 10:55:32,133 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:32,133 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-19 10:55:32,133 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-19 10:55:32,135 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:32,135 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-19 10:55:32,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:32,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:32,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:55:32,136 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-19 10:55:32,136 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:55:32,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:32,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:32,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-19 10:55:32,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:32,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:32,137 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-19 10:55:32,137 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4c50cb1a[Count = 0] remaining members to acquire global barrier 2023-11-19 10:55:32,137 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-19 10:55:32,137 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-19 10:55:32,138 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-19 10:55:32,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-19 10:55:32,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-19 10:55:32,139 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-19 10:55:32,139 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-19 10:55:32,139 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:55:32,139 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:32,139 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:55:32,140 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-19 10:55:32,140 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:55:32,140 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:32,140 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-19 10:55:32,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:32,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:32,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:55:32,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:32,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:32,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-19 10:55:32,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:32,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:32,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-19 10:55:32,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:32,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:55:32,143 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-19 10:55:32,143 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-19 10:55:32,143 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:55:32,143 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:55:32,143 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-19 10:55:32,143 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:55:32,145 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-19 10:55:32,145 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-19 10:55:32,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-19 10:55:32,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-19 10:55:32,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-19 10:55:32,145 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:55:32,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:32,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:55:32,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:55:32,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:55:32,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:32,146 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:32,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-19 10:55:32,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-19 10:55:32,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:32,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-19 10:55:32,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:32,147 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:32,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:32,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-19 10:55:32,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:32,151 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:32,151 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-19 10:55:32,151 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:55:32,151 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-19 10:55:32,151 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:32,151 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-19 10:55:32,151 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:55:32,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:55:32,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:55:32,151 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:55:32,151 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-11-19 10:55:32,152 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-19 10:55:32,152 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:55:32,151 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-19 10:55:32,151 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:55:32,152 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-19 10:55:32,152 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-19 10:55:32,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:55:32,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:55:32,252 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:55:32,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:55:32,263 DEBUG [Listener at localhost/42675] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-19 10:55:32,271 DEBUG [Listener at localhost/42675] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-19 10:55:32,279 DEBUG [Listener at localhost/42675] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-19 10:55:32,280 DEBUG [Listener at localhost/42675] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-19 10:55:32,305 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:55:32,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-19 10:55:32,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-19 10:55:32,307 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-19 10:55:32,307 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:55:32,307 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-19 10:55:32,307 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-19 10:55:32,307 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-19 10:55:32,307 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-19 10:55:32,309 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:32,309 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:55:32,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:55:32,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:55:32,309 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:32,309 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:55:32,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-19 10:55:32,309 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-19 10:55:32,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:55:32,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-19 10:55:32,310 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-19 10:55:32,310 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-19 10:55:32,310 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-19 10:55:32,310 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-19 10:55:32,310 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:55:32,310 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-19 10:55:32,310 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1700391324155.b427a1d00a803e63acb916b5a78a19da. 2023-11-19 10:55:32,310 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1700391324155.b427a1d00a803e63acb916b5a78a19da. started... 2023-11-19 10:55:32,310 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1700391324155.cb7ee8609abfbe5e360af47e0bf92474. 2023-11-19 10:55:32,310 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1700391324155.cb7ee8609abfbe5e360af47e0bf92474. started... 2023-11-19 10:55:32,310 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b427a1d00a803e63acb916b5a78a19da 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-19 10:55:32,310 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing cb7ee8609abfbe5e360af47e0bf92474 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-19 10:55:32,310 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-19 10:55:32,311 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:55:32,311 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1700391324155.cc4d248c67f2406eabe5365c5a2f50ca. 2023-11-19 10:55:32,311 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1700391324155.cc4d248c67f2406eabe5365c5a2f50ca. started... 2023-11-19 10:55:32,311 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing cc4d248c67f2406eabe5365c5a2f50ca 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-19 10:55:32,337 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/.tmp/family1/4a57a7f2eb064b5ea2e8f9cb66c43dae 2023-11-19 10:55:32,340 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4a57a7f2eb064b5ea2e8f9cb66c43dae 2023-11-19 10:55:32,353 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/.tmp/family2/010a4566062c4e0ab30a14c6a9e4bdf3 2023-11-19 10:55:32,356 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 010a4566062c4e0ab30a14c6a9e4bdf3 2023-11-19 10:55:32,357 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/.tmp/family1/4a57a7f2eb064b5ea2e8f9cb66c43dae as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/family1/4a57a7f2eb064b5ea2e8f9cb66c43dae 2023-11-19 10:55:32,359 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4a57a7f2eb064b5ea2e8f9cb66c43dae 2023-11-19 10:55:32,360 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/family1/4a57a7f2eb064b5ea2e8f9cb66c43dae, entries=3, sequenceid=23, filesize=5.0 K 2023-11-19 10:55:32,360 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/.tmp/family2/010a4566062c4e0ab30a14c6a9e4bdf3 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/family2/010a4566062c4e0ab30a14c6a9e4bdf3 2023-11-19 10:55:32,363 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 010a4566062c4e0ab30a14c6a9e4bdf3 2023-11-19 10:55:32,363 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/family2/010a4566062c4e0ab30a14c6a9e4bdf3, entries=1, sequenceid=23, filesize=5.0 K 2023-11-19 10:55:32,364 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for b427a1d00a803e63acb916b5a78a19da in 54ms, sequenceid=23, compaction requested=true 2023-11-19 10:55:32,364 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b427a1d00a803e63acb916b5a78a19da: 2023-11-19 10:55:32,364 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1700391324155.b427a1d00a803e63acb916b5a78a19da. 2023-11-19 10:55:32,364 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-19 10:55:33,140 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/.tmp/family1/d93d0ff3a6c94cc299a16ab0d388a7b1 2023-11-19 10:55:33,140 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/.tmp/family1/7e21af8ed17248d0b6632473d85f6001 2023-11-19 10:55:33,143 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d93d0ff3a6c94cc299a16ab0d388a7b1 2023-11-19 10:55:33,143 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7e21af8ed17248d0b6632473d85f6001 2023-11-19 10:55:33,956 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/.tmp/family2/3a9944b2ba9e43e38ad75e4d72b76374 2023-11-19 10:55:33,956 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/.tmp/family2/278f9a43294e4f86ad3ee271c18aef83 2023-11-19 10:55:33,959 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 278f9a43294e4f86ad3ee271c18aef83 2023-11-19 10:55:33,960 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3a9944b2ba9e43e38ad75e4d72b76374 2023-11-19 10:55:33,960 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/.tmp/family1/d93d0ff3a6c94cc299a16ab0d388a7b1 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/family1/d93d0ff3a6c94cc299a16ab0d388a7b1 2023-11-19 10:55:33,960 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/.tmp/family1/7e21af8ed17248d0b6632473d85f6001 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/family1/7e21af8ed17248d0b6632473d85f6001 2023-11-19 10:55:33,964 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7e21af8ed17248d0b6632473d85f6001 2023-11-19 10:55:33,964 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/family1/7e21af8ed17248d0b6632473d85f6001, entries=3, sequenceid=23, filesize=5.0 K 2023-11-19 10:55:33,964 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d93d0ff3a6c94cc299a16ab0d388a7b1 2023-11-19 10:55:33,964 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/family1/d93d0ff3a6c94cc299a16ab0d388a7b1, entries=3, sequenceid=23, filesize=5.0 K 2023-11-19 10:55:33,965 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/.tmp/family2/3a9944b2ba9e43e38ad75e4d72b76374 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/family2/3a9944b2ba9e43e38ad75e4d72b76374 2023-11-19 10:55:33,965 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/.tmp/family2/278f9a43294e4f86ad3ee271c18aef83 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/family2/278f9a43294e4f86ad3ee271c18aef83 2023-11-19 10:55:33,969 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3a9944b2ba9e43e38ad75e4d72b76374 2023-11-19 10:55:33,969 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/family2/3a9944b2ba9e43e38ad75e4d72b76374, entries=1, sequenceid=23, filesize=5.0 K 2023-11-19 10:55:33,969 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 278f9a43294e4f86ad3ee271c18aef83 2023-11-19 10:55:33,969 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/family2/278f9a43294e4f86ad3ee271c18aef83, entries=1, sequenceid=23, filesize=5.0 K 2023-11-19 10:55:33,970 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for cc4d248c67f2406eabe5365c5a2f50ca in 1658ms, sequenceid=23, compaction requested=true 2023-11-19 10:55:33,970 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for cb7ee8609abfbe5e360af47e0bf92474 in 1659ms, sequenceid=23, compaction requested=true 2023-11-19 10:55:33,970 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for cc4d248c67f2406eabe5365c5a2f50ca: 2023-11-19 10:55:33,970 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for cb7ee8609abfbe5e360af47e0bf92474: 2023-11-19 10:55:33,970 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1700391324155.cb7ee8609abfbe5e360af47e0bf92474. 2023-11-19 10:55:33,970 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1700391324155.cc4d248c67f2406eabe5365c5a2f50ca. 2023-11-19 10:55:33,970 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-19 10:55:33,970 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-19 10:55:33,970 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-19 10:55:33,970 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:33,970 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-19 10:55:33,970 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-19 10:55:33,972 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:33,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:33,972 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-19 10:55:33,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:33,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:55:33,972 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-19 10:55:33,972 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:55:33,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:33,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:33,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-19 10:55:33,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:33,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:33,973 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-19 10:55:33,974 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2932bcea[Count = 0] remaining members to acquire global barrier 2023-11-19 10:55:33,974 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-19 10:55:33,974 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-19 10:55:33,975 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-19 10:55:33,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-19 10:55:33,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-19 10:55:33,975 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-19 10:55:33,975 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-19 10:55:33,975 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:55:33,975 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:33,975 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:55:33,977 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:33,977 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-19 10:55:33,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:33,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:33,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:55:33,977 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:55:33,977 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-19 10:55:33,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:33,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:33,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-19 10:55:33,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:33,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:33,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-19 10:55:33,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:33,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:55:33,979 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-19 10:55:33,979 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-19 10:55:33,979 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:55:33,979 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:55:33,979 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-19 10:55:33,979 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:55:33,981 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-19 10:55:33,981 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-19 10:55:33,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-19 10:55:33,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:33,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:55:33,981 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-19 10:55:33,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-19 10:55:33,981 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:55:33,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:33,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:55:33,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:55:33,982 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:33,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-19 10:55:33,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-19 10:55:33,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:33,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-19 10:55:33,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:33,983 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:33,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:33,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-19 10:55:33,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:33,985 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:33,985 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-19 10:55:33,985 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:55:33,985 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-19 10:55:33,985 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:55:33,985 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:33,985 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-19 10:55:33,985 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:55:33,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:55:33,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:55:33,985 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:55:33,985 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-19 10:55:33,985 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-19 10:55:33,986 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-19 10:55:33,986 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-19 10:55:33,986 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:55:33,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:55:33,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:55:34,086 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:55:34,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:55:34,087 DEBUG [Listener at localhost/42675] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-19 10:55:34,087 DEBUG [Listener at localhost/42675] regionserver.HStore(1912): b427a1d00a803e63acb916b5a78a19da/family1 is initiating major compaction (all files) 2023-11-19 10:55:34,087 INFO [Listener at localhost/42675] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-19 10:55:34,087 INFO [Listener at localhost/42675] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-19 10:55:34,087 INFO [Listener at localhost/42675] regionserver.HRegion(2259): Starting compaction of b427a1d00a803e63acb916b5a78a19da/family1 in ns:testMinorCompaction,1,1700391324155.b427a1d00a803e63acb916b5a78a19da. 2023-11-19 10:55:34,087 INFO [Listener at localhost/42675] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/family1/6ece513247264e158b2652791fc6ba0c, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/family1/6e3ecc9d74bb4fc5bdc3dc075999831a, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/family1/b652d8cdf334485394744c909fd7fcb2, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/family1/a80f8f1922ea46f08dbb32aa617f1793, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/family1/4a57a7f2eb064b5ea2e8f9cb66c43dae] into tmpdir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/.tmp, totalSize=26.6 K 2023-11-19 10:55:34,088 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting 6ece513247264e158b2652791fc6ba0c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700391326268 2023-11-19 10:55:34,089 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting 6e3ecc9d74bb4fc5bdc3dc075999831a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700391328069 2023-11-19 10:55:34,089 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting b652d8cdf334485394744c909fd7fcb2, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700391329478 2023-11-19 10:55:34,089 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting a80f8f1922ea46f08dbb32aa617f1793, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700391331271 2023-11-19 10:55:34,090 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting 4a57a7f2eb064b5ea2e8f9cb66c43dae, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-19 10:55:34,098 INFO [Listener at localhost/42675] throttle.PressureAwareThroughputController(145): b427a1d00a803e63acb916b5a78a19da#family1#compaction#150 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-19 10:55:34,109 INFO [Listener at localhost/42675] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202311192a76f727d68c4f5aae8b259eb1870258_del 2023-11-19 10:55:34,109 INFO [Listener at localhost/42675] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311192a76f727d68c4f5aae8b259eb1870258_del to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202311192a76f727d68c4f5aae8b259eb1870258_del 2023-11-19 10:55:34,923 INFO [Listener at localhost/42675] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d0a4c3474f5f4ee19dc29595a6cfbce6 2023-11-19 10:55:34,923 DEBUG [Listener at localhost/42675] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/.tmp/family1/d0a4c3474f5f4ee19dc29595a6cfbce6 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/family1/d0a4c3474f5f4ee19dc29595a6cfbce6 2023-11-19 10:55:34,927 INFO [Listener at localhost/42675] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d0a4c3474f5f4ee19dc29595a6cfbce6 2023-11-19 10:55:34,927 INFO [Listener at localhost/42675] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in b427a1d00a803e63acb916b5a78a19da/family1 of b427a1d00a803e63acb916b5a78a19da into d0a4c3474f5f4ee19dc29595a6cfbce6(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-19 10:55:34,928 DEBUG [Listener at localhost/42675] regionserver.HRegion(2289): Compaction status journal for b427a1d00a803e63acb916b5a78a19da: 2023-11-19 10:55:34,928 DEBUG [Listener at localhost/42675] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-19 10:55:34,928 DEBUG [Listener at localhost/42675] regionserver.HStore(1912): b427a1d00a803e63acb916b5a78a19da/family2 is initiating major compaction (all files) 2023-11-19 10:55:34,928 INFO [Listener at localhost/42675] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-19 10:55:34,928 INFO [Listener at localhost/42675] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-19 10:55:34,929 INFO [Listener at localhost/42675] regionserver.HRegion(2259): Starting compaction of b427a1d00a803e63acb916b5a78a19da/family2 in ns:testMinorCompaction,1,1700391324155.b427a1d00a803e63acb916b5a78a19da. 2023-11-19 10:55:34,929 INFO [Listener at localhost/42675] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/family2/169162a8c0d348f6a309f5fafdc14be3, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/family2/0e6abb63a8b4471ba7666ca6c19a5a6a, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/family2/f4ee0d6a7c9c41a0ab9dca42bc80d90b, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/family2/3995d02fa9ef491aa57a1f40cd711e16, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/family2/010a4566062c4e0ab30a14c6a9e4bdf3] into tmpdir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/.tmp, totalSize=25.3 K 2023-11-19 10:55:34,929 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting 169162a8c0d348f6a309f5fafdc14be3, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700391326268 2023-11-19 10:55:34,929 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting 0e6abb63a8b4471ba7666ca6c19a5a6a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700391328069 2023-11-19 10:55:34,930 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting f4ee0d6a7c9c41a0ab9dca42bc80d90b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700391329478 2023-11-19 10:55:34,930 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting 3995d02fa9ef491aa57a1f40cd711e16, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700391331271 2023-11-19 10:55:34,930 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting 010a4566062c4e0ab30a14c6a9e4bdf3, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-19 10:55:34,938 INFO [Listener at localhost/42675] throttle.PressureAwareThroughputController(145): b427a1d00a803e63acb916b5a78a19da#family2#compaction#151 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-19 10:55:35,028 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/family1/6ece513247264e158b2652791fc6ba0c, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/family1/6e3ecc9d74bb4fc5bdc3dc075999831a, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/family1/b652d8cdf334485394744c909fd7fcb2, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/family1/a80f8f1922ea46f08dbb32aa617f1793, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/family1/4a57a7f2eb064b5ea2e8f9cb66c43dae] to archive 2023-11-19 10:55:35,029 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:55:35,030 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/family1/6ece513247264e158b2652791fc6ba0c to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/family1/6ece513247264e158b2652791fc6ba0c 2023-11-19 10:55:35,031 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/family1/6e3ecc9d74bb4fc5bdc3dc075999831a to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/family1/6e3ecc9d74bb4fc5bdc3dc075999831a 2023-11-19 10:55:35,032 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/family1/b652d8cdf334485394744c909fd7fcb2 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/family1/b652d8cdf334485394744c909fd7fcb2 2023-11-19 10:55:35,033 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/family1/a80f8f1922ea46f08dbb32aa617f1793 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/family1/a80f8f1922ea46f08dbb32aa617f1793 2023-11-19 10:55:35,034 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/family1/4a57a7f2eb064b5ea2e8f9cb66c43dae to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/family1/4a57a7f2eb064b5ea2e8f9cb66c43dae 2023-11-19 10:55:35,346 INFO [Listener at localhost/42675] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231119daf19deef7cc4f6d974b330ead88f0a3_del 2023-11-19 10:55:35,347 INFO [Listener at localhost/42675] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231119daf19deef7cc4f6d974b330ead88f0a3_del to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231119daf19deef7cc4f6d974b330ead88f0a3_del 2023-11-19 10:55:35,760 INFO [Listener at localhost/42675] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bdfed278a94a4dc18813423b1495d36a 2023-11-19 10:55:35,761 DEBUG [Listener at localhost/42675] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/.tmp/family2/bdfed278a94a4dc18813423b1495d36a as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/family2/bdfed278a94a4dc18813423b1495d36a 2023-11-19 10:55:35,765 INFO [Listener at localhost/42675] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bdfed278a94a4dc18813423b1495d36a 2023-11-19 10:55:35,765 INFO [Listener at localhost/42675] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in b427a1d00a803e63acb916b5a78a19da/family2 of b427a1d00a803e63acb916b5a78a19da into bdfed278a94a4dc18813423b1495d36a(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-19 10:55:35,766 DEBUG [Listener at localhost/42675] regionserver.HRegion(2289): Compaction status journal for b427a1d00a803e63acb916b5a78a19da: 2023-11-19 10:55:35,766 DEBUG [Listener at localhost/42675] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-19 10:55:35,766 DEBUG [Listener at localhost/42675] regionserver.HStore(1912): cb7ee8609abfbe5e360af47e0bf92474/family1 is initiating major compaction (all files) 2023-11-19 10:55:35,766 INFO [Listener at localhost/42675] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-19 10:55:35,766 INFO [Listener at localhost/42675] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-19 10:55:35,766 INFO [Listener at localhost/42675] regionserver.HRegion(2259): Starting compaction of cb7ee8609abfbe5e360af47e0bf92474/family1 in ns:testMinorCompaction,2,1700391324155.cb7ee8609abfbe5e360af47e0bf92474. 2023-11-19 10:55:35,766 INFO [Listener at localhost/42675] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/family1/82e2f6b279344490a31e40f8bed3110b, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/family1/1e9d89788c0444dd83eb14e2fb184f66, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/family1/ef3be5bb19a44115800c50f660f01494, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/family1/ba7fd7899f334e2d9db85be1a42c999e, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/family1/d93d0ff3a6c94cc299a16ab0d388a7b1] into tmpdir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/.tmp, totalSize=26.6 K 2023-11-19 10:55:35,766 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting 82e2f6b279344490a31e40f8bed3110b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700391326269 2023-11-19 10:55:35,767 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting 1e9d89788c0444dd83eb14e2fb184f66, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700391328069 2023-11-19 10:55:35,767 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting ef3be5bb19a44115800c50f660f01494, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700391329478 2023-11-19 10:55:35,767 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting ba7fd7899f334e2d9db85be1a42c999e, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700391331271 2023-11-19 10:55:35,768 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting d93d0ff3a6c94cc299a16ab0d388a7b1, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-19 10:55:35,775 INFO [Listener at localhost/42675] throttle.PressureAwareThroughputController(145): cb7ee8609abfbe5e360af47e0bf92474#family1#compaction#152 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-19 10:55:35,781 INFO [Listener at localhost/42675] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202311194f59052a4d6641b5bdb47450d44439be_del 2023-11-19 10:55:35,781 INFO [Listener at localhost/42675] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311194f59052a4d6641b5bdb47450d44439be_del to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202311194f59052a4d6641b5bdb47450d44439be_del 2023-11-19 10:55:35,827 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/family2/169162a8c0d348f6a309f5fafdc14be3, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/family2/0e6abb63a8b4471ba7666ca6c19a5a6a, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/family2/f4ee0d6a7c9c41a0ab9dca42bc80d90b, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/family2/3995d02fa9ef491aa57a1f40cd711e16, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/family2/010a4566062c4e0ab30a14c6a9e4bdf3] to archive 2023-11-19 10:55:35,828 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:55:35,829 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/family2/169162a8c0d348f6a309f5fafdc14be3 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/family2/169162a8c0d348f6a309f5fafdc14be3 2023-11-19 10:55:35,830 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/family2/0e6abb63a8b4471ba7666ca6c19a5a6a to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/family2/0e6abb63a8b4471ba7666ca6c19a5a6a 2023-11-19 10:55:35,831 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/family2/f4ee0d6a7c9c41a0ab9dca42bc80d90b to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/family2/f4ee0d6a7c9c41a0ab9dca42bc80d90b 2023-11-19 10:55:35,832 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/family2/3995d02fa9ef491aa57a1f40cd711e16 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/family2/3995d02fa9ef491aa57a1f40cd711e16 2023-11-19 10:55:35,833 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/family2/010a4566062c4e0ab30a14c6a9e4bdf3 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/family2/010a4566062c4e0ab30a14c6a9e4bdf3 2023-11-19 10:55:36,196 INFO [Listener at localhost/42675] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 10f5f05471944550bcb5c855f773cb65 2023-11-19 10:55:36,197 DEBUG [Listener at localhost/42675] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/.tmp/family1/10f5f05471944550bcb5c855f773cb65 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/family1/10f5f05471944550bcb5c855f773cb65 2023-11-19 10:55:36,201 INFO [Listener at localhost/42675] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 10f5f05471944550bcb5c855f773cb65 2023-11-19 10:55:36,202 INFO [Listener at localhost/42675] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in cb7ee8609abfbe5e360af47e0bf92474/family1 of cb7ee8609abfbe5e360af47e0bf92474 into 10f5f05471944550bcb5c855f773cb65(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-19 10:55:36,202 DEBUG [Listener at localhost/42675] regionserver.HRegion(2289): Compaction status journal for cb7ee8609abfbe5e360af47e0bf92474: 2023-11-19 10:55:36,202 DEBUG [Listener at localhost/42675] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-19 10:55:36,202 DEBUG [Listener at localhost/42675] regionserver.HStore(1912): cb7ee8609abfbe5e360af47e0bf92474/family2 is initiating major compaction (all files) 2023-11-19 10:55:36,202 INFO [Listener at localhost/42675] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-19 10:55:36,202 INFO [Listener at localhost/42675] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-19 10:55:36,202 INFO [Listener at localhost/42675] regionserver.HRegion(2259): Starting compaction of cb7ee8609abfbe5e360af47e0bf92474/family2 in ns:testMinorCompaction,2,1700391324155.cb7ee8609abfbe5e360af47e0bf92474. 2023-11-19 10:55:36,202 INFO [Listener at localhost/42675] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/family2/a3a53b51f8d04f90b064d7744b621c9f, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/family2/8fc76bd6f3624d308f52892da416f970, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/family2/6dccd27059ae4d68a2ad0a82c944d5a3, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/family2/408915e52d934b849d0b0976085dab54, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/family2/278f9a43294e4f86ad3ee271c18aef83] into tmpdir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/.tmp, totalSize=25.3 K 2023-11-19 10:55:36,203 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting a3a53b51f8d04f90b064d7744b621c9f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700391326269 2023-11-19 10:55:36,203 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting 8fc76bd6f3624d308f52892da416f970, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700391328069 2023-11-19 10:55:36,204 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting 6dccd27059ae4d68a2ad0a82c944d5a3, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700391329478 2023-11-19 10:55:36,204 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting 408915e52d934b849d0b0976085dab54, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700391331271 2023-11-19 10:55:36,204 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting 278f9a43294e4f86ad3ee271c18aef83, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-19 10:55:36,213 INFO [Listener at localhost/42675] throttle.PressureAwareThroughputController(145): cb7ee8609abfbe5e360af47e0bf92474#family2#compaction#153 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-19 10:55:36,229 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/family1/82e2f6b279344490a31e40f8bed3110b, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/family1/1e9d89788c0444dd83eb14e2fb184f66, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/family1/ef3be5bb19a44115800c50f660f01494, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/family1/ba7fd7899f334e2d9db85be1a42c999e, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/family1/d93d0ff3a6c94cc299a16ab0d388a7b1] to archive 2023-11-19 10:55:36,230 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:55:36,231 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/family1/82e2f6b279344490a31e40f8bed3110b to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/family1/82e2f6b279344490a31e40f8bed3110b 2023-11-19 10:55:36,232 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/family1/1e9d89788c0444dd83eb14e2fb184f66 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/family1/1e9d89788c0444dd83eb14e2fb184f66 2023-11-19 10:55:36,233 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/family1/ef3be5bb19a44115800c50f660f01494 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/family1/ef3be5bb19a44115800c50f660f01494 2023-11-19 10:55:36,234 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/family1/ba7fd7899f334e2d9db85be1a42c999e to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/family1/ba7fd7899f334e2d9db85be1a42c999e 2023-11-19 10:55:36,235 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/family1/d93d0ff3a6c94cc299a16ab0d388a7b1 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/family1/d93d0ff3a6c94cc299a16ab0d388a7b1 2023-11-19 10:55:36,621 INFO [Listener at localhost/42675] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202311195f21d8d8b58e41578844733c29022835_del 2023-11-19 10:55:36,621 INFO [Listener at localhost/42675] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311195f21d8d8b58e41578844733c29022835_del to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202311195f21d8d8b58e41578844733c29022835_del 2023-11-19 10:55:37,034 INFO [Listener at localhost/42675] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b789532f1c734f9f82e2143309bea6b1 2023-11-19 10:55:37,035 DEBUG [Listener at localhost/42675] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/.tmp/family2/b789532f1c734f9f82e2143309bea6b1 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/family2/b789532f1c734f9f82e2143309bea6b1 2023-11-19 10:55:37,039 INFO [Listener at localhost/42675] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b789532f1c734f9f82e2143309bea6b1 2023-11-19 10:55:37,039 INFO [Listener at localhost/42675] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in cb7ee8609abfbe5e360af47e0bf92474/family2 of cb7ee8609abfbe5e360af47e0bf92474 into b789532f1c734f9f82e2143309bea6b1(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-19 10:55:37,040 DEBUG [Listener at localhost/42675] regionserver.HRegion(2289): Compaction status journal for cb7ee8609abfbe5e360af47e0bf92474: 2023-11-19 10:55:37,040 DEBUG [Listener at localhost/42675] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-19 10:55:37,040 DEBUG [Listener at localhost/42675] regionserver.HStore(1912): cc4d248c67f2406eabe5365c5a2f50ca/family1 is initiating major compaction (all files) 2023-11-19 10:55:37,040 INFO [Listener at localhost/42675] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-19 10:55:37,040 INFO [Listener at localhost/42675] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-19 10:55:37,040 INFO [Listener at localhost/42675] regionserver.HRegion(2259): Starting compaction of cc4d248c67f2406eabe5365c5a2f50ca/family1 in ns:testMinorCompaction,,1700391324155.cc4d248c67f2406eabe5365c5a2f50ca. 2023-11-19 10:55:37,040 INFO [Listener at localhost/42675] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/family1/2dc26568af5f48c4af48274e79ef696c, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/family1/be4876e261794f6d9b598a2833f15d4a, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/family1/458c907c969143059711910e610682c2, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/family1/bd8d21125c5f4ff3a8475adfc9e3de39, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/family1/7e21af8ed17248d0b6632473d85f6001] into tmpdir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/.tmp, totalSize=26.6 K 2023-11-19 10:55:37,040 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting 2dc26568af5f48c4af48274e79ef696c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700391326268 2023-11-19 10:55:37,041 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting be4876e261794f6d9b598a2833f15d4a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700391328069 2023-11-19 10:55:37,041 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting 458c907c969143059711910e610682c2, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700391329477 2023-11-19 10:55:37,041 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting bd8d21125c5f4ff3a8475adfc9e3de39, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700391331271 2023-11-19 10:55:37,042 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting 7e21af8ed17248d0b6632473d85f6001, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-19 10:55:37,049 INFO [Listener at localhost/42675] throttle.PressureAwareThroughputController(145): cc4d248c67f2406eabe5365c5a2f50ca#family1#compaction#154 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-19 10:55:37,127 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/family2/a3a53b51f8d04f90b064d7744b621c9f, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/family2/8fc76bd6f3624d308f52892da416f970, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/family2/6dccd27059ae4d68a2ad0a82c944d5a3, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/family2/408915e52d934b849d0b0976085dab54, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/family2/278f9a43294e4f86ad3ee271c18aef83] to archive 2023-11-19 10:55:37,128 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:55:37,129 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/family2/a3a53b51f8d04f90b064d7744b621c9f to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/family2/a3a53b51f8d04f90b064d7744b621c9f 2023-11-19 10:55:37,130 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/family2/8fc76bd6f3624d308f52892da416f970 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/family2/8fc76bd6f3624d308f52892da416f970 2023-11-19 10:55:37,131 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/family2/6dccd27059ae4d68a2ad0a82c944d5a3 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/family2/6dccd27059ae4d68a2ad0a82c944d5a3 2023-11-19 10:55:37,132 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/family2/408915e52d934b849d0b0976085dab54 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/family2/408915e52d934b849d0b0976085dab54 2023-11-19 10:55:37,134 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/family2/278f9a43294e4f86ad3ee271c18aef83 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/family2/278f9a43294e4f86ad3ee271c18aef83 2023-11-19 10:55:37,456 INFO [Listener at localhost/42675] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023111978d3c3817c2a432da9c58e752e7b75f1_del 2023-11-19 10:55:37,456 INFO [Listener at localhost/42675] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023111978d3c3817c2a432da9c58e752e7b75f1_del to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023111978d3c3817c2a432da9c58e752e7b75f1_del 2023-11-19 10:55:38,271 INFO [Listener at localhost/42675] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9b34dc253dc8425a85c854182ccda119 2023-11-19 10:55:38,271 DEBUG [Listener at localhost/42675] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/.tmp/family1/9b34dc253dc8425a85c854182ccda119 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/family1/9b34dc253dc8425a85c854182ccda119 2023-11-19 10:55:38,275 INFO [Listener at localhost/42675] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9b34dc253dc8425a85c854182ccda119 2023-11-19 10:55:38,276 INFO [Listener at localhost/42675] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in cc4d248c67f2406eabe5365c5a2f50ca/family1 of cc4d248c67f2406eabe5365c5a2f50ca into 9b34dc253dc8425a85c854182ccda119(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-19 10:55:38,277 DEBUG [Listener at localhost/42675] regionserver.HRegion(2289): Compaction status journal for cc4d248c67f2406eabe5365c5a2f50ca: 2023-11-19 10:55:38,277 DEBUG [Listener at localhost/42675] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-19 10:55:38,277 DEBUG [Listener at localhost/42675] regionserver.HStore(1912): cc4d248c67f2406eabe5365c5a2f50ca/family2 is initiating major compaction (all files) 2023-11-19 10:55:38,277 INFO [Listener at localhost/42675] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-19 10:55:38,277 INFO [Listener at localhost/42675] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-19 10:55:38,277 INFO [Listener at localhost/42675] regionserver.HRegion(2259): Starting compaction of cc4d248c67f2406eabe5365c5a2f50ca/family2 in ns:testMinorCompaction,,1700391324155.cc4d248c67f2406eabe5365c5a2f50ca. 2023-11-19 10:55:38,277 INFO [Listener at localhost/42675] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/family2/35e2440fb2c749efb69b81361a641fd8, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/family2/3c66e65b8ed94f3c920b92dfe04d4fd6, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/family2/09ebd73b81aa4cdca716814df47e9846, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/family2/c7de6a2b1a4d41dead03ac11f3ff5077, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/family2/3a9944b2ba9e43e38ad75e4d72b76374] into tmpdir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/.tmp, totalSize=25.3 K 2023-11-19 10:55:38,278 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting 35e2440fb2c749efb69b81361a641fd8, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700391326268 2023-11-19 10:55:38,278 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting 3c66e65b8ed94f3c920b92dfe04d4fd6, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700391328069 2023-11-19 10:55:38,278 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting 09ebd73b81aa4cdca716814df47e9846, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700391329477 2023-11-19 10:55:38,279 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting c7de6a2b1a4d41dead03ac11f3ff5077, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700391331271 2023-11-19 10:55:38,279 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting 3a9944b2ba9e43e38ad75e4d72b76374, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-19 10:55:38,287 INFO [Listener at localhost/42675] throttle.PressureAwareThroughputController(145): cc4d248c67f2406eabe5365c5a2f50ca#family2#compaction#155 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-19 10:55:38,329 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/family1/2dc26568af5f48c4af48274e79ef696c, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/family1/be4876e261794f6d9b598a2833f15d4a, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/family1/458c907c969143059711910e610682c2, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/family1/bd8d21125c5f4ff3a8475adfc9e3de39, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/family1/7e21af8ed17248d0b6632473d85f6001] to archive 2023-11-19 10:55:38,330 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:55:38,332 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/family1/2dc26568af5f48c4af48274e79ef696c to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/family1/2dc26568af5f48c4af48274e79ef696c 2023-11-19 10:55:38,332 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/family1/be4876e261794f6d9b598a2833f15d4a to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/family1/be4876e261794f6d9b598a2833f15d4a 2023-11-19 10:55:38,333 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/family1/458c907c969143059711910e610682c2 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/family1/458c907c969143059711910e610682c2 2023-11-19 10:55:38,334 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/family1/bd8d21125c5f4ff3a8475adfc9e3de39 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/family1/bd8d21125c5f4ff3a8475adfc9e3de39 2023-11-19 10:55:38,335 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/family1/7e21af8ed17248d0b6632473d85f6001 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/family1/7e21af8ed17248d0b6632473d85f6001 2023-11-19 10:55:38,695 INFO [Listener at localhost/42675] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231119510ba0b9f6ea4bbe99c8b2f17fe14510_del 2023-11-19 10:55:38,695 INFO [Listener at localhost/42675] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231119510ba0b9f6ea4bbe99c8b2f17fe14510_del to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231119510ba0b9f6ea4bbe99c8b2f17fe14510_del 2023-11-19 10:55:39,508 INFO [Listener at localhost/42675] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 454cf8c115334a8f855d7f22ce36fff1 2023-11-19 10:55:39,509 DEBUG [Listener at localhost/42675] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/.tmp/family2/454cf8c115334a8f855d7f22ce36fff1 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/family2/454cf8c115334a8f855d7f22ce36fff1 2023-11-19 10:55:39,514 INFO [Listener at localhost/42675] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 454cf8c115334a8f855d7f22ce36fff1 2023-11-19 10:55:39,515 INFO [Listener at localhost/42675] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in cc4d248c67f2406eabe5365c5a2f50ca/family2 of cc4d248c67f2406eabe5365c5a2f50ca into 454cf8c115334a8f855d7f22ce36fff1(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-19 10:55:39,515 DEBUG [Listener at localhost/42675] regionserver.HRegion(2289): Compaction status journal for cc4d248c67f2406eabe5365c5a2f50ca: 2023-11-19 10:55:39,518 DEBUG [Listener at localhost/42675] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-19 10:55:39,521 DEBUG [Listener at localhost/42675] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-19 10:55:39,525 DEBUG [Listener at localhost/42675] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-19 10:55:39,525 DEBUG [Listener at localhost/42675] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-19 10:55:39,528 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/family2/35e2440fb2c749efb69b81361a641fd8, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/family2/3c66e65b8ed94f3c920b92dfe04d4fd6, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/family2/09ebd73b81aa4cdca716814df47e9846, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/family2/c7de6a2b1a4d41dead03ac11f3ff5077, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/family2/3a9944b2ba9e43e38ad75e4d72b76374] to archive 2023-11-19 10:55:39,529 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:55:39,531 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/family2/35e2440fb2c749efb69b81361a641fd8 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/family2/35e2440fb2c749efb69b81361a641fd8 2023-11-19 10:55:39,532 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/family2/3c66e65b8ed94f3c920b92dfe04d4fd6 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/family2/3c66e65b8ed94f3c920b92dfe04d4fd6 2023-11-19 10:55:39,533 INFO [Listener at localhost/42675] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-19 10:55:39,533 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/family2/09ebd73b81aa4cdca716814df47e9846 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/family2/09ebd73b81aa4cdca716814df47e9846 2023-11-19 10:55:39,534 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/family2/c7de6a2b1a4d41dead03ac11f3ff5077 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/family2/c7de6a2b1a4d41dead03ac11f3ff5077 2023-11-19 10:55:39,536 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/family2/3a9944b2ba9e43e38ad75e4d72b76374 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/family2/3a9944b2ba9e43e38ad75e4d72b76374 2023-11-19 10:55:39,546 INFO [Listener at localhost/42675] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 3 del files, 3 selected files, and 0 irrelevant files table 'ns:testMinorCompaction' and column 'family1' 2023-11-19 10:55:39,549 INFO [Listener at localhost/42675] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023111978d3c3817c2a432da9c58e752e7b75f1_del 2023-11-19 10:55:39,552 INFO [Listener at localhost/42675] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202311192a76f727d68c4f5aae8b259eb1870258_del 2023-11-19 10:55:39,554 INFO [Listener at localhost/42675] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202311194f59052a4d6641b5bdb47450d44439be_del 2023-11-19 10:55:39,554 INFO [Listener at localhost/42675] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='ns:testMinorCompaction' column='family1' 2023-11-19 10:55:39,555 DEBUG [Listener at localhost/42675] zookeeper.ReadOnlyZKClient(139): Connect 0x2b98f7c4 to 127.0.0.1:60497 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-19 10:55:39,559 DEBUG [Listener at localhost/42675] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5513016, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-19 10:55:39,560 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231119 for table='ns:testMinorCompaction' and column='family1' 2023-11-19 10:55:39,560 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231119 for table='ns:testMinorCompaction' and column='family1' 2023-11-19 10:55:39,560 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231119 for table='ns:testMinorCompaction' and column='family1' 2023-11-19 10:55:39,604 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231119d801a888e31d49a88dc2161934192dcf to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231119d801a888e31d49a88dc2161934192dcf 2023-11-19 10:55:39,605 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231119 table='ns:testMinorCompaction' column='family1' 2023-11-19 10:55:39,617 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-19 10:55:39,619 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53434, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-19 10:55:39,626 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-19 10:55:39,629 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55336, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-19 10:55:39,638 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231119/family1/d186c0707d9240338b4ef79a26df1306 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x01] 2023-11-19 10:55:39,638 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,1,1700391324155.b427a1d00a803e63acb916b5a78a19da., hostname=jenkins-hbase4.apache.org,46035,1700391201579, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231119/family1/d186c0707d9240338b4ef79a26df1306}] 2023-11-19 10:55:39,644 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(763): Validating hfile at hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231119/family1/d186c0707d9240338b4ef79a26df1306 for inclusion in b427a1d00a803e63acb916b5a78a19da/family1 2023-11-19 10:55:39,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x01 2023-11-19 10:55:39,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-19 10:55:39,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegion(2446): Flush status journal for b427a1d00a803e63acb916b5a78a19da: 2023-11-19 10:55:39,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231119/family1/d186c0707d9240338b4ef79a26df1306 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__ns_testMinorCompaction__rq6ip7fb5aoh2bnuuao3vhrhq8fj3llusm4sl0rntjl6a1i213lvmp60jeggdaes/family1/d186c0707d9240338b4ef79a26df1306 2023-11-19 10:55:39,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__ns_testMinorCompaction__rq6ip7fb5aoh2bnuuao3vhrhq8fj3llusm4sl0rntjl6a1i213lvmp60jeggdaes/family1/d186c0707d9240338b4ef79a26df1306 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/family1/7ece35a4e2044f7fb8594681f54b30a2_SeqId_28_ 2023-11-19 10:55:39,650 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(849): Loaded HFile hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__ns_testMinorCompaction__rq6ip7fb5aoh2bnuuao3vhrhq8fj3llusm4sl0rntjl6a1i213lvmp60jeggdaes/family1/d186c0707d9240338b4ef79a26df1306 into b427a1d00a803e63acb916b5a78a19da/family1 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/family1/7ece35a4e2044f7fb8594681f54b30a2_SeqId_28_ - updating store file list. 2023-11-19 10:55:39,653 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(882): Loaded HFile hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/family1/7ece35a4e2044f7fb8594681f54b30a2_SeqId_28_ into b427a1d00a803e63acb916b5a78a19da/family1 2023-11-19 10:55:39,653 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(855): Successfully loaded hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__ns_testMinorCompaction__rq6ip7fb5aoh2bnuuao3vhrhq8fj3llusm4sl0rntjl6a1i213lvmp60jeggdaes/family1/d186c0707d9240338b4ef79a26df1306 into b427a1d00a803e63acb916b5a78a19da/family1 (new location: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/family1/7ece35a4e2044f7fb8594681f54b30a2_SeqId_28_) 2023-11-19 10:55:39,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__ns_testMinorCompaction__rq6ip7fb5aoh2bnuuao3vhrhq8fj3llusm4sl0rntjl6a1i213lvmp60jeggdaes/family1/d186c0707d9240338b4ef79a26df1306 2023-11-19 10:55:39,655 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231119 table='ns:testMinorCompaction' column='family1' 2023-11-19 10:55:39,655 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:55:39,656 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202311195dd3e83c3b4048398ee3bbbaa103ed05 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202311195dd3e83c3b4048398ee3bbbaa103ed05 2023-11-19 10:55:39,657 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-11-19 10:55:39,657 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231119' 2023-11-19 10:55:39,657 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231119 for table='ns:testMinorCompaction' and column='family1' 2023-11-19 10:55:40,401 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311199c9bf64f3dde4bad815a762869b335e4 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202311199c9bf64f3dde4bad815a762869b335e4 2023-11-19 10:55:40,402 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311199a3abc772d4a4c07810f19574fbfa04e to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202311199a3abc772d4a4c07810f19574fbfa04e 2023-11-19 10:55:40,402 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231119 table='ns:testMinorCompaction' column='family1' 2023-11-19 10:55:40,402 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231119 table='ns:testMinorCompaction' column='family1' 2023-11-19 10:55:40,436 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231119/family1/ab73cb97c4a34e51adfacab183f309d9 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x01] 2023-11-19 10:55:40,436 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,,1700391324155.cc4d248c67f2406eabe5365c5a2f50ca., hostname=jenkins-hbase4.apache.org,46035,1700391201579, seqNum=2 for row with hfile group [{family1,hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231119/family1/ab73cb97c4a34e51adfacab183f309d9}] 2023-11-19 10:55:40,437 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231119/family1/28f6ef961fe8432ea4f14a49027756eb first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x01] 2023-11-19 10:55:40,438 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,2,1700391324155.cb7ee8609abfbe5e360af47e0bf92474., hostname=jenkins-hbase4.apache.org,46035,1700391201579, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231119/family1/28f6ef961fe8432ea4f14a49027756eb}] 2023-11-19 10:55:40,439 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(763): Validating hfile at hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231119/family1/ab73cb97c4a34e51adfacab183f309d9 for inclusion in cc4d248c67f2406eabe5365c5a2f50ca/family1 2023-11-19 10:55:40,439 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46035] regionserver.HStore(763): Validating hfile at hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231119/family1/28f6ef961fe8432ea4f14a49027756eb for inclusion in cb7ee8609abfbe5e360af47e0bf92474/family1 2023-11-19 10:55:40,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x01 2023-11-19 10:55:40,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(777): Region bounds: first= last=1 2023-11-19 10:55:40,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegion(2446): Flush status journal for cc4d248c67f2406eabe5365c5a2f50ca: 2023-11-19 10:55:40,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46035] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x01 2023-11-19 10:55:40,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46035] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-19 10:55:40,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46035] regionserver.HRegion(2446): Flush status journal for cb7ee8609abfbe5e360af47e0bf92474: 2023-11-19 10:55:40,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231119/family1/ab73cb97c4a34e51adfacab183f309d9 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__ns_testMinorCompaction__qml8hna8hjc2s3j05go9l5t7lt6dabgpsos1vec1h82npjkia8kk1nq821pqlpu4/family1/ab73cb97c4a34e51adfacab183f309d9 2023-11-19 10:55:40,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46035] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231119/family1/28f6ef961fe8432ea4f14a49027756eb to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__ns_testMinorCompaction__9fv0atbsgs927jbjo2om29tsqi1g65d31l4p0tjf0opv2mbllu50nosgvbb85uqk/family1/28f6ef961fe8432ea4f14a49027756eb 2023-11-19 10:55:40,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__ns_testMinorCompaction__qml8hna8hjc2s3j05go9l5t7lt6dabgpsos1vec1h82npjkia8kk1nq821pqlpu4/family1/ab73cb97c4a34e51adfacab183f309d9 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/family1/353eb0370ffc40dc9776ee0c716b3854_SeqId_28_ 2023-11-19 10:55:40,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46035] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__ns_testMinorCompaction__9fv0atbsgs927jbjo2om29tsqi1g65d31l4p0tjf0opv2mbllu50nosgvbb85uqk/family1/28f6ef961fe8432ea4f14a49027756eb as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/family1/5bb44bd347794783aeab53a98c3b2f8c_SeqId_28_ 2023-11-19 10:55:40,445 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(849): Loaded HFile hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__ns_testMinorCompaction__qml8hna8hjc2s3j05go9l5t7lt6dabgpsos1vec1h82npjkia8kk1nq821pqlpu4/family1/ab73cb97c4a34e51adfacab183f309d9 into cc4d248c67f2406eabe5365c5a2f50ca/family1 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/family1/353eb0370ffc40dc9776ee0c716b3854_SeqId_28_ - updating store file list. 2023-11-19 10:55:40,445 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46035] regionserver.HStore(849): Loaded HFile hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__ns_testMinorCompaction__9fv0atbsgs927jbjo2om29tsqi1g65d31l4p0tjf0opv2mbllu50nosgvbb85uqk/family1/28f6ef961fe8432ea4f14a49027756eb into cb7ee8609abfbe5e360af47e0bf92474/family1 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/family1/5bb44bd347794783aeab53a98c3b2f8c_SeqId_28_ - updating store file list. 2023-11-19 10:55:40,447 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(882): Loaded HFile hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/family1/353eb0370ffc40dc9776ee0c716b3854_SeqId_28_ into cc4d248c67f2406eabe5365c5a2f50ca/family1 2023-11-19 10:55:40,447 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(855): Successfully loaded hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__ns_testMinorCompaction__qml8hna8hjc2s3j05go9l5t7lt6dabgpsos1vec1h82npjkia8kk1nq821pqlpu4/family1/ab73cb97c4a34e51adfacab183f309d9 into cc4d248c67f2406eabe5365c5a2f50ca/family1 (new location: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/family1/353eb0370ffc40dc9776ee0c716b3854_SeqId_28_) 2023-11-19 10:55:40,447 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46035] regionserver.HStore(882): Loaded HFile hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/family1/5bb44bd347794783aeab53a98c3b2f8c_SeqId_28_ into cb7ee8609abfbe5e360af47e0bf92474/family1 2023-11-19 10:55:40,448 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46035] regionserver.HStore(855): Successfully loaded hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__ns_testMinorCompaction__9fv0atbsgs927jbjo2om29tsqi1g65d31l4p0tjf0opv2mbllu50nosgvbb85uqk/family1/28f6ef961fe8432ea4f14a49027756eb into cb7ee8609abfbe5e360af47e0bf92474/family1 (new location: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/family1/5bb44bd347794783aeab53a98c3b2f8c_SeqId_28_) 2023-11-19 10:55:40,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__ns_testMinorCompaction__qml8hna8hjc2s3j05go9l5t7lt6dabgpsos1vec1h82npjkia8kk1nq821pqlpu4/family1/ab73cb97c4a34e51adfacab183f309d9 2023-11-19 10:55:40,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46035] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__ns_testMinorCompaction__9fv0atbsgs927jbjo2om29tsqi1g65d31l4p0tjf0opv2mbllu50nosgvbb85uqk/family1/28f6ef961fe8432ea4f14a49027756eb 2023-11-19 10:55:40,449 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231119 table='ns:testMinorCompaction' column='family1' 2023-11-19 10:55:40,449 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231119 table='ns:testMinorCompaction' column='family1' 2023-11-19 10:55:40,450 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:55:40,450 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:55:40,451 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202311195cb1d536d4d5431a9432752aa4a511f3 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202311195cb1d536d4d5431a9432752aa4a511f3 2023-11-19 10:55:40,451 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231119fb12391db4884e8e91590ef544627e6e to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231119fb12391db4884e8e91590ef544627e6e 2023-11-19 10:55:40,451 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-11-19 10:55:40,451 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-11-19 10:55:40,451 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231119' 2023-11-19 10:55:40,451 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231119' 2023-11-19 10:55:40,452 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231119 for table='ns:testMinorCompaction' and column='family1' 2023-11-19 10:55:40,452 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231119 for table='ns:testMinorCompaction' and column='family1' 2023-11-19 10:55:40,452 INFO [Listener at localhost/42675] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='ns:testMinorCompaction' column='family1' 2023-11-19 10:55:40,454 DEBUG [Listener at localhost/42675] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-19 10:55:40,456 DEBUG [Listener at localhost/42675] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-19 10:55:40,458 DEBUG [Listener at localhost/42675] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-19 10:55:40,459 DEBUG [Listener at localhost/42675] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-19 10:55:40,474 INFO [Listener at localhost/42675] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompaction Thread=250 (was 293), OpenFileDescriptor=659 (was 801), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=164 (was 172), ProcessCount=174 (was 174), AvailableMemoryMB=15841 (was 15707) - AvailableMemoryMB LEAK? - 2023-11-19 10:55:40,485 INFO [Listener at localhost/42675] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=250, OpenFileDescriptor=659, MaxFileDescriptor=60000, SystemLoadAverage=164, ProcessCount=174, AvailableMemoryMB=15841 2023-11-19 10:55:40,487 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-19 10:55:40,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:40,489 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-19 10:55:40,489 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithMonthlyPolicy" procId is: 112 2023-11-19 10:55:40,489 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-19 10:55:40,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-19 10:55:40,490 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42 2023-11-19 10:55:40,491 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42 empty. 2023-11-19 10:55:40,491 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42 2023-11-19 10:55:40,491 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithMonthlyPolicy regions 2023-11-19 10:55:40,498 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-19 10:55:40,500 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6cb2537056386ddfd53df16ae102ba42, NAME => 'testMinorCompactionWithMonthlyPolicy,,1700391340487.6cb2537056386ddfd53df16ae102ba42.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp 2023-11-19 10:55:40,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-19 10:55:40,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-19 10:55:40,904 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1700391340487.6cb2537056386ddfd53df16ae102ba42.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-19 10:55:40,904 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing 6cb2537056386ddfd53df16ae102ba42, disabling compactions & flushes 2023-11-19 10:55:40,904 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1700391340487.6cb2537056386ddfd53df16ae102ba42. 2023-11-19 10:55:40,904 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1700391340487.6cb2537056386ddfd53df16ae102ba42. 2023-11-19 10:55:40,904 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1700391340487.6cb2537056386ddfd53df16ae102ba42. after waiting 0 ms 2023-11-19 10:55:40,904 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1700391340487.6cb2537056386ddfd53df16ae102ba42. 2023-11-19 10:55:40,904 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1700391340487.6cb2537056386ddfd53df16ae102ba42. 2023-11-19 10:55:40,904 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 6cb2537056386ddfd53df16ae102ba42: 2023-11-19 10:55:40,906 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-19 10:55:40,907 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithMonthlyPolicy,,1700391340487.6cb2537056386ddfd53df16ae102ba42.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1700391340907"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700391340907"}]},"ts":"1700391340907"} 2023-11-19 10:55:40,909 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-19 10:55:40,909 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-19 10:55:40,909 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700391340909"}]},"ts":"1700391340909"} 2023-11-19 10:55:40,910 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-11-19 10:55:40,913 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=6cb2537056386ddfd53df16ae102ba42, ASSIGN}] 2023-11-19 10:55:40,915 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=6cb2537056386ddfd53df16ae102ba42, ASSIGN 2023-11-19 10:55:40,915 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=6cb2537056386ddfd53df16ae102ba42, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46035,1700391201579; forceNewPlan=false, retain=false 2023-11-19 10:55:41,066 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=6cb2537056386ddfd53df16ae102ba42, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:41,066 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithMonthlyPolicy,,1700391340487.6cb2537056386ddfd53df16ae102ba42.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1700391341066"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700391341066"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700391341066"}]},"ts":"1700391341066"} 2023-11-19 10:55:41,068 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=114, ppid=113, state=RUNNABLE; OpenRegionProcedure 6cb2537056386ddfd53df16ae102ba42, server=jenkins-hbase4.apache.org,46035,1700391201579}] 2023-11-19 10:55:41,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-19 10:55:41,219 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:41,222 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMinorCompactionWithMonthlyPolicy,,1700391340487.6cb2537056386ddfd53df16ae102ba42. 2023-11-19 10:55:41,222 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6cb2537056386ddfd53df16ae102ba42, NAME => 'testMinorCompactionWithMonthlyPolicy,,1700391340487.6cb2537056386ddfd53df16ae102ba42.', STARTKEY => '', ENDKEY => ''} 2023-11-19 10:55:41,222 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithMonthlyPolicy 6cb2537056386ddfd53df16ae102ba42 2023-11-19 10:55:41,222 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1700391340487.6cb2537056386ddfd53df16ae102ba42.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-19 10:55:41,223 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6cb2537056386ddfd53df16ae102ba42 2023-11-19 10:55:41,223 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6cb2537056386ddfd53df16ae102ba42 2023-11-19 10:55:41,224 INFO [StoreOpener-6cb2537056386ddfd53df16ae102ba42-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 6cb2537056386ddfd53df16ae102ba42 2023-11-19 10:55:41,225 DEBUG [StoreOpener-6cb2537056386ddfd53df16ae102ba42-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1 2023-11-19 10:55:41,225 DEBUG [StoreOpener-6cb2537056386ddfd53df16ae102ba42-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1 2023-11-19 10:55:41,226 INFO [StoreOpener-6cb2537056386ddfd53df16ae102ba42-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6cb2537056386ddfd53df16ae102ba42 columnFamilyName family1 2023-11-19 10:55:41,227 INFO [StoreOpener-6cb2537056386ddfd53df16ae102ba42-1] regionserver.HStore(310): Store=6cb2537056386ddfd53df16ae102ba42/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-19 10:55:41,228 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42 2023-11-19 10:55:41,228 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42 2023-11-19 10:55:41,230 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6cb2537056386ddfd53df16ae102ba42 2023-11-19 10:55:41,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-19 10:55:41,231 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6cb2537056386ddfd53df16ae102ba42; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72526489, jitterRate=0.08072890341281891}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-19 10:55:41,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6cb2537056386ddfd53df16ae102ba42: 2023-11-19 10:55:41,232 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMinorCompactionWithMonthlyPolicy,,1700391340487.6cb2537056386ddfd53df16ae102ba42., pid=114, masterSystemTime=1700391341219 2023-11-19 10:55:41,233 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMinorCompactionWithMonthlyPolicy,,1700391340487.6cb2537056386ddfd53df16ae102ba42. 2023-11-19 10:55:41,233 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMinorCompactionWithMonthlyPolicy,,1700391340487.6cb2537056386ddfd53df16ae102ba42. 2023-11-19 10:55:41,233 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=6cb2537056386ddfd53df16ae102ba42, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:41,233 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithMonthlyPolicy,,1700391340487.6cb2537056386ddfd53df16ae102ba42.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1700391341233"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700391341233"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700391341233"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700391341233"}]},"ts":"1700391341233"} 2023-11-19 10:55:41,236 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=114, resume processing ppid=113 2023-11-19 10:55:41,236 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=114, ppid=113, state=SUCCESS; OpenRegionProcedure 6cb2537056386ddfd53df16ae102ba42, server=jenkins-hbase4.apache.org,46035,1700391201579 in 167 msec 2023-11-19 10:55:41,237 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=113, resume processing ppid=112 2023-11-19 10:55:41,237 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=113, ppid=112, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=6cb2537056386ddfd53df16ae102ba42, ASSIGN in 323 msec 2023-11-19 10:55:41,237 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-19 10:55:41,237 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700391341237"}]},"ts":"1700391341237"} 2023-11-19 10:55:41,238 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-11-19 10:55:41,240 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-19 10:55:41,241 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy in 753 msec 2023-11-19 10:55:41,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-19 10:55:41,594 INFO [Listener at localhost/42675] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithMonthlyPolicy, procId: 112 completed 2023-11-19 10:55:41,614 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:55:41,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:41,618 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-19 10:55:41,618 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:55:41,619 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-19 10:55:41,619 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-19 10:55:41,619 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:41,619 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:41,621 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:55:41,621 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:41,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:55:41,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:55:41,622 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:41,622 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:55:41,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:41,622 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:41,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:55:41,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:41,623 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:41,626 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:41,626 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-19 10:55:41,626 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:55:41,626 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-19 10:55:41,627 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-19 10:55:41,627 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:55:41,627 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700391340487.6cb2537056386ddfd53df16ae102ba42. 2023-11-19 10:55:41,627 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700391340487.6cb2537056386ddfd53df16ae102ba42. started... 2023-11-19 10:55:41,628 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6cb2537056386ddfd53df16ae102ba42 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-19 10:55:41,715 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithMonthlyPolicy' 2023-11-19 10:55:42,053 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130a200c6debf504efc89ae95a4fda8ebd0 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130a200c6debf504efc89ae95a4fda8ebd0 2023-11-19 10:55:42,456 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/.tmp/family1/d687fa9f39594fa08924e38321abbe50 2023-11-19 10:55:42,460 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/.tmp/family1/d687fa9f39594fa08924e38321abbe50 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/d687fa9f39594fa08924e38321abbe50 2023-11-19 10:55:42,464 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/d687fa9f39594fa08924e38321abbe50, entries=1000, sequenceid=5, filesize=166.0 K 2023-11-19 10:55:42,465 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 6cb2537056386ddfd53df16ae102ba42 in 837ms, sequenceid=5, compaction requested=false 2023-11-19 10:55:42,465 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6cb2537056386ddfd53df16ae102ba42: 2023-11-19 10:55:42,466 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700391340487.6cb2537056386ddfd53df16ae102ba42. 2023-11-19 10:55:42,466 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-19 10:55:42,466 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-19 10:55:42,466 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:42,466 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-19 10:55:42,466 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-19 10:55:42,470 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:42,470 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:42,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:42,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:42,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:55:42,471 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:42,471 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:55:42,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:42,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:42,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:42,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:42,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:42,472 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-19 10:55:42,472 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@18e0a947[Count = 0] remaining members to acquire global barrier 2023-11-19 10:55:42,472 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-19 10:55:42,472 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:42,473 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:42,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:42,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:42,473 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-19 10:55:42,473 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-19 10:55:42,473 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:55:42,473 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:42,473 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:55:42,474 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:42,474 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-19 10:55:42,474 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:55:42,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:42,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:42,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:55:42,474 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-19 10:55:42,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:42,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:42,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:42,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:42,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:42,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:42,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:42,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:55:42,477 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-19 10:55:42,477 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-19 10:55:42,477 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:55:42,477 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:55:42,477 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:42,477 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:55:42,479 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:42,479 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:42,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:42,480 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:55:42,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:42,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:55:42,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:42,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:42,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:42,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:55:42,480 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:42,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:55:42,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:42,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:42,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:42,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:42,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:42,481 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:42,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:42,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:42,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:42,483 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:42,483 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:42,483 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:42,484 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:42,484 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:55:42,484 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:42,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:55:42,484 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-19 10:55:42,484 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-19 10:55:42,484 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:55:42,484 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:55:42,484 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:42,484 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:55:42,484 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:42,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:55:42,484 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-19 10:55:42,484 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:55:42,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:55:42,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:55:42,584 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:55:42,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:55:42,589 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:55:42,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-19 10:55:42,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:42,591 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-19 10:55:42,591 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:55:42,591 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-19 10:55:42,591 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-19 10:55:42,591 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:42,591 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:42,592 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:42,592 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:55:42,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:55:42,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:55:42,593 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:42,593 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:55:42,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:42,593 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:42,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:55:42,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:42,594 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:42,595 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-19 10:55:42,595 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:42,595 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-19 10:55:42,595 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:55:42,595 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-19 10:55:42,596 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-19 10:55:42,596 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700391340487.6cb2537056386ddfd53df16ae102ba42. 2023-11-19 10:55:42,596 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700391340487.6cb2537056386ddfd53df16ae102ba42. started... 2023-11-19 10:55:42,596 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:55:42,596 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6cb2537056386ddfd53df16ae102ba42 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-19 10:55:43,014 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128cdf3cfbcd69549aa97b2670e14c03146 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128cdf3cfbcd69549aa97b2670e14c03146 2023-11-19 10:55:43,419 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/.tmp/family1/c06a680cb6f142f891803d572e7d66a0 2023-11-19 10:55:43,423 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/.tmp/family1/c06a680cb6f142f891803d572e7d66a0 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/c06a680cb6f142f891803d572e7d66a0 2023-11-19 10:55:43,426 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/c06a680cb6f142f891803d572e7d66a0, entries=1, sequenceid=9, filesize=5.0 K 2023-11-19 10:55:43,427 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 6cb2537056386ddfd53df16ae102ba42 in 831ms, sequenceid=9, compaction requested=false 2023-11-19 10:55:43,427 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6cb2537056386ddfd53df16ae102ba42: 2023-11-19 10:55:43,427 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700391340487.6cb2537056386ddfd53df16ae102ba42. 2023-11-19 10:55:43,427 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-19 10:55:43,427 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-19 10:55:43,427 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:43,428 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-19 10:55:43,428 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-19 10:55:43,429 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:43,429 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:43,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:43,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:43,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:55:43,429 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:43,429 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:55:43,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:43,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:43,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:43,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:43,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:43,431 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-19 10:55:43,431 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2ff4f3bc[Count = 0] remaining members to acquire global barrier 2023-11-19 10:55:43,431 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-19 10:55:43,431 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:43,433 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:43,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:43,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:43,433 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-19 10:55:43,433 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-19 10:55:43,433 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:55:43,433 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:43,434 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:55:43,435 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-19 10:55:43,435 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:55:43,435 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:43,435 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-19 10:55:43,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:43,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:43,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:55:43,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:43,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:43,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:43,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:43,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:43,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:43,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:43,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:55:43,437 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-19 10:55:43,437 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-19 10:55:43,437 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:55:43,437 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:55:43,437 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:43,437 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:55:43,438 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:43,438 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:43,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:43,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:43,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:43,439 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:55:43,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:43,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:55:43,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:55:43,439 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:43,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:43,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:55:43,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:43,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:43,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:43,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:43,440 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:43,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:43,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:43,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:43,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:43,442 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:43,442 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:43,442 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:43,442 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:55:43,442 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:43,442 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:55:43,443 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-19 10:55:43,443 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-19 10:55:43,443 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:55:43,443 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:55:43,443 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:43,442 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:55:43,443 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:43,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:55:43,443 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:43,443 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-19 10:55:43,443 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:55:43,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:55:43,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:55:43,543 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:55:43,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:55:43,547 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:55:43,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-19 10:55:43,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:43,549 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-19 10:55:43,549 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:55:43,549 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-19 10:55:43,549 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-19 10:55:43,549 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:43,549 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:43,552 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:55:43,552 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:43,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:55:43,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:55:43,552 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:43,552 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:55:43,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:43,553 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:43,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:55:43,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:43,553 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:43,553 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-19 10:55:43,553 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:43,553 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-19 10:55:43,553 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:55:43,554 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-19 10:55:43,554 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-19 10:55:43,554 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:55:43,554 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700391340487.6cb2537056386ddfd53df16ae102ba42. 2023-11-19 10:55:43,554 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700391340487.6cb2537056386ddfd53df16ae102ba42. started... 2023-11-19 10:55:43,554 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6cb2537056386ddfd53df16ae102ba42 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-19 10:55:43,965 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512018deedb5f949b4f35a2c92792273c761a to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512018deedb5f949b4f35a2c92792273c761a 2023-11-19 10:55:44,370 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/.tmp/family1/ee9dd04840d34ddfa7cdafeafb473e1e 2023-11-19 10:55:44,374 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/.tmp/family1/ee9dd04840d34ddfa7cdafeafb473e1e as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/ee9dd04840d34ddfa7cdafeafb473e1e 2023-11-19 10:55:44,377 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/ee9dd04840d34ddfa7cdafeafb473e1e, entries=1, sequenceid=13, filesize=4.9 K 2023-11-19 10:55:44,378 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6cb2537056386ddfd53df16ae102ba42 in 824ms, sequenceid=13, compaction requested=true 2023-11-19 10:55:44,378 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6cb2537056386ddfd53df16ae102ba42: 2023-11-19 10:55:44,378 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700391340487.6cb2537056386ddfd53df16ae102ba42. 2023-11-19 10:55:44,378 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-19 10:55:44,378 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-19 10:55:44,378 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:44,378 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-19 10:55:44,378 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-19 10:55:44,380 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:44,380 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:44,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:44,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:44,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:55:44,381 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:44,381 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:55:44,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:44,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:44,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:44,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:44,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:44,382 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-19 10:55:44,382 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@65b6f543[Count = 0] remaining members to acquire global barrier 2023-11-19 10:55:44,382 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-19 10:55:44,382 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:44,384 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:44,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:44,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:44,384 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-19 10:55:44,384 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:44,384 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:55:44,384 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-19 10:55:44,384 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:55:44,385 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:44,385 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-19 10:55:44,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:44,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:44,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:55:44,385 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:55:44,385 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-19 10:55:44,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:44,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:44,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:44,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:44,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:44,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:44,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:44,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:55:44,388 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-19 10:55:44,388 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-19 10:55:44,388 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:55:44,388 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:55:44,388 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:44,388 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:55:44,391 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:44,391 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:44,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:44,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:44,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:44,391 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:55:44,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:55:44,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:44,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:44,391 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:44,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:55:44,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:55:44,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:44,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:44,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:44,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:44,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:44,393 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:44,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:44,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:44,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:44,397 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:44,397 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:55:44,397 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:44,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:55:44,397 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-19 10:55:44,397 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-19 10:55:44,397 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:55:44,397 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:55:44,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:55:44,397 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:55:44,397 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:44,398 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:44,398 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:44,398 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-19 10:55:44,398 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:55:44,398 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:44,398 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:55:44,398 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:44,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:55:44,498 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:55:44,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:55:44,502 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:55:44,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-19 10:55:44,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:44,504 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-19 10:55:44,504 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:55:44,504 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-19 10:55:44,504 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-19 10:55:44,504 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:44,504 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:44,506 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:44,506 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:55:44,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:55:44,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:55:44,506 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:44,506 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:55:44,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:44,506 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:44,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:55:44,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:44,507 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:44,507 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-19 10:55:44,507 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:44,507 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-19 10:55:44,507 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:55:44,507 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-19 10:55:44,507 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-19 10:55:44,507 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:55:44,507 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700391340487.6cb2537056386ddfd53df16ae102ba42. 2023-11-19 10:55:44,507 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700391340487.6cb2537056386ddfd53df16ae102ba42. started... 2023-11-19 10:55:44,507 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6cb2537056386ddfd53df16ae102ba42 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-19 10:55:44,918 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205dcad1712bdb64838ae637e8246ed558f to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205dcad1712bdb64838ae637e8246ed558f 2023-11-19 10:55:45,323 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/.tmp/family1/0db598a1f1914d3a90881318025f5113 2023-11-19 10:55:45,326 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/.tmp/family1/0db598a1f1914d3a90881318025f5113 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/0db598a1f1914d3a90881318025f5113 2023-11-19 10:55:45,329 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/0db598a1f1914d3a90881318025f5113, entries=1, sequenceid=17, filesize=4.9 K 2023-11-19 10:55:45,330 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6cb2537056386ddfd53df16ae102ba42 in 823ms, sequenceid=17, compaction requested=true 2023-11-19 10:55:45,330 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6cb2537056386ddfd53df16ae102ba42: 2023-11-19 10:55:45,330 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700391340487.6cb2537056386ddfd53df16ae102ba42. 2023-11-19 10:55:45,330 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-19 10:55:45,330 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-19 10:55:45,330 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:45,330 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-19 10:55:45,330 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-19 10:55:45,332 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:45,332 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:45,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:45,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:45,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:55:45,332 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:45,332 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:55:45,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:45,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:45,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:45,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:45,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:45,334 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-19 10:55:45,334 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@595fd0f3[Count = 0] remaining members to acquire global barrier 2023-11-19 10:55:45,334 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-19 10:55:45,334 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:45,336 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:45,336 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:45,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:45,336 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-19 10:55:45,336 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-19 10:55:45,336 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:55:45,336 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:45,336 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:55:45,337 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:45,337 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-19 10:55:45,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:45,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:45,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:55:45,337 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:55:45,338 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-19 10:55:45,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:45,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:45,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:45,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:45,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:45,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:45,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:45,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:55:45,340 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-19 10:55:45,340 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-19 10:55:45,340 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:55:45,340 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:55:45,340 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:45,340 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:55:45,341 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:45,341 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:45,341 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:55:45,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:45,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:45,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:45,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:45,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:55:45,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:55:45,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:55:45,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:45,342 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:45,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:45,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:45,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:45,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:45,343 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:45,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:45,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:45,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:45,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:45,345 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:45,345 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:45,345 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:45,345 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:45,345 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:45,345 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:45,345 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:55:45,345 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-19 10:55:45,345 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:55:45,345 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:45,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:55:45,345 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-19 10:55:45,345 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:55:45,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:55:45,345 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:55:45,346 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-19 10:55:45,346 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:55:45,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:55:45,346 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:55:45,446 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:55:45,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:55:45,450 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:55:45,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-19 10:55:45,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:45,451 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-19 10:55:45,451 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:55:45,452 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-19 10:55:45,452 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-19 10:55:45,452 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:45,452 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:45,454 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:45,454 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:55:45,454 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:55:45,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:55:45,454 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:45,454 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:55:45,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:45,455 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:45,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:55:45,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:45,455 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:45,455 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-19 10:55:45,455 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:45,455 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-19 10:55:45,455 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:55:45,455 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-19 10:55:45,456 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-19 10:55:45,456 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:55:45,456 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700391340487.6cb2537056386ddfd53df16ae102ba42. 2023-11-19 10:55:45,456 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700391340487.6cb2537056386ddfd53df16ae102ba42. started... 2023-11-19 10:55:45,456 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6cb2537056386ddfd53df16ae102ba42 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-19 10:55:45,866 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228ff1de5c1b00a462e90cd412238ec0c72 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228ff1de5c1b00a462e90cd412238ec0c72 2023-11-19 10:55:46,270 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/.tmp/family1/fe40896a0c4c438f99dd45d8a1cdf4a0 2023-11-19 10:55:46,274 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/.tmp/family1/fe40896a0c4c438f99dd45d8a1cdf4a0 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/fe40896a0c4c438f99dd45d8a1cdf4a0 2023-11-19 10:55:46,277 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/fe40896a0c4c438f99dd45d8a1cdf4a0, entries=1, sequenceid=21, filesize=4.9 K 2023-11-19 10:55:46,278 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6cb2537056386ddfd53df16ae102ba42 in 822ms, sequenceid=21, compaction requested=true 2023-11-19 10:55:46,278 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6cb2537056386ddfd53df16ae102ba42: 2023-11-19 10:55:46,278 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700391340487.6cb2537056386ddfd53df16ae102ba42. 2023-11-19 10:55:46,278 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-19 10:55:46,278 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-19 10:55:46,278 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:46,278 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-19 10:55:46,278 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-19 10:55:46,280 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:46,280 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:46,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:46,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:46,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:55:46,280 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:46,280 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:55:46,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:46,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:46,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:46,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:46,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:46,282 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-19 10:55:46,282 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@44e8f00e[Count = 0] remaining members to acquire global barrier 2023-11-19 10:55:46,282 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-19 10:55:46,282 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:46,283 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:46,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:46,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:46,283 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-19 10:55:46,283 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-19 10:55:46,283 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:55:46,283 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:46,283 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:55:46,284 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:46,284 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-19 10:55:46,284 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:55:46,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:46,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:46,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:55:46,284 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-19 10:55:46,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:46,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:46,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:46,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:46,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:46,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:46,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:46,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:55:46,287 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-19 10:55:46,287 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-19 10:55:46,287 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:55:46,287 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:55:46,287 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:46,287 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:55:46,289 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:46,289 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:46,289 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:55:46,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:46,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:46,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:55:46,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:46,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:46,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:46,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:55:46,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:55:46,290 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:46,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:46,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:46,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:46,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:46,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:46,291 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:46,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:46,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:46,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:46,293 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:46,293 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:55:46,293 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:55:46,293 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:55:46,293 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:46,293 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-19 10:55:46,294 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:55:46,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:55:46,294 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:46,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:55:46,294 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:46,294 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:46,294 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:46,294 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:46,294 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-19 10:55:46,294 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:55:46,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:55:46,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:55:46,394 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:55:46,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:55:46,399 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:55:46,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-19 10:55:46,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:46,400 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-19 10:55:46,400 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:55:46,400 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-19 10:55:46,400 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-19 10:55:46,401 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:46,401 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:46,402 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:46,402 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:55:46,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:55:46,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:55:46,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:46,403 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:46,403 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:46,403 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:55:46,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:55:46,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:46,404 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:46,404 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-19 10:55:46,404 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:46,404 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-19 10:55:46,404 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:55:46,404 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-19 10:55:46,408 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-19 10:55:46,408 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700391340487.6cb2537056386ddfd53df16ae102ba42. 2023-11-19 10:55:46,408 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700391340487.6cb2537056386ddfd53df16ae102ba42. started... 2023-11-19 10:55:46,408 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:55:46,408 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6cb2537056386ddfd53df16ae102ba42 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-19 10:55:46,763 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-19 10:55:46,823 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231f72cd8b91b5842598f0ed15ecb63a54c to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231f72cd8b91b5842598f0ed15ecb63a54c 2023-11-19 10:55:47,228 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/.tmp/family1/4eb3fb4dcd6749e0b0040a069f1f69db 2023-11-19 10:55:47,232 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/.tmp/family1/4eb3fb4dcd6749e0b0040a069f1f69db as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/4eb3fb4dcd6749e0b0040a069f1f69db 2023-11-19 10:55:47,235 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/4eb3fb4dcd6749e0b0040a069f1f69db, entries=1, sequenceid=25, filesize=4.9 K 2023-11-19 10:55:47,235 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6cb2537056386ddfd53df16ae102ba42 in 827ms, sequenceid=25, compaction requested=true 2023-11-19 10:55:47,236 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6cb2537056386ddfd53df16ae102ba42: 2023-11-19 10:55:47,236 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700391340487.6cb2537056386ddfd53df16ae102ba42. 2023-11-19 10:55:47,236 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-19 10:55:47,236 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-19 10:55:47,236 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:47,236 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-19 10:55:47,236 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-19 10:55:47,237 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:47,237 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:47,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:47,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:47,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:55:47,238 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:47,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:47,238 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:55:47,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:47,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:47,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:47,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:47,239 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-19 10:55:47,239 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4c89923c[Count = 0] remaining members to acquire global barrier 2023-11-19 10:55:47,239 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-19 10:55:47,239 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:47,244 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:47,244 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:47,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:47,245 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-19 10:55:47,245 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-19 10:55:47,245 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:55:47,245 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:47,245 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:55:47,248 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-19 10:55:47,248 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:55:47,248 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:47,248 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-19 10:55:47,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:47,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:47,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:55:47,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:47,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:47,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:47,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:47,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:47,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:47,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:47,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:55:47,251 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-19 10:55:47,251 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-19 10:55:47,251 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:55:47,251 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:55:47,251 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:47,251 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:55:47,252 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:47,252 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:47,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:47,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:47,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:47,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:47,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:55:47,252 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:55:47,253 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:55:47,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:55:47,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:47,253 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:47,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:47,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:47,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:47,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:47,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:47,254 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:47,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:47,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:47,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:47,258 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:47,258 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:47,258 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:47,258 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:47,258 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:47,258 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:47,258 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:47,258 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:55:47,258 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:55:47,258 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-19 10:55:47,258 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:55:47,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:55:47,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:55:47,258 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:55:47,258 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-19 10:55:47,258 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:55:47,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:55:47,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:55:47,358 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:55:47,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:55:47,362 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:55:47,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-19 10:55:47,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:47,364 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-19 10:55:47,364 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:55:47,364 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-19 10:55:47,364 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-19 10:55:47,364 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:47,364 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:47,365 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:47,365 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:55:47,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:55:47,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:55:47,366 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:47,366 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:55:47,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:47,366 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:47,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:55:47,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:47,367 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:47,367 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-19 10:55:47,367 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:47,367 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-19 10:55:47,367 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:55:47,367 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-19 10:55:47,367 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-19 10:55:47,367 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:55:47,367 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700391340487.6cb2537056386ddfd53df16ae102ba42. 2023-11-19 10:55:47,367 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700391340487.6cb2537056386ddfd53df16ae102ba42. started... 2023-11-19 10:55:47,367 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6cb2537056386ddfd53df16ae102ba42 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-19 10:55:47,778 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101dc47cf26a79a4bb589b5ac84c1aa3fe6 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160101dc47cf26a79a4bb589b5ac84c1aa3fe6 2023-11-19 10:55:48,183 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/.tmp/family1/48800ce21da7457589f6245b8e89a662 2023-11-19 10:55:48,187 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/.tmp/family1/48800ce21da7457589f6245b8e89a662 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/48800ce21da7457589f6245b8e89a662 2023-11-19 10:55:48,190 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/48800ce21da7457589f6245b8e89a662, entries=1, sequenceid=29, filesize=4.9 K 2023-11-19 10:55:48,191 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6cb2537056386ddfd53df16ae102ba42 in 824ms, sequenceid=29, compaction requested=true 2023-11-19 10:55:48,191 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6cb2537056386ddfd53df16ae102ba42: 2023-11-19 10:55:48,191 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700391340487.6cb2537056386ddfd53df16ae102ba42. 2023-11-19 10:55:48,191 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-19 10:55:48,192 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-19 10:55:48,192 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:48,192 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-19 10:55:48,192 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-19 10:55:48,193 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:48,193 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:48,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:48,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:48,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:55:48,194 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:48,194 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:55:48,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:48,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:48,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:48,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:48,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:48,195 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-19 10:55:48,195 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1ec77a03[Count = 0] remaining members to acquire global barrier 2023-11-19 10:55:48,195 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-19 10:55:48,195 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:48,196 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:48,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:48,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:48,196 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-19 10:55:48,196 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-19 10:55:48,196 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:55:48,197 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:48,197 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:55:48,199 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:48,199 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-19 10:55:48,199 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:55:48,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:48,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:48,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:55:48,199 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-19 10:55:48,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:48,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:48,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:48,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:48,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:48,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:48,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:48,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:55:48,201 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-19 10:55:48,201 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-19 10:55:48,201 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:55:48,201 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:55:48,201 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:48,201 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:55:48,202 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:48,202 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:48,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:48,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:48,202 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:55:48,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:48,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:48,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:55:48,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:55:48,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:55:48,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:48,203 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:48,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:48,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:48,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:48,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:48,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:48,204 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:48,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:48,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:48,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:48,207 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:48,207 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:48,207 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:55:48,207 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:48,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:55:48,207 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:55:48,207 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:48,207 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:55:48,207 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:48,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:55:48,207 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-19 10:55:48,207 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:55:48,207 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:48,207 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:48,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:55:48,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:55:48,208 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-19 10:55:48,208 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:55:48,308 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:55:48,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:55:48,312 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:55:48,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-19 10:55:48,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:48,314 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-19 10:55:48,314 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:55:48,314 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-19 10:55:48,314 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-19 10:55:48,314 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:48,314 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:48,315 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:55:48,315 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:48,315 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:55:48,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:55:48,316 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:48,316 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:55:48,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:48,316 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:48,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:55:48,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:48,317 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:48,317 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-19 10:55:48,317 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:48,317 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-19 10:55:48,317 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:55:48,317 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-19 10:55:48,317 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-19 10:55:48,317 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:55:48,317 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700391340487.6cb2537056386ddfd53df16ae102ba42. 2023-11-19 10:55:48,317 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700391340487.6cb2537056386ddfd53df16ae102ba42. started... 2023-11-19 10:55:48,317 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6cb2537056386ddfd53df16ae102ba42 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-19 10:55:48,728 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601032140f6b6f0904fac97859b3e4b7f1389 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601032140f6b6f0904fac97859b3e4b7f1389 2023-11-19 10:55:49,134 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/.tmp/family1/937c05d2563b404c886eedbf98a04021 2023-11-19 10:55:49,137 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/.tmp/family1/937c05d2563b404c886eedbf98a04021 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/937c05d2563b404c886eedbf98a04021 2023-11-19 10:55:49,140 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/937c05d2563b404c886eedbf98a04021, entries=1, sequenceid=33, filesize=4.9 K 2023-11-19 10:55:49,141 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6cb2537056386ddfd53df16ae102ba42 in 824ms, sequenceid=33, compaction requested=true 2023-11-19 10:55:49,141 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6cb2537056386ddfd53df16ae102ba42: 2023-11-19 10:55:49,141 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700391340487.6cb2537056386ddfd53df16ae102ba42. 2023-11-19 10:55:49,141 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-19 10:55:49,141 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-19 10:55:49,141 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:49,141 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-19 10:55:49,141 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-19 10:55:49,144 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:49,144 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:49,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:49,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:49,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:55:49,144 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:49,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:49,144 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:55:49,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:49,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:49,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:49,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:49,145 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-19 10:55:49,145 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3938f960[Count = 0] remaining members to acquire global barrier 2023-11-19 10:55:49,145 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-19 10:55:49,145 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:49,146 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:49,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:49,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:49,147 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-19 10:55:49,147 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-19 10:55:49,147 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:55:49,147 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:49,147 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:55:49,148 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-19 10:55:49,148 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:55:49,148 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:49,148 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-19 10:55:49,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:49,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:49,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:55:49,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:49,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:49,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:49,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:49,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:49,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:49,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:49,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:55:49,150 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-19 10:55:49,150 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-19 10:55:49,150 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:55:49,150 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:55:49,150 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:49,150 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:55:49,151 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:49,151 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:49,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:49,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:49,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:55:49,152 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:49,152 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:55:49,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:49,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:49,152 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:55:49,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:55:49,152 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:49,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:49,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:49,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:49,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:49,153 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:49,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:49,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:49,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:49,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:49,156 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:49,156 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:55:49,156 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:49,156 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:49,156 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:55:49,156 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-19 10:55:49,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:55:49,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:55:49,156 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:55:49,156 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-19 10:55:49,157 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:55:49,156 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:49,157 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:49,157 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:49,157 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:49,157 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:55:49,157 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-19 10:55:49,157 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:55:49,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:55:49,257 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:55:49,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:55:49,261 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:55:49,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-19 10:55:49,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:49,263 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-19 10:55:49,263 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:55:49,263 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-19 10:55:49,263 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-19 10:55:49,263 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:49,263 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:49,264 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:49,264 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:55:49,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:55:49,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:55:49,265 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:49,265 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:55:49,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:49,265 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:49,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:55:49,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:49,266 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:49,266 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-19 10:55:49,266 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:49,266 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-19 10:55:49,266 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:55:49,266 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-19 10:55:49,266 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-19 10:55:49,266 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:55:49,266 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700391340487.6cb2537056386ddfd53df16ae102ba42. 2023-11-19 10:55:49,266 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700391340487.6cb2537056386ddfd53df16ae102ba42. started... 2023-11-19 10:55:49,266 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6cb2537056386ddfd53df16ae102ba42 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-19 10:55:49,677 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509070747a5b6159f476787d9658649eaacaa to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201509070747a5b6159f476787d9658649eaacaa 2023-11-19 10:55:50,082 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/.tmp/family1/2ddcbbe3293245a9bfdced6d5778d8a5 2023-11-19 10:55:50,086 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/.tmp/family1/2ddcbbe3293245a9bfdced6d5778d8a5 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/2ddcbbe3293245a9bfdced6d5778d8a5 2023-11-19 10:55:50,089 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/2ddcbbe3293245a9bfdced6d5778d8a5, entries=1, sequenceid=37, filesize=4.9 K 2023-11-19 10:55:50,090 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6cb2537056386ddfd53df16ae102ba42 in 824ms, sequenceid=37, compaction requested=true 2023-11-19 10:55:50,090 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6cb2537056386ddfd53df16ae102ba42: 2023-11-19 10:55:50,090 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700391340487.6cb2537056386ddfd53df16ae102ba42. 2023-11-19 10:55:50,090 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-19 10:55:50,090 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-19 10:55:50,090 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:50,090 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-19 10:55:50,090 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-19 10:55:50,094 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:50,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:50,094 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:50,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:50,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:55:50,095 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:50,095 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:55:50,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:50,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:50,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:50,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:50,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:50,096 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-19 10:55:50,096 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3ad306c9[Count = 0] remaining members to acquire global barrier 2023-11-19 10:55:50,096 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-19 10:55:50,096 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:50,097 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:50,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:50,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:50,097 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-19 10:55:50,098 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-19 10:55:50,098 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:50,098 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:55:50,098 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:55:50,099 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-19 10:55:50,099 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:55:50,099 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:50,099 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-19 10:55:50,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:50,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:50,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:55:50,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:50,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:50,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:50,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:50,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:50,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:50,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:50,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:55:50,101 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-19 10:55:50,101 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-19 10:55:50,102 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:55:50,102 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:55:50,102 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:50,102 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:55:50,104 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:50,104 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:50,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:50,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:50,104 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:55:50,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:50,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:55:50,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:50,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:50,105 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:50,105 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:55:50,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:55:50,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:50,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:50,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:50,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:50,106 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:50,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:50,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:50,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:50,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:50,108 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:50,108 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:50,108 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:55:50,108 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-19 10:55:50,108 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:55:50,108 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-19 10:55:50,108 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:55:50,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:55:50,108 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:55:50,108 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:50,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:55:50,108 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-19 10:55:50,108 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:55:50,108 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:50,108 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:50,108 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:50,108 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:50,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:55:50,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:55:50,208 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:55:50,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:55:50,213 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:55:50,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-19 10:55:50,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:50,214 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-19 10:55:50,214 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:55:50,214 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-19 10:55:50,214 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-19 10:55:50,215 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:50,215 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:50,216 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:50,216 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:55:50,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:55:50,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:55:50,216 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:50,216 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:55:50,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:50,217 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:50,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:55:50,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:50,217 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:50,217 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-19 10:55:50,217 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:50,217 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-19 10:55:50,217 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:55:50,217 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-19 10:55:50,218 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-19 10:55:50,218 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:55:50,218 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700391340487.6cb2537056386ddfd53df16ae102ba42. 2023-11-19 10:55:50,218 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700391340487.6cb2537056386ddfd53df16ae102ba42. started... 2023-11-19 10:55:50,218 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6cb2537056386ddfd53df16ae102ba42 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-19 10:55:50,629 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112001b4427097d74e79863a703e09a35dd7 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015112001b4427097d74e79863a703e09a35dd7 2023-11-19 10:55:50,637 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/.tmp/family1/21ab752992234243986f55ebf87b3613 2023-11-19 10:55:50,641 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/.tmp/family1/21ab752992234243986f55ebf87b3613 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/21ab752992234243986f55ebf87b3613 2023-11-19 10:55:50,644 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/21ab752992234243986f55ebf87b3613, entries=1, sequenceid=41, filesize=4.9 K 2023-11-19 10:55:50,645 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6cb2537056386ddfd53df16ae102ba42 in 427ms, sequenceid=41, compaction requested=true 2023-11-19 10:55:50,645 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6cb2537056386ddfd53df16ae102ba42: 2023-11-19 10:55:50,645 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700391340487.6cb2537056386ddfd53df16ae102ba42. 2023-11-19 10:55:50,646 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-19 10:55:50,646 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-19 10:55:50,646 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:50,646 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-19 10:55:50,646 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-19 10:55:50,647 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:50,647 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:50,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:50,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:50,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:55:50,647 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:50,648 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:55:50,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:50,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:50,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:50,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:50,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:50,649 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-19 10:55:50,649 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3a4b6bdd[Count = 0] remaining members to acquire global barrier 2023-11-19 10:55:50,649 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-19 10:55:50,649 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:50,652 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:50,652 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:50,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:50,652 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-19 10:55:50,652 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-19 10:55:50,652 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:55:50,652 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:50,652 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:55:50,653 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-19 10:55:50,653 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:55:50,653 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:50,653 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-19 10:55:50,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:50,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:50,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:55:50,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:50,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:50,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:50,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:50,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:50,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:50,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:50,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:55:50,656 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-19 10:55:50,656 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-19 10:55:50,656 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:55:50,656 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:55:50,656 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:50,656 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:55:50,657 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:50,657 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:50,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:50,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:50,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:55:50,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:50,657 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:55:50,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:50,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:50,658 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:50,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:55:50,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:55:50,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:50,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:50,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:50,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:50,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:50,659 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:50,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:50,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:50,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:50,662 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:50,662 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:55:50,662 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:50,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:55:50,662 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:55:50,662 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:55:50,662 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-19 10:55:50,662 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:55:50,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:55:50,662 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:50,662 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:50,662 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:50,662 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:50,662 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:50,662 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-19 10:55:50,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:55:50,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:55:50,662 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:55:50,763 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:55:50,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:55:50,765 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=33457] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMinorCompactionWithMonthlyPolicy 2023-11-19 10:55:50,766 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] procedure2.ProcedureExecutor(1028): Stored pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-19 10:55:50,767 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-19 10:55:50,768 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-19 10:55:50,768 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=115, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700391950768 2023-11-19 10:55:50,768 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-19 10:55:50,769 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMinorCompactionWithMonthlyPolicy' and column 'family1' 2023-11-19 10:55:50,769 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-19 10:55:50,770 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] zookeeper.ReadOnlyZKClient(139): Connect 0x16844807 to 127.0.0.1:60497 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-19 10:55:50,779 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7154ffd0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-19 10:55:50,779 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-19 10:55:50,805 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601034ad9c6414d7841bc905f7a2829436b4a to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601034ad9c6414d7841bc905f7a2829436b4a 2023-11-19 10:55:50,806 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-19 10:55:50,822 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-19 10:55:50,825 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39558, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-19 10:55:50,831 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-19 10:55:50,832 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55058, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-19 10:55:50,840 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/1be00bca413941598d074aac0f295314 first=Optional[r5] last=Optional[r6] 2023-11-19 10:55:50,841 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1700391340487.6cb2537056386ddfd53df16ae102ba42., hostname=jenkins-hbase4.apache.org,46035,1700391201579, seqNum=2 for row with hfile group [{family1,hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/1be00bca413941598d074aac0f295314}] 2023-11-19 10:55:50,845 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(763): Validating hfile at hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/1be00bca413941598d074aac0f295314 for inclusion in 6cb2537056386ddfd53df16ae102ba42/family1 2023-11-19 10:55:50,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-11-19 10:55:50,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(777): Region bounds: first= last= 2023-11-19 10:55:50,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegion(2446): Flush status journal for 6cb2537056386ddfd53df16ae102ba42: 2023-11-19 10:55:50,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/1be00bca413941598d074aac0f295314 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__gamm4a4uv7emdrkpao3fb5q2381q0ja8l3348v3508t9q63h649tkm0nvlrl9gho/family1/1be00bca413941598d074aac0f295314 2023-11-19 10:55:50,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__gamm4a4uv7emdrkpao3fb5q2381q0ja8l3348v3508t9q63h649tkm0nvlrl9gho/family1/1be00bca413941598d074aac0f295314 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/634cde51258c4d50bb450bb53bddaf27_SeqId_44_ 2023-11-19 10:55:50,851 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(849): Loaded HFile hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__gamm4a4uv7emdrkpao3fb5q2381q0ja8l3348v3508t9q63h649tkm0nvlrl9gho/family1/1be00bca413941598d074aac0f295314 into 6cb2537056386ddfd53df16ae102ba42/family1 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/634cde51258c4d50bb450bb53bddaf27_SeqId_44_ - updating store file list. 2023-11-19 10:55:50,853 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(882): Loaded HFile hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/634cde51258c4d50bb450bb53bddaf27_SeqId_44_ into 6cb2537056386ddfd53df16ae102ba42/family1 2023-11-19 10:55:50,853 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(855): Successfully loaded hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__gamm4a4uv7emdrkpao3fb5q2381q0ja8l3348v3508t9q63h649tkm0nvlrl9gho/family1/1be00bca413941598d074aac0f295314 into 6cb2537056386ddfd53df16ae102ba42/family1 (new location: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/634cde51258c4d50bb450bb53bddaf27_SeqId_44_) 2023-11-19 10:55:50,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__gamm4a4uv7emdrkpao3fb5q2381q0ja8l3348v3508t9q63h649tkm0nvlrl9gho/family1/1be00bca413941598d074aac0f295314 2023-11-19 10:55:50,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-19 10:55:50,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-19 10:55:50,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(1912): 6cb2537056386ddfd53df16ae102ba42/family1 is initiating minor compaction 2023-11-19 10:55:50,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@3f9a49f; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-19 10:55:50,857 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 6cb2537056386ddfd53df16ae102ba42/family1 in testMinorCompactionWithMonthlyPolicy,,1700391340487.6cb2537056386ddfd53df16ae102ba42. 2023-11-19 10:55:50,857 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/c06a680cb6f142f891803d572e7d66a0, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/ee9dd04840d34ddfa7cdafeafb473e1e, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/0db598a1f1914d3a90881318025f5113, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/fe40896a0c4c438f99dd45d8a1cdf4a0, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/4eb3fb4dcd6749e0b0040a069f1f69db, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/48800ce21da7457589f6245b8e89a662, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/937c05d2563b404c886eedbf98a04021, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/2ddcbbe3293245a9bfdced6d5778d8a5, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/21ab752992234243986f55ebf87b3613, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/634cde51258c4d50bb450bb53bddaf27_SeqId_44_] into tmpdir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/.tmp, totalSize=49.7 K 2023-11-19 10:55:50,857 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting c06a680cb6f142f891803d572e7d66a0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-19 10:55:50,857 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting ee9dd04840d34ddfa7cdafeafb473e1e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-19 10:55:50,857 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting 0db598a1f1914d3a90881318025f5113, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-19 10:55:50,857 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting fe40896a0c4c438f99dd45d8a1cdf4a0, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-19 10:55:50,857 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting 4eb3fb4dcd6749e0b0040a069f1f69db, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-19 10:55:50,857 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting 48800ce21da7457589f6245b8e89a662, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-19 10:55:50,857 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting 937c05d2563b404c886eedbf98a04021, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-19 10:55:50,857 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting 2ddcbbe3293245a9bfdced6d5778d8a5, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-19 10:55:50,857 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting 21ab752992234243986f55ebf87b3613, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-19 10:55:50,857 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting 634cde51258c4d50bb450bb53bddaf27_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-19 10:55:50,858 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-19 10:55:50,859 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:55:50,860 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160101dc47cf26a79a4bb589b5ac84c1aa3fe6 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160101dc47cf26a79a4bb589b5ac84c1aa3fe6 2023-11-19 10:55:50,861 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601032140f6b6f0904fac97859b3e4b7f1389 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601032140f6b6f0904fac97859b3e4b7f1389 2023-11-19 10:55:50,861 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-11-19 10:55:50,861 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-11-19 10:55:50,862 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-19 10:55:50,862 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-19 10:55:50,886 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] throttle.PressureAwareThroughputController(145): 6cb2537056386ddfd53df16ae102ba42#family1#compaction#166 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-11-19 10:55:51,306 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512315493f1a6b95f41a593330410c8719fe8 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512315493f1a6b95f41a593330410c8719fe8 2023-11-19 10:55:51,307 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-19 10:55:51,328 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/190c08f96b1846648730ccefb50f3554 first=Optional[r1] last=Optional[r4] 2023-11-19 10:55:51,329 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1700391340487.6cb2537056386ddfd53df16ae102ba42., hostname=jenkins-hbase4.apache.org,46035,1700391201579, seqNum=2 for row with hfile group [{family1,hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/190c08f96b1846648730ccefb50f3554}] 2023-11-19 10:55:51,330 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(763): Validating hfile at hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/190c08f96b1846648730ccefb50f3554 for inclusion in 6cb2537056386ddfd53df16ae102ba42/family1 2023-11-19 10:55:51,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-11-19 10:55:51,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(777): Region bounds: first= last= 2023-11-19 10:55:51,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegion(2446): Flush status journal for 6cb2537056386ddfd53df16ae102ba42: 2023-11-19 10:55:51,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/190c08f96b1846648730ccefb50f3554 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__tojqntcldfubungb8fa3sokao7qcguoslqpm7k0j5vrg1qi1jq9tkl2g8bn8u87s/family1/190c08f96b1846648730ccefb50f3554 2023-11-19 10:55:51,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__tojqntcldfubungb8fa3sokao7qcguoslqpm7k0j5vrg1qi1jq9tkl2g8bn8u87s/family1/190c08f96b1846648730ccefb50f3554 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/3561e79437a24eeeac4265b5b2560383_SeqId_46_ 2023-11-19 10:55:51,336 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(849): Loaded HFile hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__tojqntcldfubungb8fa3sokao7qcguoslqpm7k0j5vrg1qi1jq9tkl2g8bn8u87s/family1/190c08f96b1846648730ccefb50f3554 into 6cb2537056386ddfd53df16ae102ba42/family1 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/3561e79437a24eeeac4265b5b2560383_SeqId_46_ - updating store file list. 2023-11-19 10:55:51,339 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(882): Loaded HFile hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/3561e79437a24eeeac4265b5b2560383_SeqId_46_ into 6cb2537056386ddfd53df16ae102ba42/family1 2023-11-19 10:55:51,339 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(855): Successfully loaded hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__tojqntcldfubungb8fa3sokao7qcguoslqpm7k0j5vrg1qi1jq9tkl2g8bn8u87s/family1/190c08f96b1846648730ccefb50f3554 into 6cb2537056386ddfd53df16ae102ba42/family1 (new location: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/3561e79437a24eeeac4265b5b2560383_SeqId_46_) 2023-11-19 10:55:51,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__tojqntcldfubungb8fa3sokao7qcguoslqpm7k0j5vrg1qi1jq9tkl2g8bn8u87s/family1/190c08f96b1846648730ccefb50f3554 2023-11-19 10:55:51,341 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-19 10:55:51,342 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:55:51,346 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512018deedb5f949b4f35a2c92792273c761a to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512018deedb5f949b4f35a2c92792273c761a 2023-11-19 10:55:51,347 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205dcad1712bdb64838ae637e8246ed558f to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205dcad1712bdb64838ae637e8246ed558f 2023-11-19 10:55:51,348 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228ff1de5c1b00a462e90cd412238ec0c72 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228ff1de5c1b00a462e90cd412238ec0c72 2023-11-19 10:55:51,349 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231f72cd8b91b5842598f0ed15ecb63a54c to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231f72cd8b91b5842598f0ed15ecb63a54c 2023-11-19 10:55:51,349 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-11-19 10:55:51,350 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-11-19 10:55:51,350 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-19 10:55:51,350 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-19 10:55:51,698 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/.tmp/family1/4b947c7597ef44cabaee8a64a6ab8c2f as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/4b947c7597ef44cabaee8a64a6ab8c2f 2023-11-19 10:55:51,702 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 6cb2537056386ddfd53df16ae102ba42/family1 of 6cb2537056386ddfd53df16ae102ba42 into 4b947c7597ef44cabaee8a64a6ab8c2f(size=6.6 K), total size for store is 178.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-19 10:55:51,702 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 6cb2537056386ddfd53df16ae102ba42: 2023-11-19 10:55:51,702 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1700391340487.6cb2537056386ddfd53df16ae102ba42., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1700391350857; duration=0sec 2023-11-19 10:55:51,702 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-19 10:55:51,728 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/c06a680cb6f142f891803d572e7d66a0, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/ee9dd04840d34ddfa7cdafeafb473e1e, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/0db598a1f1914d3a90881318025f5113, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/fe40896a0c4c438f99dd45d8a1cdf4a0, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/4eb3fb4dcd6749e0b0040a069f1f69db, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/48800ce21da7457589f6245b8e89a662, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/937c05d2563b404c886eedbf98a04021, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/2ddcbbe3293245a9bfdced6d5778d8a5, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/21ab752992234243986f55ebf87b3613, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/634cde51258c4d50bb450bb53bddaf27_SeqId_44_] to archive 2023-11-19 10:55:51,729 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:55:51,730 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/c06a680cb6f142f891803d572e7d66a0 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/c06a680cb6f142f891803d572e7d66a0 2023-11-19 10:55:51,731 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/ee9dd04840d34ddfa7cdafeafb473e1e to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/ee9dd04840d34ddfa7cdafeafb473e1e 2023-11-19 10:55:51,732 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/0db598a1f1914d3a90881318025f5113 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/0db598a1f1914d3a90881318025f5113 2023-11-19 10:55:51,733 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/fe40896a0c4c438f99dd45d8a1cdf4a0 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/fe40896a0c4c438f99dd45d8a1cdf4a0 2023-11-19 10:55:51,734 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/4eb3fb4dcd6749e0b0040a069f1f69db to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/4eb3fb4dcd6749e0b0040a069f1f69db 2023-11-19 10:55:51,735 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/48800ce21da7457589f6245b8e89a662 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/48800ce21da7457589f6245b8e89a662 2023-11-19 10:55:51,736 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/937c05d2563b404c886eedbf98a04021 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/937c05d2563b404c886eedbf98a04021 2023-11-19 10:55:51,737 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/2ddcbbe3293245a9bfdced6d5778d8a5 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/2ddcbbe3293245a9bfdced6d5778d8a5 2023-11-19 10:55:51,738 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/21ab752992234243986f55ebf87b3613 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/21ab752992234243986f55ebf87b3613 2023-11-19 10:55:51,739 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/634cde51258c4d50bb450bb53bddaf27_SeqId_44_ to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/634cde51258c4d50bb450bb53bddaf27_SeqId_44_ 2023-11-19 10:55:51,786 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113066f0487f0ede40b9a33f96deb8042c75 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015113066f0487f0ede40b9a33f96deb8042c75 2023-11-19 10:55:51,786 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-19 10:55:51,809 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/2cb04c9892e64cf39165c52beca66cca first=Optional[r00] last=Optional[r8] 2023-11-19 10:55:51,809 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1700391340487.6cb2537056386ddfd53df16ae102ba42., hostname=jenkins-hbase4.apache.org,46035,1700391201579, seqNum=2 for row with hfile group [{family1,hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/2cb04c9892e64cf39165c52beca66cca}] 2023-11-19 10:55:51,811 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(763): Validating hfile at hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/2cb04c9892e64cf39165c52beca66cca for inclusion in 6cb2537056386ddfd53df16ae102ba42/family1 2023-11-19 10:55:51,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-11-19 10:55:51,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(777): Region bounds: first= last= 2023-11-19 10:55:51,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegion(2446): Flush status journal for 6cb2537056386ddfd53df16ae102ba42: 2023-11-19 10:55:51,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/2cb04c9892e64cf39165c52beca66cca to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__vkl5lrnb8jrumee4n3uuahorq1huc1o59479og42m03j5cvij8890gr510ih35oc/family1/2cb04c9892e64cf39165c52beca66cca 2023-11-19 10:55:51,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__vkl5lrnb8jrumee4n3uuahorq1huc1o59479og42m03j5cvij8890gr510ih35oc/family1/2cb04c9892e64cf39165c52beca66cca as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/84ff2eeb88d24aa587df3225e596f6ed_SeqId_49_ 2023-11-19 10:55:51,817 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(849): Loaded HFile hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__vkl5lrnb8jrumee4n3uuahorq1huc1o59479og42m03j5cvij8890gr510ih35oc/family1/2cb04c9892e64cf39165c52beca66cca into 6cb2537056386ddfd53df16ae102ba42/family1 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/84ff2eeb88d24aa587df3225e596f6ed_SeqId_49_ - updating store file list. 2023-11-19 10:55:51,820 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(882): Loaded HFile hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/84ff2eeb88d24aa587df3225e596f6ed_SeqId_49_ into 6cb2537056386ddfd53df16ae102ba42/family1 2023-11-19 10:55:51,820 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(855): Successfully loaded hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__vkl5lrnb8jrumee4n3uuahorq1huc1o59479og42m03j5cvij8890gr510ih35oc/family1/2cb04c9892e64cf39165c52beca66cca into 6cb2537056386ddfd53df16ae102ba42/family1 (new location: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/84ff2eeb88d24aa587df3225e596f6ed_SeqId_49_) 2023-11-19 10:55:51,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__vkl5lrnb8jrumee4n3uuahorq1huc1o59479og42m03j5cvij8890gr510ih35oc/family1/2cb04c9892e64cf39165c52beca66cca 2023-11-19 10:55:51,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-19 10:55:51,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 352581 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-19 10:55:51,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(1912): 6cb2537056386ddfd53df16ae102ba42/family1 is initiating minor compaction (all files) 2023-11-19 10:55:51,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@22aef907; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-19 10:55:51,821 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 6cb2537056386ddfd53df16ae102ba42/family1 in testMinorCompactionWithMonthlyPolicy,,1700391340487.6cb2537056386ddfd53df16ae102ba42. 2023-11-19 10:55:51,822 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/d687fa9f39594fa08924e38321abbe50, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/4b947c7597ef44cabaee8a64a6ab8c2f, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/3561e79437a24eeeac4265b5b2560383_SeqId_46_, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/84ff2eeb88d24aa587df3225e596f6ed_SeqId_49_] into tmpdir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/.tmp, totalSize=344.3 K 2023-11-19 10:55:51,822 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting d687fa9f39594fa08924e38321abbe50, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878825094 2023-11-19 10:55:51,822 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting 4b947c7597ef44cabaee8a64a6ab8c2f, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621225094 2023-11-19 10:55:51,823 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting 3561e79437a24eeeac4265b5b2560383_SeqId_46_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=47, earliestPutTs=1448965225094 2023-11-19 10:55:51,823 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] compactions.Compactor(207): Compacting 84ff2eeb88d24aa587df3225e596f6ed_SeqId_49_, keycount=1001, bloomtype=ROW, size=166.2 K, encoding=NONE, compression=NONE, seqNum=50, earliestPutTs=1448014825094 2023-11-19 10:55:51,823 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-19 10:55:51,823 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:55:51,825 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015112001b4427097d74e79863a703e09a35dd7 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015112001b4427097d74e79863a703e09a35dd7 2023-11-19 10:55:51,825 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128cdf3cfbcd69549aa97b2670e14c03146 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128cdf3cfbcd69549aa97b2670e14c03146 2023-11-19 10:55:51,826 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130a200c6debf504efc89ae95a4fda8ebd0 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130a200c6debf504efc89ae95a4fda8ebd0 2023-11-19 10:55:51,826 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-11-19 10:55:51,826 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-19 10:55:51,827 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-19 10:55:51,827 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-19 10:55:51,827 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-19 10:55:51,827 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-19 10:55:51,827 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-19 10:55:51,829 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=115, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-19 10:55:51,830 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=115, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 1.0640 sec 2023-11-19 10:55:51,842 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] throttle.PressureAwareThroughputController(145): 6cb2537056386ddfd53df16ae102ba42#family1#compaction#167 average throughput is 15.56 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-11-19 10:55:52,034 INFO [Listener at localhost/42675] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=267 (was 250) - Thread LEAK? -, OpenFileDescriptor=680 (was 659) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=162 (was 164), ProcessCount=174 (was 174), AvailableMemoryMB=15832 (was 15841) 2023-11-19 10:55:52,045 INFO [Listener at localhost/42675] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=267, OpenFileDescriptor=680, MaxFileDescriptor=60000, SystemLoadAverage=162, ProcessCount=174, AvailableMemoryMB=15831 2023-11-19 10:55:52,065 DEBUG [Listener at localhost/42675] crypto.Encryption(565): Installed org.apache.hadoop.hbase.io.crypto.KeyProviderForTesting into key provider cache 2023-11-19 10:55:52,118 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x90\xEC\xB2\x02\xA6\xED\xBC\x88\x81c\x87w\xF3I\xFD9"\x10=#\x19HK\x88\xDA\xEC3\xBF1\x83\xA4<'z*\x10 \x94\xF1\xB1/d\xB2X\x19B\xB3Vkl\xB5\x172\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-19 10:55:52,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] procedure2.ProcedureExecutor(1028): Stored pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionFromAdmin 2023-11-19 10:55:52,120 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_PRE_OPERATION 2023-11-19 10:55:52,121 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionFromAdmin" procId is: 116 2023-11-19 10:55:52,121 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-19 10:55:52,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-19 10:55:52,123 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb 2023-11-19 10:55:52,123 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983 2023-11-19 10:55:52,123 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7 2023-11-19 10:55:52,123 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb empty. 2023-11-19 10:55:52,123 DEBUG [HFileArchiver-21] backup.HFileArchiver(153): Directory hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983 empty. 2023-11-19 10:55:52,123 DEBUG [HFileArchiver-22] backup.HFileArchiver(153): Directory hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7 empty. 2023-11-19 10:55:52,124 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb 2023-11-19 10:55:52,124 DEBUG [HFileArchiver-21] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983 2023-11-19 10:55:52,124 DEBUG [HFileArchiver-22] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7 2023-11-19 10:55:52,124 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionFromAdmin regions 2023-11-19 10:55:52,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-19 10:55:52,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-19 10:55:52,531 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp/data/default/testMajorCompactionFromAdmin/.tabledesc/.tableinfo.0000000001 2023-11-19 10:55:52,532 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(7675): creating {ENCODED => 497f14d21350d42b3c82af489eba8bb7, NAME => 'testMajorCompactionFromAdmin,2,1700391352088.497f14d21350d42b3c82af489eba8bb7.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x90\xEC\xB2\x02\xA6\xED\xBC\x88\x81c\x87w\xF3I\xFD9"\x10=#\x19HK\x88\xDA\xEC3\xBF1\x83\xA4<'z*\x10 \x94\xF1\xB1/d\xB2X\x19B\xB3Vkl\xB5\x172\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp 2023-11-19 10:55:52,533 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(7675): creating {ENCODED => 4ce979cd3b1a8635c1e43f8856cd9983, NAME => 'testMajorCompactionFromAdmin,1,1700391352088.4ce979cd3b1a8635c1e43f8856cd9983.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x90\xEC\xB2\x02\xA6\xED\xBC\x88\x81c\x87w\xF3I\xFD9"\x10=#\x19HK\x88\xDA\xEC3\xBF1\x83\xA4<'z*\x10 \x94\xF1\xB1/d\xB2X\x19B\xB3Vkl\xB5\x172\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp 2023-11-19 10:55:52,533 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(7675): creating {ENCODED => 335e7ed4b507c72c2048400c591d5abb, NAME => 'testMajorCompactionFromAdmin,,1700391352088.335e7ed4b507c72c2048400c591d5abb.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x90\xEC\xB2\x02\xA6\xED\xBC\x88\x81c\x87w\xF3I\xFD9"\x10=#\x19HK\x88\xDA\xEC3\xBF1\x83\xA4<'z*\x10 \x94\xF1\xB1/d\xB2X\x19B\xB3Vkl\xB5\x172\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/.tmp 2023-11-19 10:55:52,541 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1700391352088.497f14d21350d42b3c82af489eba8bb7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-19 10:55:52,542 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1604): Closing 497f14d21350d42b3c82af489eba8bb7, disabling compactions & flushes 2023-11-19 10:55:52,542 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1700391352088.497f14d21350d42b3c82af489eba8bb7. 2023-11-19 10:55:52,542 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1700391352088.497f14d21350d42b3c82af489eba8bb7. 2023-11-19 10:55:52,542 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1700391352088.497f14d21350d42b3c82af489eba8bb7. after waiting 0 ms 2023-11-19 10:55:52,542 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1700391352088.497f14d21350d42b3c82af489eba8bb7. 2023-11-19 10:55:52,542 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1700391352088.497f14d21350d42b3c82af489eba8bb7. 2023-11-19 10:55:52,542 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1558): Region close journal for 497f14d21350d42b3c82af489eba8bb7: 2023-11-19 10:55:52,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-19 10:55:52,940 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1700391352088.4ce979cd3b1a8635c1e43f8856cd9983.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-19 10:55:52,940 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1700391352088.335e7ed4b507c72c2048400c591d5abb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-19 10:55:52,940 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1604): Closing 4ce979cd3b1a8635c1e43f8856cd9983, disabling compactions & flushes 2023-11-19 10:55:52,941 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1604): Closing 335e7ed4b507c72c2048400c591d5abb, disabling compactions & flushes 2023-11-19 10:55:52,941 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1700391352088.4ce979cd3b1a8635c1e43f8856cd9983. 2023-11-19 10:55:52,941 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1700391352088.4ce979cd3b1a8635c1e43f8856cd9983. 2023-11-19 10:55:52,941 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1700391352088.335e7ed4b507c72c2048400c591d5abb. 2023-11-19 10:55:52,941 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1700391352088.4ce979cd3b1a8635c1e43f8856cd9983. after waiting 0 ms 2023-11-19 10:55:52,941 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1700391352088.4ce979cd3b1a8635c1e43f8856cd9983. 2023-11-19 10:55:52,941 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1700391352088.335e7ed4b507c72c2048400c591d5abb. 2023-11-19 10:55:52,941 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1700391352088.4ce979cd3b1a8635c1e43f8856cd9983. 2023-11-19 10:55:52,941 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1558): Region close journal for 4ce979cd3b1a8635c1e43f8856cd9983: 2023-11-19 10:55:52,941 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1700391352088.335e7ed4b507c72c2048400c591d5abb. after waiting 0 ms 2023-11-19 10:55:52,941 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1700391352088.335e7ed4b507c72c2048400c591d5abb. 2023-11-19 10:55:52,941 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1700391352088.335e7ed4b507c72c2048400c591d5abb. 2023-11-19 10:55:52,941 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1558): Region close journal for 335e7ed4b507c72c2048400c591d5abb: 2023-11-19 10:55:52,943 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ADD_TO_META 2023-11-19 10:55:52,944 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,2,1700391352088.497f14d21350d42b3c82af489eba8bb7.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700391352944"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700391352944"}]},"ts":"1700391352944"} 2023-11-19 10:55:52,944 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,1,1700391352088.4ce979cd3b1a8635c1e43f8856cd9983.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1700391352944"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700391352944"}]},"ts":"1700391352944"} 2023-11-19 10:55:52,944 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,,1700391352088.335e7ed4b507c72c2048400c591d5abb.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700391352944"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700391352944"}]},"ts":"1700391352944"} 2023-11-19 10:55:52,946 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-19 10:55:52,946 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-19 10:55:52,946 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700391352946"}]},"ts":"1700391352946"} 2023-11-19 10:55:52,947 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLING in hbase:meta 2023-11-19 10:55:52,950 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=335e7ed4b507c72c2048400c591d5abb, ASSIGN}, {pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=4ce979cd3b1a8635c1e43f8856cd9983, ASSIGN}, {pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=497f14d21350d42b3c82af489eba8bb7, ASSIGN}] 2023-11-19 10:55:52,951 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=335e7ed4b507c72c2048400c591d5abb, ASSIGN 2023-11-19 10:55:52,951 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=497f14d21350d42b3c82af489eba8bb7, ASSIGN 2023-11-19 10:55:52,952 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=4ce979cd3b1a8635c1e43f8856cd9983, ASSIGN 2023-11-19 10:55:52,952 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=335e7ed4b507c72c2048400c591d5abb, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46035,1700391201579; forceNewPlan=false, retain=false 2023-11-19 10:55:52,952 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=497f14d21350d42b3c82af489eba8bb7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46035,1700391201579; forceNewPlan=false, retain=false 2023-11-19 10:55:52,952 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=4ce979cd3b1a8635c1e43f8856cd9983, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46035,1700391201579; forceNewPlan=false, retain=false 2023-11-19 10:55:53,075 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/.tmp/family1/a60dc6568ed14c50bcfe195a20b895bd as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/a60dc6568ed14c50bcfe195a20b895bd 2023-11-19 10:55:53,079 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 6cb2537056386ddfd53df16ae102ba42/family1 of 6cb2537056386ddfd53df16ae102ba42 into a60dc6568ed14c50bcfe195a20b895bd(size=167.4 K), total size for store is 167.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-19 10:55:53,079 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 6cb2537056386ddfd53df16ae102ba42: 2023-11-19 10:55:53,079 INFO [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1700391340487.6cb2537056386ddfd53df16ae102ba42., storeName=family1, fileCount=4, fileSize=344.3 K (166.0 K, 6.6 K, 5.5 K, 166.2 K), priority=2, time=1700391351821; duration=1sec 2023-11-19 10:55:53,079 DEBUG [RS:0;jenkins-hbase4:46035-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-19 10:55:53,104 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=4ce979cd3b1a8635c1e43f8856cd9983, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:53,104 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=335e7ed4b507c72c2048400c591d5abb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:53,104 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,1,1700391352088.4ce979cd3b1a8635c1e43f8856cd9983.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1700391353104"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700391353104"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700391353104"}]},"ts":"1700391353104"} 2023-11-19 10:55:53,104 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=497f14d21350d42b3c82af489eba8bb7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:53,104 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,,1700391352088.335e7ed4b507c72c2048400c591d5abb.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700391353104"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700391353104"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700391353104"}]},"ts":"1700391353104"} 2023-11-19 10:55:53,104 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,2,1700391352088.497f14d21350d42b3c82af489eba8bb7.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700391353104"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700391353104"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700391353104"}]},"ts":"1700391353104"} 2023-11-19 10:55:53,105 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=120, ppid=118, state=RUNNABLE; OpenRegionProcedure 4ce979cd3b1a8635c1e43f8856cd9983, server=jenkins-hbase4.apache.org,46035,1700391201579}] 2023-11-19 10:55:53,106 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=121, ppid=117, state=RUNNABLE; OpenRegionProcedure 335e7ed4b507c72c2048400c591d5abb, server=jenkins-hbase4.apache.org,46035,1700391201579}] 2023-11-19 10:55:53,106 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=122, ppid=119, state=RUNNABLE; OpenRegionProcedure 497f14d21350d42b3c82af489eba8bb7, server=jenkins-hbase4.apache.org,46035,1700391201579}] 2023-11-19 10:55:53,133 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/d687fa9f39594fa08924e38321abbe50, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/4b947c7597ef44cabaee8a64a6ab8c2f, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/3561e79437a24eeeac4265b5b2560383_SeqId_46_, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/84ff2eeb88d24aa587df3225e596f6ed_SeqId_49_] to archive 2023-11-19 10:55:53,134 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:55:53,136 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/d687fa9f39594fa08924e38321abbe50 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/d687fa9f39594fa08924e38321abbe50 2023-11-19 10:55:53,137 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/4b947c7597ef44cabaee8a64a6ab8c2f to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/4b947c7597ef44cabaee8a64a6ab8c2f 2023-11-19 10:55:53,139 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/3561e79437a24eeeac4265b5b2560383_SeqId_46_ to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/3561e79437a24eeeac4265b5b2560383_SeqId_46_ 2023-11-19 10:55:53,140 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/84ff2eeb88d24aa587df3225e596f6ed_SeqId_49_ to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/family1/84ff2eeb88d24aa587df3225e596f6ed_SeqId_49_ 2023-11-19 10:55:53,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-19 10:55:53,257 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:53,259 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,,1700391352088.335e7ed4b507c72c2048400c591d5abb. 2023-11-19 10:55:53,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 335e7ed4b507c72c2048400c591d5abb, NAME => 'testMajorCompactionFromAdmin,,1700391352088.335e7ed4b507c72c2048400c591d5abb.', STARTKEY => '', ENDKEY => '1'} 2023-11-19 10:55:53,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 335e7ed4b507c72c2048400c591d5abb 2023-11-19 10:55:53,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1700391352088.335e7ed4b507c72c2048400c591d5abb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-19 10:55:53,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 335e7ed4b507c72c2048400c591d5abb 2023-11-19 10:55:53,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 335e7ed4b507c72c2048400c591d5abb 2023-11-19 10:55:53,281 INFO [StoreOpener-335e7ed4b507c72c2048400c591d5abb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 335e7ed4b507c72c2048400c591d5abb 2023-11-19 10:55:53,282 DEBUG [StoreOpener-335e7ed4b507c72c2048400c591d5abb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/family1 2023-11-19 10:55:53,282 DEBUG [StoreOpener-335e7ed4b507c72c2048400c591d5abb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/family1 2023-11-19 10:55:53,282 INFO [StoreOpener-335e7ed4b507c72c2048400c591d5abb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 335e7ed4b507c72c2048400c591d5abb columnFamilyName family1 2023-11-19 10:55:53,283 INFO [StoreOpener-335e7ed4b507c72c2048400c591d5abb-1] regionserver.HStore(310): Store=335e7ed4b507c72c2048400c591d5abb/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-19 10:55:53,283 INFO [StoreOpener-335e7ed4b507c72c2048400c591d5abb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 335e7ed4b507c72c2048400c591d5abb 2023-11-19 10:55:53,284 DEBUG [StoreOpener-335e7ed4b507c72c2048400c591d5abb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/family2 2023-11-19 10:55:53,285 DEBUG [StoreOpener-335e7ed4b507c72c2048400c591d5abb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/family2 2023-11-19 10:55:53,285 INFO [StoreOpener-335e7ed4b507c72c2048400c591d5abb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 335e7ed4b507c72c2048400c591d5abb columnFamilyName family2 2023-11-19 10:55:53,286 INFO [StoreOpener-335e7ed4b507c72c2048400c591d5abb-1] regionserver.HStore(310): Store=335e7ed4b507c72c2048400c591d5abb/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-19 10:55:53,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb 2023-11-19 10:55:53,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb 2023-11-19 10:55:53,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-19 10:55:53,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 335e7ed4b507c72c2048400c591d5abb 2023-11-19 10:55:53,290 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-19 10:55:53,290 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 335e7ed4b507c72c2048400c591d5abb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60512050, jitterRate=-0.09830018877983093}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-19 10:55:53,290 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 335e7ed4b507c72c2048400c591d5abb: 2023-11-19 10:55:53,291 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,,1700391352088.335e7ed4b507c72c2048400c591d5abb., pid=121, masterSystemTime=1700391353257 2023-11-19 10:55:53,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,,1700391352088.335e7ed4b507c72c2048400c591d5abb. 2023-11-19 10:55:53,292 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,,1700391352088.335e7ed4b507c72c2048400c591d5abb. 2023-11-19 10:55:53,292 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,1,1700391352088.4ce979cd3b1a8635c1e43f8856cd9983. 2023-11-19 10:55:53,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4ce979cd3b1a8635c1e43f8856cd9983, NAME => 'testMajorCompactionFromAdmin,1,1700391352088.4ce979cd3b1a8635c1e43f8856cd9983.', STARTKEY => '1', ENDKEY => '2'} 2023-11-19 10:55:53,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 4ce979cd3b1a8635c1e43f8856cd9983 2023-11-19 10:55:53,292 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=335e7ed4b507c72c2048400c591d5abb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:53,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1700391352088.4ce979cd3b1a8635c1e43f8856cd9983.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-19 10:55:53,293 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4ce979cd3b1a8635c1e43f8856cd9983 2023-11-19 10:55:53,293 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,,1700391352088.335e7ed4b507c72c2048400c591d5abb.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700391353292"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700391353292"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700391353292"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700391353292"}]},"ts":"1700391353292"} 2023-11-19 10:55:53,293 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4ce979cd3b1a8635c1e43f8856cd9983 2023-11-19 10:55:53,295 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=121, resume processing ppid=117 2023-11-19 10:55:53,295 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=121, ppid=117, state=SUCCESS; OpenRegionProcedure 335e7ed4b507c72c2048400c591d5abb, server=jenkins-hbase4.apache.org,46035,1700391201579 in 188 msec 2023-11-19 10:55:53,296 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=335e7ed4b507c72c2048400c591d5abb, ASSIGN in 345 msec 2023-11-19 10:55:53,313 INFO [StoreOpener-4ce979cd3b1a8635c1e43f8856cd9983-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 4ce979cd3b1a8635c1e43f8856cd9983 2023-11-19 10:55:53,314 DEBUG [StoreOpener-4ce979cd3b1a8635c1e43f8856cd9983-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/family1 2023-11-19 10:55:53,314 DEBUG [StoreOpener-4ce979cd3b1a8635c1e43f8856cd9983-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/family1 2023-11-19 10:55:53,314 INFO [StoreOpener-4ce979cd3b1a8635c1e43f8856cd9983-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4ce979cd3b1a8635c1e43f8856cd9983 columnFamilyName family1 2023-11-19 10:55:53,315 INFO [StoreOpener-4ce979cd3b1a8635c1e43f8856cd9983-1] regionserver.HStore(310): Store=4ce979cd3b1a8635c1e43f8856cd9983/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-19 10:55:53,315 INFO [StoreOpener-4ce979cd3b1a8635c1e43f8856cd9983-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 4ce979cd3b1a8635c1e43f8856cd9983 2023-11-19 10:55:53,316 DEBUG [StoreOpener-4ce979cd3b1a8635c1e43f8856cd9983-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/family2 2023-11-19 10:55:53,316 DEBUG [StoreOpener-4ce979cd3b1a8635c1e43f8856cd9983-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/family2 2023-11-19 10:55:53,316 INFO [StoreOpener-4ce979cd3b1a8635c1e43f8856cd9983-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4ce979cd3b1a8635c1e43f8856cd9983 columnFamilyName family2 2023-11-19 10:55:53,317 INFO [StoreOpener-4ce979cd3b1a8635c1e43f8856cd9983-1] regionserver.HStore(310): Store=4ce979cd3b1a8635c1e43f8856cd9983/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-19 10:55:53,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983 2023-11-19 10:55:53,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983 2023-11-19 10:55:53,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-19 10:55:53,320 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4ce979cd3b1a8635c1e43f8856cd9983 2023-11-19 10:55:53,321 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-19 10:55:53,321 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4ce979cd3b1a8635c1e43f8856cd9983; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68931977, jitterRate=0.027166500687599182}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-19 10:55:53,321 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4ce979cd3b1a8635c1e43f8856cd9983: 2023-11-19 10:55:53,322 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,1,1700391352088.4ce979cd3b1a8635c1e43f8856cd9983., pid=120, masterSystemTime=1700391353257 2023-11-19 10:55:53,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,1,1700391352088.4ce979cd3b1a8635c1e43f8856cd9983. 2023-11-19 10:55:53,323 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,1,1700391352088.4ce979cd3b1a8635c1e43f8856cd9983. 2023-11-19 10:55:53,323 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,2,1700391352088.497f14d21350d42b3c82af489eba8bb7. 2023-11-19 10:55:53,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 497f14d21350d42b3c82af489eba8bb7, NAME => 'testMajorCompactionFromAdmin,2,1700391352088.497f14d21350d42b3c82af489eba8bb7.', STARTKEY => '2', ENDKEY => ''} 2023-11-19 10:55:53,323 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=4ce979cd3b1a8635c1e43f8856cd9983, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:53,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 497f14d21350d42b3c82af489eba8bb7 2023-11-19 10:55:53,323 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,1,1700391352088.4ce979cd3b1a8635c1e43f8856cd9983.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1700391353323"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700391353323"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700391353323"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700391353323"}]},"ts":"1700391353323"} 2023-11-19 10:55:53,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1700391352088.497f14d21350d42b3c82af489eba8bb7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-19 10:55:53,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 497f14d21350d42b3c82af489eba8bb7 2023-11-19 10:55:53,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 497f14d21350d42b3c82af489eba8bb7 2023-11-19 10:55:53,326 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=120, resume processing ppid=118 2023-11-19 10:55:53,326 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=120, ppid=118, state=SUCCESS; OpenRegionProcedure 4ce979cd3b1a8635c1e43f8856cd9983, server=jenkins-hbase4.apache.org,46035,1700391201579 in 220 msec 2023-11-19 10:55:53,326 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=4ce979cd3b1a8635c1e43f8856cd9983, ASSIGN in 376 msec 2023-11-19 10:55:53,343 INFO [StoreOpener-497f14d21350d42b3c82af489eba8bb7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 497f14d21350d42b3c82af489eba8bb7 2023-11-19 10:55:53,344 DEBUG [StoreOpener-497f14d21350d42b3c82af489eba8bb7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/family1 2023-11-19 10:55:53,344 DEBUG [StoreOpener-497f14d21350d42b3c82af489eba8bb7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/family1 2023-11-19 10:55:53,345 INFO [StoreOpener-497f14d21350d42b3c82af489eba8bb7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 497f14d21350d42b3c82af489eba8bb7 columnFamilyName family1 2023-11-19 10:55:53,345 INFO [StoreOpener-497f14d21350d42b3c82af489eba8bb7-1] regionserver.HStore(310): Store=497f14d21350d42b3c82af489eba8bb7/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-19 10:55:53,345 INFO [StoreOpener-497f14d21350d42b3c82af489eba8bb7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 497f14d21350d42b3c82af489eba8bb7 2023-11-19 10:55:53,346 DEBUG [StoreOpener-497f14d21350d42b3c82af489eba8bb7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/family2 2023-11-19 10:55:53,346 DEBUG [StoreOpener-497f14d21350d42b3c82af489eba8bb7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/family2 2023-11-19 10:55:53,347 INFO [StoreOpener-497f14d21350d42b3c82af489eba8bb7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 497f14d21350d42b3c82af489eba8bb7 columnFamilyName family2 2023-11-19 10:55:53,347 INFO [StoreOpener-497f14d21350d42b3c82af489eba8bb7-1] regionserver.HStore(310): Store=497f14d21350d42b3c82af489eba8bb7/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-19 10:55:53,348 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7 2023-11-19 10:55:53,348 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7 2023-11-19 10:55:53,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-19 10:55:53,350 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 497f14d21350d42b3c82af489eba8bb7 2023-11-19 10:55:53,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-19 10:55:53,351 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 497f14d21350d42b3c82af489eba8bb7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63076628, jitterRate=-0.0600849986076355}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-19 10:55:53,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 497f14d21350d42b3c82af489eba8bb7: 2023-11-19 10:55:53,352 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,2,1700391352088.497f14d21350d42b3c82af489eba8bb7., pid=122, masterSystemTime=1700391353257 2023-11-19 10:55:53,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,2,1700391352088.497f14d21350d42b3c82af489eba8bb7. 2023-11-19 10:55:53,353 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,2,1700391352088.497f14d21350d42b3c82af489eba8bb7. 2023-11-19 10:55:53,353 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=497f14d21350d42b3c82af489eba8bb7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:53,354 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,2,1700391352088.497f14d21350d42b3c82af489eba8bb7.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700391353353"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700391353353"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700391353353"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700391353353"}]},"ts":"1700391353353"} 2023-11-19 10:55:53,355 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=122, resume processing ppid=119 2023-11-19 10:55:53,355 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=122, ppid=119, state=SUCCESS; OpenRegionProcedure 497f14d21350d42b3c82af489eba8bb7, server=jenkins-hbase4.apache.org,46035,1700391201579 in 249 msec 2023-11-19 10:55:53,356 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=119, resume processing ppid=116 2023-11-19 10:55:53,356 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=119, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=497f14d21350d42b3c82af489eba8bb7, ASSIGN in 405 msec 2023-11-19 10:55:53,357 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-19 10:55:53,357 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700391353357"}]},"ts":"1700391353357"} 2023-11-19 10:55:53,358 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLED in hbase:meta 2023-11-19 10:55:53,360 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_POST_OPERATION 2023-11-19 10:55:53,360 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=116, state=SUCCESS; CreateTableProcedure table=testMajorCompactionFromAdmin in 1.2420 sec 2023-11-19 10:55:53,717 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionFromAdmin' 2023-11-19 10:55:54,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-19 10:55:54,226 INFO [Listener at localhost/42675] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionFromAdmin, procId: 116 completed 2023-11-19 10:55:54,231 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1700391352088.335e7ed4b507c72c2048400c591d5abb. with WAL disabled. Data may be lost in the event of a crash. 2023-11-19 10:55:54,232 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1700391352088.4ce979cd3b1a8635c1e43f8856cd9983. with WAL disabled. Data may be lost in the event of a crash. 2023-11-19 10:55:54,232 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1700391352088.497f14d21350d42b3c82af489eba8bb7. with WAL disabled. Data may be lost in the event of a crash. 2023-11-19 10:55:54,234 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:55:54,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-19 10:55:54,237 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-19 10:55:54,237 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:55:54,237 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-19 10:55:54,237 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-19 10:55:54,238 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-19 10:55:54,238 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-19 10:55:54,240 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:54,240 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:55:54,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:55:54,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:55:54,240 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:54,240 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:55:54,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-19 10:55:54,240 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-19 10:55:54,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:55:54,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-19 10:55:54,241 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-19 10:55:54,241 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-19 10:55:54,241 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-19 10:55:54,241 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:55:54,241 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-19 10:55:54,241 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1700391352088.4ce979cd3b1a8635c1e43f8856cd9983. 2023-11-19 10:55:54,241 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1700391352088.4ce979cd3b1a8635c1e43f8856cd9983. started... 2023-11-19 10:55:54,241 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-19 10:55:54,241 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1700391352088.497f14d21350d42b3c82af489eba8bb7. 2023-11-19 10:55:54,242 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4ce979cd3b1a8635c1e43f8856cd9983 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-19 10:55:54,242 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1700391352088.497f14d21350d42b3c82af489eba8bb7. started... 2023-11-19 10:55:54,241 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1700391352088.335e7ed4b507c72c2048400c591d5abb. 2023-11-19 10:55:54,241 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:55:54,242 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1700391352088.335e7ed4b507c72c2048400c591d5abb. started... 2023-11-19 10:55:54,243 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 497f14d21350d42b3c82af489eba8bb7 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-19 10:55:54,243 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 335e7ed4b507c72c2048400c591d5abb 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-19 10:55:54,289 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231119438be611588343f2ba2ab1118dea29d2 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231119438be611588343f2ba2ab1118dea29d2 2023-11-19 10:55:54,686 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231119e30dbb3881af4287b7dcd5b1a1a6d9b6 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231119e30dbb3881af4287b7dcd5b1a1a6d9b6 2023-11-19 10:55:54,688 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231119651cd53fff214860a9d1c3368d94ca10 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231119651cd53fff214860a9d1c3368d94ca10 2023-11-19 10:55:54,703 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/.tmp/family1/c13a044ec7f94b9ab20f7ed5fe40f2cf 2023-11-19 10:55:54,704 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/.tmp/family1/02943bd2e4614fd99c69c73632520adf 2023-11-19 10:55:55,101 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/.tmp/family1/f7c6f6dd3c1b4157976d54093cb3cd67 2023-11-19 10:55:55,136 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231119856310d8bf9e43f690fd2d36ed3686b3 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20231119856310d8bf9e43f690fd2d36ed3686b3 2023-11-19 10:55:55,139 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/.tmp/family2/ce40b4d8de4a45a3bebf556998b032e6 2023-11-19 10:55:55,143 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/.tmp/family1/c13a044ec7f94b9ab20f7ed5fe40f2cf as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/family1/c13a044ec7f94b9ab20f7ed5fe40f2cf 2023-11-19 10:55:55,152 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231119bb08615cb2a3454781468457d8f9aba2 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20231119bb08615cb2a3454781468457d8f9aba2 2023-11-19 10:55:55,156 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/.tmp/family2/a78ea115b57b41cb8edbae336fe75c6d 2023-11-19 10:55:55,159 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/.tmp/family1/02943bd2e4614fd99c69c73632520adf as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/family1/02943bd2e4614fd99c69c73632520adf 2023-11-19 10:55:55,179 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/family1/c13a044ec7f94b9ab20f7ed5fe40f2cf, entries=4, sequenceid=5, filesize=5.5 K 2023-11-19 10:55:55,179 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/.tmp/family2/ce40b4d8de4a45a3bebf556998b032e6 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/family2/ce40b4d8de4a45a3bebf556998b032e6 2023-11-19 10:55:55,181 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/family1/02943bd2e4614fd99c69c73632520adf, entries=4, sequenceid=5, filesize=5.5 K 2023-11-19 10:55:55,181 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/.tmp/family2/a78ea115b57b41cb8edbae336fe75c6d as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/family2/a78ea115b57b41cb8edbae336fe75c6d 2023-11-19 10:55:55,183 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/family2/ce40b4d8de4a45a3bebf556998b032e6, entries=2, sequenceid=5, filesize=5.1 K 2023-11-19 10:55:55,184 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 335e7ed4b507c72c2048400c591d5abb in 941ms, sequenceid=5, compaction requested=false 2023-11-19 10:55:55,184 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 335e7ed4b507c72c2048400c591d5abb: 2023-11-19 10:55:55,184 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1700391352088.335e7ed4b507c72c2048400c591d5abb. 2023-11-19 10:55:55,185 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-19 10:55:55,185 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/family2/a78ea115b57b41cb8edbae336fe75c6d, entries=2, sequenceid=5, filesize=5.1 K 2023-11-19 10:55:55,186 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 4ce979cd3b1a8635c1e43f8856cd9983 in 944ms, sequenceid=5, compaction requested=false 2023-11-19 10:55:55,186 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4ce979cd3b1a8635c1e43f8856cd9983: 2023-11-19 10:55:55,186 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1700391352088.4ce979cd3b1a8635c1e43f8856cd9983. 2023-11-19 10:55:55,186 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-19 10:55:55,535 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231119fd34f8a2e5a54b58b008a571aa3aee34 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20231119fd34f8a2e5a54b58b008a571aa3aee34 2023-11-19 10:55:55,940 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/.tmp/family2/36b3354077b645c8994ac3c2183de3af 2023-11-19 10:55:55,944 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/.tmp/family1/f7c6f6dd3c1b4157976d54093cb3cd67 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/family1/f7c6f6dd3c1b4157976d54093cb3cd67 2023-11-19 10:55:55,976 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/family1/f7c6f6dd3c1b4157976d54093cb3cd67, entries=4, sequenceid=5, filesize=5.5 K 2023-11-19 10:55:55,977 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/.tmp/family2/36b3354077b645c8994ac3c2183de3af as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/family2/36b3354077b645c8994ac3c2183de3af 2023-11-19 10:55:55,980 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/family2/36b3354077b645c8994ac3c2183de3af, entries=2, sequenceid=5, filesize=5.1 K 2023-11-19 10:55:55,981 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 497f14d21350d42b3c82af489eba8bb7 in 1738ms, sequenceid=5, compaction requested=false 2023-11-19 10:55:55,981 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 497f14d21350d42b3c82af489eba8bb7: 2023-11-19 10:55:55,981 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1700391352088.497f14d21350d42b3c82af489eba8bb7. 2023-11-19 10:55:55,982 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-19 10:55:55,982 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-19 10:55:55,982 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:55,982 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-19 10:55:55,982 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-19 10:55:55,983 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-19 10:55:55,983 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:55,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:55,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:55,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:55:55,983 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-19 10:55:55,984 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:55:55,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:55,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:55,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-19 10:55:55,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:55,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:55,985 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-19 10:55:55,985 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1ff909f5[Count = 0] remaining members to acquire global barrier 2023-11-19 10:55:55,985 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-19 10:55:55,985 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-19 10:55:55,986 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-19 10:55:55,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-19 10:55:55,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-19 10:55:55,986 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-19 10:55:55,987 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-19 10:55:55,987 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:55,987 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:55:55,987 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:55:55,988 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-19 10:55:55,988 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:55,988 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:55:55,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:55,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:55,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:55:55,988 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-19 10:55:55,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:55,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:55,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-19 10:55:55,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:55,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:55,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-19 10:55:55,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:55,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:55:55,990 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-19 10:55:55,990 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-19 10:55:55,990 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:55:55,990 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:55:55,991 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-19 10:55:55,991 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:55:55,996 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-19 10:55:55,996 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-19 10:55:55,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-19 10:55:55,996 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-19 10:55:55,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:55,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:55:55,996 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:55:55,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-19 10:55:55,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:55,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:55:55,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:55:55,997 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:55,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-19 10:55:55,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-19 10:55:55,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:55,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-19 10:55:55,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:55,998 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:55,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:55,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-19 10:55:55,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:56,000 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:56,000 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:55:56,000 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-19 10:55:56,000 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-19 10:55:56,000 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:55:56,000 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-19 10:55:56,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:55:56,000 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:55:56,000 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:55:56,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:55:56,001 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-19 10:55:56,001 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:56,001 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:55:56,001 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-19 10:55:56,001 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-19 10:55:56,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:55:56,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:55:56,001 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-19 10:55:56,101 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:55:56,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:55:56,103 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1700391352088.335e7ed4b507c72c2048400c591d5abb. with WAL disabled. Data may be lost in the event of a crash. 2023-11-19 10:55:56,103 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1700391352088.4ce979cd3b1a8635c1e43f8856cd9983. with WAL disabled. Data may be lost in the event of a crash. 2023-11-19 10:55:56,103 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1700391352088.497f14d21350d42b3c82af489eba8bb7. with WAL disabled. Data may be lost in the event of a crash. 2023-11-19 10:55:56,105 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:55:56,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-19 10:55:56,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-19 10:55:56,107 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-19 10:55:56,107 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:55:56,107 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-19 10:55:56,107 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-19 10:55:56,107 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-19 10:55:56,107 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-19 10:55:56,108 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:56,108 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:55:56,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:55:56,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:55:56,109 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:56,109 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:55:56,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-19 10:55:56,109 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-19 10:55:56,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:55:56,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-19 10:55:56,110 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-19 10:55:56,110 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-19 10:55:56,110 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-19 10:55:56,110 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-19 10:55:56,110 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:55:56,110 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-19 10:55:56,110 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1700391352088.4ce979cd3b1a8635c1e43f8856cd9983. 2023-11-19 10:55:56,110 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-19 10:55:56,110 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1700391352088.497f14d21350d42b3c82af489eba8bb7. 2023-11-19 10:55:56,110 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1700391352088.335e7ed4b507c72c2048400c591d5abb. 2023-11-19 10:55:56,110 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1700391352088.497f14d21350d42b3c82af489eba8bb7. started... 2023-11-19 10:55:56,110 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:55:56,110 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1700391352088.4ce979cd3b1a8635c1e43f8856cd9983. started... 2023-11-19 10:55:56,110 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1700391352088.335e7ed4b507c72c2048400c591d5abb. started... 2023-11-19 10:55:56,110 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 497f14d21350d42b3c82af489eba8bb7 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-19 10:55:56,110 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 335e7ed4b507c72c2048400c591d5abb 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-19 10:55:56,110 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4ce979cd3b1a8635c1e43f8856cd9983 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-19 10:55:56,162 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023111921189f7f09cb44d98bad12b62565b3a6 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023111921189f7f09cb44d98bad12b62565b3a6 2023-11-19 10:55:56,163 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311194229e3b742844f9d90cb3d56d1f589ad to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311194229e3b742844f9d90cb3d56d1f589ad 2023-11-19 10:55:56,170 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231119d6301b549b8a4945bfd172501bc96ea5 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231119d6301b549b8a4945bfd172501bc96ea5 2023-11-19 10:55:56,189 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/.tmp/family1/62f7665130294eb5aa30e9e49beceb07 2023-11-19 10:55:56,191 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/.tmp/family1/cb9baa127a974b96aa466d4add63f512 2023-11-19 10:55:56,193 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/.tmp/family1/2349856351ce49e5b4564870063a0dcd 2023-11-19 10:55:56,249 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311193e51aaa83386400e8035d1112cb56a66 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202311193e51aaa83386400e8035d1112cb56a66 2023-11-19 10:55:56,255 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/.tmp/family2/77b76d328ed24fd38b12502f9171050d 2023-11-19 10:55:56,258 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/.tmp/family1/62f7665130294eb5aa30e9e49beceb07 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/family1/62f7665130294eb5aa30e9e49beceb07 2023-11-19 10:55:56,281 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/family1/62f7665130294eb5aa30e9e49beceb07, entries=4, sequenceid=9, filesize=5.5 K 2023-11-19 10:55:56,282 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/.tmp/family2/77b76d328ed24fd38b12502f9171050d as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/family2/77b76d328ed24fd38b12502f9171050d 2023-11-19 10:55:56,285 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/family2/77b76d328ed24fd38b12502f9171050d, entries=2, sequenceid=9, filesize=5.1 K 2023-11-19 10:55:56,286 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 497f14d21350d42b3c82af489eba8bb7 in 176ms, sequenceid=9, compaction requested=false 2023-11-19 10:55:56,286 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 497f14d21350d42b3c82af489eba8bb7: 2023-11-19 10:55:56,286 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1700391352088.497f14d21350d42b3c82af489eba8bb7. 2023-11-19 10:55:56,286 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-19 10:55:56,649 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231119f72c344585c742eeab08f0419d9f2954 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20231119f72c344585c742eeab08f0419d9f2954 2023-11-19 10:55:56,649 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023111943795d4d45a64a02ac65c8473b8b3a9a to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e2023111943795d4d45a64a02ac65c8473b8b3a9a 2023-11-19 10:55:57,053 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/.tmp/family2/c35b08e8c67b406386cd46dae300bb55 2023-11-19 10:55:57,053 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/.tmp/family2/c742c02875d34eed828b59c977879078 2023-11-19 10:55:57,057 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/.tmp/family1/cb9baa127a974b96aa466d4add63f512 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/family1/cb9baa127a974b96aa466d4add63f512 2023-11-19 10:55:57,057 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/.tmp/family1/2349856351ce49e5b4564870063a0dcd as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/family1/2349856351ce49e5b4564870063a0dcd 2023-11-19 10:55:57,081 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/family1/2349856351ce49e5b4564870063a0dcd, entries=4, sequenceid=9, filesize=5.5 K 2023-11-19 10:55:57,081 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/family1/cb9baa127a974b96aa466d4add63f512, entries=4, sequenceid=9, filesize=5.5 K 2023-11-19 10:55:57,081 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/.tmp/family2/c35b08e8c67b406386cd46dae300bb55 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/family2/c35b08e8c67b406386cd46dae300bb55 2023-11-19 10:55:57,081 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/.tmp/family2/c742c02875d34eed828b59c977879078 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/family2/c742c02875d34eed828b59c977879078 2023-11-19 10:55:57,084 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/family2/c35b08e8c67b406386cd46dae300bb55, entries=2, sequenceid=9, filesize=5.1 K 2023-11-19 10:55:57,085 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/family2/c742c02875d34eed828b59c977879078, entries=2, sequenceid=9, filesize=5.1 K 2023-11-19 10:55:57,085 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 335e7ed4b507c72c2048400c591d5abb in 975ms, sequenceid=9, compaction requested=false 2023-11-19 10:55:57,085 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 4ce979cd3b1a8635c1e43f8856cd9983 in 975ms, sequenceid=9, compaction requested=false 2023-11-19 10:55:57,085 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 335e7ed4b507c72c2048400c591d5abb: 2023-11-19 10:55:57,085 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4ce979cd3b1a8635c1e43f8856cd9983: 2023-11-19 10:55:57,085 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1700391352088.335e7ed4b507c72c2048400c591d5abb. 2023-11-19 10:55:57,085 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1700391352088.4ce979cd3b1a8635c1e43f8856cd9983. 2023-11-19 10:55:57,085 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-19 10:55:57,085 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-19 10:55:57,085 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-19 10:55:57,085 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:57,085 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-19 10:55:57,086 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-19 10:55:57,088 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:57,088 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-19 10:55:57,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:57,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:57,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:55:57,088 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-19 10:55:57,088 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:55:57,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:57,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:57,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-19 10:55:57,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:57,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:57,090 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-19 10:55:57,090 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@61740093[Count = 0] remaining members to acquire global barrier 2023-11-19 10:55:57,090 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-19 10:55:57,090 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-19 10:55:57,091 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-19 10:55:57,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-19 10:55:57,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-19 10:55:57,091 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-19 10:55:57,091 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-19 10:55:57,091 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:55:57,091 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:57,091 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:55:57,092 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:57,092 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-19 10:55:57,092 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:55:57,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:57,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:57,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:55:57,092 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-19 10:55:57,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:57,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:57,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-19 10:55:57,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:57,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:57,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-19 10:55:57,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:57,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:55:57,095 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-19 10:55:57,095 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-19 10:55:57,095 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:55:57,095 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:55:57,095 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-19 10:55:57,095 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:55:57,096 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-19 10:55:57,096 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-19 10:55:57,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-19 10:55:57,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-19 10:55:57,096 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:55:57,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-19 10:55:57,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:57,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:55:57,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:55:57,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:55:57,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:57,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-19 10:55:57,097 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:57,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-19 10:55:57,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:57,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-19 10:55:57,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:57,099 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:57,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:57,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-19 10:55:57,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:57,101 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:57,101 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-19 10:55:57,101 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-19 10:55:57,101 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:57,101 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-19 10:55:57,102 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-19 10:55:57,101 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:55:57,101 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:55:57,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:55:57,102 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:55:57,102 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-19 10:55:57,102 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:55:57,102 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-11-19 10:55:57,102 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-19 10:55:57,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:55:57,102 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-19 10:55:57,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:55:57,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:55:57,102 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:55:57,202 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:55:57,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:55:57,205 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1700391352088.335e7ed4b507c72c2048400c591d5abb. with WAL disabled. Data may be lost in the event of a crash. 2023-11-19 10:55:57,205 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1700391352088.4ce979cd3b1a8635c1e43f8856cd9983. with WAL disabled. Data may be lost in the event of a crash. 2023-11-19 10:55:57,205 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1700391352088.497f14d21350d42b3c82af489eba8bb7. with WAL disabled. Data may be lost in the event of a crash. 2023-11-19 10:55:57,207 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:55:57,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-19 10:55:57,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-19 10:55:57,209 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-19 10:55:57,209 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:55:57,209 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-19 10:55:57,209 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-19 10:55:57,210 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-19 10:55:57,210 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-19 10:55:57,212 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:55:57,212 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:57,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:55:57,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:55:57,212 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:57,212 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:55:57,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-19 10:55:57,213 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-19 10:55:57,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:55:57,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-19 10:55:57,213 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-19 10:55:57,214 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-19 10:55:57,214 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-19 10:55:57,214 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-19 10:55:57,214 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:55:57,214 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-19 10:55:57,214 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1700391352088.4ce979cd3b1a8635c1e43f8856cd9983. 2023-11-19 10:55:57,214 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1700391352088.4ce979cd3b1a8635c1e43f8856cd9983. started... 2023-11-19 10:55:57,214 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-19 10:55:57,214 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1700391352088.497f14d21350d42b3c82af489eba8bb7. 2023-11-19 10:55:57,214 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4ce979cd3b1a8635c1e43f8856cd9983 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-19 10:55:57,214 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1700391352088.497f14d21350d42b3c82af489eba8bb7. started... 2023-11-19 10:55:57,214 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1700391352088.335e7ed4b507c72c2048400c591d5abb. 2023-11-19 10:55:57,214 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:55:57,214 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1700391352088.335e7ed4b507c72c2048400c591d5abb. started... 2023-11-19 10:55:57,214 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 497f14d21350d42b3c82af489eba8bb7 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-19 10:55:57,215 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 335e7ed4b507c72c2048400c591d5abb 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-19 10:55:57,279 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311198748950a0d53439e9b56f10076f6bd93 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311198748950a0d53439e9b56f10076f6bd93 2023-11-19 10:55:57,285 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311192dd5358c633b49aeac98b9fa3ff633ac to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311192dd5358c633b49aeac98b9fa3ff633ac 2023-11-19 10:55:57,295 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/.tmp/family1/4ab2642e69a945fa935b1e9d49e5b3e4 2023-11-19 10:55:57,305 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/.tmp/family1/e068c2167cc34d299750104ba57a4887 2023-11-19 10:55:57,333 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311196b690ae370db47ccbb0e6b2a5f0e2701 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202311196b690ae370db47ccbb0e6b2a5f0e2701 2023-11-19 10:55:57,355 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231119305f421a18b1460999b0a1d4716e43ac to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20231119305f421a18b1460999b0a1d4716e43ac 2023-11-19 10:55:57,667 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231119a9fd50cc1a4c462c9e41b439bc385a0f to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231119a9fd50cc1a4c462c9e41b439bc385a0f 2023-11-19 10:55:57,742 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/.tmp/family2/6a4cebcf9b144258bd3dcd7811954931 2023-11-19 10:55:57,746 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/.tmp/family1/4ab2642e69a945fa935b1e9d49e5b3e4 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/family1/4ab2642e69a945fa935b1e9d49e5b3e4 2023-11-19 10:55:57,760 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/.tmp/family2/2ef28b1fa7464dfb9f73b239289b5d76 2023-11-19 10:55:57,764 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/.tmp/family1/e068c2167cc34d299750104ba57a4887 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/family1/e068c2167cc34d299750104ba57a4887 2023-11-19 10:55:57,769 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/family1/4ab2642e69a945fa935b1e9d49e5b3e4, entries=4, sequenceid=13, filesize=5.5 K 2023-11-19 10:55:57,769 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/.tmp/family2/6a4cebcf9b144258bd3dcd7811954931 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/family2/6a4cebcf9b144258bd3dcd7811954931 2023-11-19 10:55:57,772 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/family2/6a4cebcf9b144258bd3dcd7811954931, entries=2, sequenceid=13, filesize=5.1 K 2023-11-19 10:55:57,773 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 335e7ed4b507c72c2048400c591d5abb in 558ms, sequenceid=13, compaction requested=true 2023-11-19 10:55:57,773 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 335e7ed4b507c72c2048400c591d5abb: 2023-11-19 10:55:57,773 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1700391352088.335e7ed4b507c72c2048400c591d5abb. 2023-11-19 10:55:57,773 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-19 10:55:57,785 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/family1/e068c2167cc34d299750104ba57a4887, entries=4, sequenceid=13, filesize=5.5 K 2023-11-19 10:55:57,786 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/.tmp/family2/2ef28b1fa7464dfb9f73b239289b5d76 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/family2/2ef28b1fa7464dfb9f73b239289b5d76 2023-11-19 10:55:57,789 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/family2/2ef28b1fa7464dfb9f73b239289b5d76, entries=2, sequenceid=13, filesize=5.1 K 2023-11-19 10:55:57,790 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 497f14d21350d42b3c82af489eba8bb7 in 576ms, sequenceid=13, compaction requested=true 2023-11-19 10:55:57,790 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 497f14d21350d42b3c82af489eba8bb7: 2023-11-19 10:55:57,790 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1700391352088.497f14d21350d42b3c82af489eba8bb7. 2023-11-19 10:55:57,790 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-19 10:55:58,083 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/.tmp/family1/713bab5165754c4ab93c000e7102739e 2023-11-19 10:55:58,114 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023111985fcd013e51749339f7e50abe88a381f to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b2023111985fcd013e51749339f7e50abe88a381f 2023-11-19 10:55:58,313 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-19 10:55:58,314 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x16844807 to 127.0.0.1:60497 2023-11-19 10:55:58,314 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-19 10:55:58,314 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-19 10:55:58,314 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2b98f7c4 to 127.0.0.1:60497 2023-11-19 10:55:58,314 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-19 10:55:58,519 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/.tmp/family2/64d9d898a4d44b9b93c2d913d419ab53 2023-11-19 10:55:58,523 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/.tmp/family1/713bab5165754c4ab93c000e7102739e as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/family1/713bab5165754c4ab93c000e7102739e 2023-11-19 10:55:58,546 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/family1/713bab5165754c4ab93c000e7102739e, entries=4, sequenceid=13, filesize=5.5 K 2023-11-19 10:55:58,546 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/.tmp/family2/64d9d898a4d44b9b93c2d913d419ab53 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/family2/64d9d898a4d44b9b93c2d913d419ab53 2023-11-19 10:55:58,550 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/family2/64d9d898a4d44b9b93c2d913d419ab53, entries=2, sequenceid=13, filesize=5.1 K 2023-11-19 10:55:58,550 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 4ce979cd3b1a8635c1e43f8856cd9983 in 1336ms, sequenceid=13, compaction requested=true 2023-11-19 10:55:58,550 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4ce979cd3b1a8635c1e43f8856cd9983: 2023-11-19 10:55:58,551 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1700391352088.4ce979cd3b1a8635c1e43f8856cd9983. 2023-11-19 10:55:58,551 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-19 10:55:58,551 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-19 10:55:58,551 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:58,551 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-19 10:55:58,551 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-19 10:55:58,554 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:58,554 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-19 10:55:58,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:58,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:58,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:55:58,554 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-19 10:55:58,554 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:55:58,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:58,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:58,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-19 10:55:58,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:58,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:58,556 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-19 10:55:58,556 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4333a73a[Count = 0] remaining members to acquire global barrier 2023-11-19 10:55:58,556 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-19 10:55:58,556 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-19 10:55:58,557 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-19 10:55:58,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-19 10:55:58,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-19 10:55:58,557 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:58,557 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:55:58,557 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-19 10:55:58,557 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-19 10:55:58,558 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:55:58,559 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-19 10:55:58,559 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:58,559 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:55:58,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:58,559 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-19 10:55:58,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:58,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:55:58,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:58,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:58,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-19 10:55:58,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:58,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:58,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-19 10:55:58,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:58,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:55:58,561 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-19 10:55:58,561 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-19 10:55:58,561 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:55:58,561 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:55:58,561 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-19 10:55:58,561 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:55:58,563 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-19 10:55:58,563 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-19 10:55:58,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-19 10:55:58,563 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:55:58,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-19 10:55:58,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-19 10:55:58,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:55:58,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:55:58,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:55:58,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:55:58,564 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:58,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:55:58,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-19 10:55:58,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-19 10:55:58,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:55:58,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-19 10:55:58,565 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:58,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:58,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:55:58,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-19 10:55:58,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:58,568 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:58,568 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:55:58,568 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-19 10:55:58,568 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-19 10:55:58,568 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:58,568 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-19 10:55:58,568 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:55:58,568 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-19 10:55:58,568 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:55:58,568 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:55:58,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:55:58,568 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-11-19 10:55:58,568 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:55:58,568 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-19 10:55:58,568 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-19 10:55:58,568 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-19 10:55:58,568 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:55:58,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:55:58,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:55:58,669 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:55:58,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:55:58,670 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1700391352088.335e7ed4b507c72c2048400c591d5abb. with WAL disabled. Data may be lost in the event of a crash. 2023-11-19 10:55:58,671 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1700391352088.4ce979cd3b1a8635c1e43f8856cd9983. with WAL disabled. Data may be lost in the event of a crash. 2023-11-19 10:55:58,671 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1700391352088.497f14d21350d42b3c82af489eba8bb7. with WAL disabled. Data may be lost in the event of a crash. 2023-11-19 10:55:58,673 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:55:58,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-19 10:55:58,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-19 10:55:58,674 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-19 10:55:58,674 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:55:58,674 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-19 10:55:58,675 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-19 10:55:58,675 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-19 10:55:58,675 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-19 10:55:58,676 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:55:58,676 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:58,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:55:58,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:55:58,677 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:55:58,677 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:55:58,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-19 10:55:58,677 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-19 10:55:58,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:55:58,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-19 10:55:58,677 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-19 10:55:58,678 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-19 10:55:58,678 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-19 10:55:58,678 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-19 10:55:58,678 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:55:58,678 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-19 10:55:58,678 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1700391352088.4ce979cd3b1a8635c1e43f8856cd9983. 2023-11-19 10:55:58,678 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-19 10:55:58,678 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1700391352088.497f14d21350d42b3c82af489eba8bb7. 2023-11-19 10:55:58,678 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1700391352088.335e7ed4b507c72c2048400c591d5abb. 2023-11-19 10:55:58,678 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:55:58,678 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1700391352088.4ce979cd3b1a8635c1e43f8856cd9983. started... 2023-11-19 10:55:58,678 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1700391352088.335e7ed4b507c72c2048400c591d5abb. started... 2023-11-19 10:55:58,678 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1700391352088.497f14d21350d42b3c82af489eba8bb7. started... 2023-11-19 10:55:58,678 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4ce979cd3b1a8635c1e43f8856cd9983 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-19 10:55:58,678 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 497f14d21350d42b3c82af489eba8bb7 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-19 10:55:58,678 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 335e7ed4b507c72c2048400c591d5abb 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-19 10:55:58,724 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231119618107003ed5488c9b6a8a5c2d60b7c2 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231119618107003ed5488c9b6a8a5c2d60b7c2 2023-11-19 10:55:58,737 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/.tmp/family1/72b485cdddd44578a14685b7aff63d4f 2023-11-19 10:55:58,766 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231119e598763c645d4932b79ead4bdb1a770f to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20231119e598763c645d4932b79ead4bdb1a770f 2023-11-19 10:55:58,770 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/.tmp/family2/4d0ae1508ea149c5bd83ddc72a894b26 2023-11-19 10:55:58,773 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/.tmp/family1/72b485cdddd44578a14685b7aff63d4f as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/family1/72b485cdddd44578a14685b7aff63d4f 2023-11-19 10:55:58,796 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/family1/72b485cdddd44578a14685b7aff63d4f, entries=4, sequenceid=17, filesize=5.5 K 2023-11-19 10:55:58,797 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/.tmp/family2/4d0ae1508ea149c5bd83ddc72a894b26 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/family2/4d0ae1508ea149c5bd83ddc72a894b26 2023-11-19 10:55:58,800 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/family2/4d0ae1508ea149c5bd83ddc72a894b26, entries=2, sequenceid=17, filesize=5.1 K 2023-11-19 10:55:58,801 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 335e7ed4b507c72c2048400c591d5abb in 123ms, sequenceid=17, compaction requested=true 2023-11-19 10:55:58,801 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 335e7ed4b507c72c2048400c591d5abb: 2023-11-19 10:55:58,801 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1700391352088.335e7ed4b507c72c2048400c591d5abb. 2023-11-19 10:55:58,801 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-19 10:55:58,822 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-19 10:55:59,119 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023111953a03608ece8482daeedf8145798337d to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023111953a03608ece8482daeedf8145798337d 2023-11-19 10:55:59,128 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231119a6c90e84d5d0420097cbddb616ebf84c to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231119a6c90e84d5d0420097cbddb616ebf84c 2023-11-19 10:55:59,533 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/.tmp/family1/bd062114706c49bd91efcd46fa44bfea 2023-11-19 10:55:59,542 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/.tmp/family1/b9fab8e58feb4aa2b41591cf815f878c 2023-11-19 10:55:59,579 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311199f54d9895e4a4cc99770edd5b4a42219 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202311199f54d9895e4a4cc99770edd5b4a42219 2023-11-19 10:55:59,983 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023111990b53091d50d4e2496aa87f04ec8af50 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b2023111990b53091d50d4e2496aa87f04ec8af50 2023-11-19 10:55:59,990 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/.tmp/family2/0b72f42dc41b4f538ab9c0de311ec7c4 2023-11-19 10:55:59,993 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/.tmp/family1/b9fab8e58feb4aa2b41591cf815f878c as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/family1/b9fab8e58feb4aa2b41591cf815f878c 2023-11-19 10:56:00,016 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/family1/b9fab8e58feb4aa2b41591cf815f878c, entries=4, sequenceid=17, filesize=5.5 K 2023-11-19 10:56:00,017 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/.tmp/family2/0b72f42dc41b4f538ab9c0de311ec7c4 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/family2/0b72f42dc41b4f538ab9c0de311ec7c4 2023-11-19 10:56:00,020 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/family2/0b72f42dc41b4f538ab9c0de311ec7c4, entries=2, sequenceid=17, filesize=5.1 K 2023-11-19 10:56:00,021 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 497f14d21350d42b3c82af489eba8bb7 in 1343ms, sequenceid=17, compaction requested=true 2023-11-19 10:56:00,021 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 497f14d21350d42b3c82af489eba8bb7: 2023-11-19 10:56:00,021 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1700391352088.497f14d21350d42b3c82af489eba8bb7. 2023-11-19 10:56:00,021 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-19 10:56:00,388 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/.tmp/family2/b03db06687034b2cadf26d438b4a1ff8 2023-11-19 10:56:00,391 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/.tmp/family1/bd062114706c49bd91efcd46fa44bfea as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/family1/bd062114706c49bd91efcd46fa44bfea 2023-11-19 10:56:00,414 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/family1/bd062114706c49bd91efcd46fa44bfea, entries=4, sequenceid=17, filesize=5.5 K 2023-11-19 10:56:00,414 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/.tmp/family2/b03db06687034b2cadf26d438b4a1ff8 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/family2/b03db06687034b2cadf26d438b4a1ff8 2023-11-19 10:56:00,418 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/family2/b03db06687034b2cadf26d438b4a1ff8, entries=2, sequenceid=17, filesize=5.1 K 2023-11-19 10:56:00,418 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 4ce979cd3b1a8635c1e43f8856cd9983 in 1740ms, sequenceid=17, compaction requested=true 2023-11-19 10:56:00,419 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4ce979cd3b1a8635c1e43f8856cd9983: 2023-11-19 10:56:00,419 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1700391352088.4ce979cd3b1a8635c1e43f8856cd9983. 2023-11-19 10:56:00,419 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-19 10:56:00,419 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-19 10:56:00,419 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:56:00,419 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-19 10:56:00,419 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-19 10:56:00,420 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:56:00,420 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-19 10:56:00,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:56:00,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:56:00,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:56:00,421 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-19 10:56:00,421 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:56:00,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:56:00,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:56:00,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-19 10:56:00,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:56:00,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:56:00,422 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-19 10:56:00,422 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@22c72902[Count = 0] remaining members to acquire global barrier 2023-11-19 10:56:00,422 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-19 10:56:00,422 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-19 10:56:00,427 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-19 10:56:00,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-19 10:56:00,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-19 10:56:00,427 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-19 10:56:00,427 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:56:00,427 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:56:00,427 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-19 10:56:00,427 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:56:00,428 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:56:00,428 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-19 10:56:00,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:56:00,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:56:00,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:56:00,428 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:56:00,428 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-19 10:56:00,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:56:00,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:56:00,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-19 10:56:00,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:56:00,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:56:00,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-19 10:56:00,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:56:00,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:56:00,430 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-19 10:56:00,430 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-19 10:56:00,431 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:56:00,431 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:56:00,431 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-19 10:56:00,431 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:56:00,432 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-19 10:56:00,432 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-19 10:56:00,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-19 10:56:00,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-19 10:56:00,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:56:00,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:56:00,432 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:56:00,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-19 10:56:00,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:56:00,433 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:56:00,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:56:00,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:56:00,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-19 10:56:00,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-19 10:56:00,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:56:00,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-19 10:56:00,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:56:00,434 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:56:00,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:56:00,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-19 10:56:00,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:56:00,437 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:56:00,437 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:56:00,437 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-19 10:56:00,437 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:56:00,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:56:00,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:56:00,437 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:56:00,437 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-19 10:56:00,437 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:56:00,437 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-19 10:56:00,437 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:56:00,437 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-19 10:56:00,437 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-19 10:56:00,437 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-19 10:56:00,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:56:00,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:56:00,437 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-19 10:56:00,437 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:56:00,538 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:56:00,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:56:00,546 DEBUG [Listener at localhost/42675] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-19 10:56:00,552 DEBUG [Listener at localhost/42675] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-19 10:56:00,561 DEBUG [Listener at localhost/42675] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-19 10:56:00,562 DEBUG [Listener at localhost/42675] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-19 10:56:00,642 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-19 10:56:00,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-19 10:56:00,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-19 10:56:00,644 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-19 10:56:00,644 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:56:00,644 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-19 10:56:00,644 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-19 10:56:00,644 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-19 10:56:00,644 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-19 10:56:00,645 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:56:00,645 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:56:00,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:56:00,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:56:00,646 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:56:00,646 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-19 10:56:00,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-19 10:56:00,646 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-19 10:56:00,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-19 10:56:00,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-19 10:56:00,646 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-19 10:56:00,647 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-19 10:56:00,647 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-19 10:56:00,647 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-19 10:56:00,647 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-19 10:56:00,647 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-19 10:56:00,647 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1700391352088.4ce979cd3b1a8635c1e43f8856cd9983. 2023-11-19 10:56:00,647 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1700391352088.4ce979cd3b1a8635c1e43f8856cd9983. started... 2023-11-19 10:56:00,647 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1700391352088.497f14d21350d42b3c82af489eba8bb7. 2023-11-19 10:56:00,647 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-19 10:56:00,647 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-19 10:56:00,647 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4ce979cd3b1a8635c1e43f8856cd9983 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-19 10:56:00,647 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1700391352088.335e7ed4b507c72c2048400c591d5abb. 2023-11-19 10:56:00,647 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1700391352088.497f14d21350d42b3c82af489eba8bb7. started... 2023-11-19 10:56:00,647 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1700391352088.335e7ed4b507c72c2048400c591d5abb. started... 2023-11-19 10:56:00,647 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 497f14d21350d42b3c82af489eba8bb7 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-19 10:56:00,647 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 335e7ed4b507c72c2048400c591d5abb 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-19 10:56:00,688 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/.tmp/family1/d3a2378afe4c4274b6e5958d48914328 2023-11-19 10:56:00,695 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/.tmp/family1/fd165170c7944884a929afd1d255446c 2023-11-19 10:56:00,695 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/.tmp/family1/94d45646b937494ab6b43105e2f9db8f 2023-11-19 10:56:00,717 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fd165170c7944884a929afd1d255446c 2023-11-19 10:56:00,717 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d3a2378afe4c4274b6e5958d48914328 2023-11-19 10:56:00,720 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 94d45646b937494ab6b43105e2f9db8f 2023-11-19 10:56:00,735 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/.tmp/family2/14aa913000ae4745a7dfc47616f37c19 2023-11-19 10:56:00,735 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/.tmp/family2/db5420d5fc114bf0bc3df1aed32dbec0 2023-11-19 10:56:00,738 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 14aa913000ae4745a7dfc47616f37c19 2023-11-19 10:56:00,738 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for db5420d5fc114bf0bc3df1aed32dbec0 2023-11-19 10:56:00,738 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/.tmp/family1/94d45646b937494ab6b43105e2f9db8f as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/family1/94d45646b937494ab6b43105e2f9db8f 2023-11-19 10:56:00,739 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/.tmp/family1/fd165170c7944884a929afd1d255446c as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/family1/fd165170c7944884a929afd1d255446c 2023-11-19 10:56:00,762 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 94d45646b937494ab6b43105e2f9db8f 2023-11-19 10:56:00,762 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fd165170c7944884a929afd1d255446c 2023-11-19 10:56:00,762 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/family1/94d45646b937494ab6b43105e2f9db8f, entries=3, sequenceid=23, filesize=5.2 K 2023-11-19 10:56:00,762 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/family1/fd165170c7944884a929afd1d255446c, entries=3, sequenceid=23, filesize=5.2 K 2023-11-19 10:56:00,762 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/.tmp/family2/14aa913000ae4745a7dfc47616f37c19 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/family2/14aa913000ae4745a7dfc47616f37c19 2023-11-19 10:56:00,763 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/.tmp/family2/db5420d5fc114bf0bc3df1aed32dbec0 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/family2/db5420d5fc114bf0bc3df1aed32dbec0 2023-11-19 10:56:00,765 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 14aa913000ae4745a7dfc47616f37c19 2023-11-19 10:56:00,766 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/family2/14aa913000ae4745a7dfc47616f37c19, entries=1, sequenceid=23, filesize=5.0 K 2023-11-19 10:56:00,766 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for db5420d5fc114bf0bc3df1aed32dbec0 2023-11-19 10:56:00,766 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/family2/db5420d5fc114bf0bc3df1aed32dbec0, entries=1, sequenceid=23, filesize=5.0 K 2023-11-19 10:56:00,766 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 4ce979cd3b1a8635c1e43f8856cd9983 in 119ms, sequenceid=23, compaction requested=true 2023-11-19 10:56:00,766 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4ce979cd3b1a8635c1e43f8856cd9983: 2023-11-19 10:56:00,766 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1700391352088.4ce979cd3b1a8635c1e43f8856cd9983. 2023-11-19 10:56:00,766 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 497f14d21350d42b3c82af489eba8bb7 in 119ms, sequenceid=23, compaction requested=true 2023-11-19 10:56:00,766 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-19 10:56:00,767 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 497f14d21350d42b3c82af489eba8bb7: 2023-11-19 10:56:00,767 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1700391352088.497f14d21350d42b3c82af489eba8bb7. 2023-11-19 10:56:00,767 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-19 10:56:01,136 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/.tmp/family2/6d12e80199d64d71846e12fcde0d0723 2023-11-19 10:56:01,139 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6d12e80199d64d71846e12fcde0d0723 2023-11-19 10:56:01,140 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/.tmp/family1/d3a2378afe4c4274b6e5958d48914328 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/family1/d3a2378afe4c4274b6e5958d48914328 2023-11-19 10:56:01,162 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d3a2378afe4c4274b6e5958d48914328 2023-11-19 10:56:01,162 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/family1/d3a2378afe4c4274b6e5958d48914328, entries=3, sequenceid=23, filesize=5.2 K 2023-11-19 10:56:01,163 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/.tmp/family2/6d12e80199d64d71846e12fcde0d0723 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/family2/6d12e80199d64d71846e12fcde0d0723 2023-11-19 10:56:01,166 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6d12e80199d64d71846e12fcde0d0723 2023-11-19 10:56:01,166 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/family2/6d12e80199d64d71846e12fcde0d0723, entries=1, sequenceid=23, filesize=5.0 K 2023-11-19 10:56:01,167 INFO [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 335e7ed4b507c72c2048400c591d5abb in 520ms, sequenceid=23, compaction requested=true 2023-11-19 10:56:01,167 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 335e7ed4b507c72c2048400c591d5abb: 2023-11-19 10:56:01,167 DEBUG [rs(jenkins-hbase4.apache.org,46035,1700391201579)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1700391352088.335e7ed4b507c72c2048400c591d5abb. 2023-11-19 10:56:01,167 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-19 10:56:01,167 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-19 10:56:01,167 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:56:01,167 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-19 10:56:01,167 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-19 10:56:01,170 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-19 10:56:01,170 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:56:01,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:56:01,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:56:01,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:56:01,171 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-19 10:56:01,171 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-19 10:56:01,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:56:01,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:56:01,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-19 10:56:01,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:56:01,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:56:01,173 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46035,1700391201579' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-19 10:56:01,173 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@75a63a0e[Count = 0] remaining members to acquire global barrier 2023-11-19 10:56:01,173 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-19 10:56:01,173 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-19 10:56:01,174 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-19 10:56:01,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-19 10:56:01,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-19 10:56:01,174 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-19 10:56:01,174 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-19 10:56:01,174 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,46035,1700391201579' in zk 2023-11-19 10:56:01,174 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:56:01,174 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-19 10:56:01,176 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-19 10:56:01,176 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:56:01,176 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:56:01,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:56:01,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:56:01,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:56:01,176 DEBUG [member: 'jenkins-hbase4.apache.org,46035,1700391201579' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-19 10:56:01,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:56:01,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:56:01,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-19 10:56:01,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:56:01,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:56:01,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-19 10:56:01,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:56:01,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,46035,1700391201579': 2023-11-19 10:56:01,178 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46035,1700391201579' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-19 10:56:01,178 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-19 10:56:01,179 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-19 10:56:01,179 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-19 10:56:01,179 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-19 10:56:01,179 INFO [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-19 10:56:01,180 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-19 10:56:01,180 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-19 10:56:01,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-19 10:56:01,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-19 10:56:01,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-19 10:56:01,180 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-19 10:56:01,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-19 10:56:01,180 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:56:01,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-19 10:56:01,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:56:01,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:56:01,181 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:56:01,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-19 10:56:01,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-19 10:56:01,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-19 10:56:01,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-19 10:56:01,182 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:56:01,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:56:01,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-19 10:56:01,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-19 10:56:01,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:56:01,185 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:56:01,185 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-19 10:56:01,185 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-19 10:56:01,185 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:56:01,185 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-19 10:56:01,185 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-19 10:56:01,185 DEBUG [(jenkins-hbase4.apache.org,33457,1700391200382)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-19 10:56:01,185 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-19 10:56:01,185 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-19 10:56:01,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-19 10:56:01,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-19 10:56:01,185 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-19 10:56:01,185 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-19 10:56:01,185 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-19 10:56:01,186 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-19 10:56:01,186 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-11-19 10:56:01,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-19 10:56:01,186 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-19 10:56:01,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-19 10:56:01,286 DEBUG [Listener at localhost/42675] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-19 10:56:01,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33457] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-19 10:56:01,287 DEBUG [Listener at localhost/42675] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-19 10:56:01,287 DEBUG [Listener at localhost/42675] regionserver.HStore(1912): 4ce979cd3b1a8635c1e43f8856cd9983/family1 is initiating major compaction (all files) 2023-11-19 10:56:01,287 INFO [Listener at localhost/42675] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-19 10:56:01,287 INFO [Listener at localhost/42675] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-19 10:56:01,288 INFO [Listener at localhost/42675] regionserver.HRegion(2259): Starting compaction of 4ce979cd3b1a8635c1e43f8856cd9983/family1 in testMajorCompactionFromAdmin,1,1700391352088.4ce979cd3b1a8635c1e43f8856cd9983. 2023-11-19 10:56:01,288 INFO [Listener at localhost/42675] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/family1/02943bd2e4614fd99c69c73632520adf, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/family1/cb9baa127a974b96aa466d4add63f512, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/family1/713bab5165754c4ab93c000e7102739e, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/family1/bd062114706c49bd91efcd46fa44bfea, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/family1/94d45646b937494ab6b43105e2f9db8f] into tmpdir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/.tmp, totalSize=27.1 K 2023-11-19 10:56:01,288 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting 02943bd2e4614fd99c69c73632520adf, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700391354232 2023-11-19 10:56:01,289 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting cb9baa127a974b96aa466d4add63f512, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700391356103 2023-11-19 10:56:01,289 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting 713bab5165754c4ab93c000e7102739e, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700391357205 2023-11-19 10:56:01,289 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting bd062114706c49bd91efcd46fa44bfea, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700391358671 2023-11-19 10:56:01,290 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting 94d45646b937494ab6b43105e2f9db8f, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-19 10:56:01,297 INFO [Listener at localhost/42675] throttle.PressureAwareThroughputController(145): 4ce979cd3b1a8635c1e43f8856cd9983#family1#compaction#198 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-19 10:56:01,734 INFO [Listener at localhost/42675] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202311199131b0952e424d75af0608eabcc8f45a_del 2023-11-19 10:56:01,734 INFO [Listener at localhost/42675] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311199131b0952e424d75af0608eabcc8f45a_del to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311199131b0952e424d75af0608eabcc8f45a_del 2023-11-19 10:56:02,586 INFO [Listener at localhost/42675] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5e4f4cf88558481eb6089dda9c7e0b5a 2023-11-19 10:56:02,586 DEBUG [Listener at localhost/42675] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/.tmp/family1/5e4f4cf88558481eb6089dda9c7e0b5a as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/family1/5e4f4cf88558481eb6089dda9c7e0b5a 2023-11-19 10:56:02,619 INFO [Listener at localhost/42675] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5e4f4cf88558481eb6089dda9c7e0b5a 2023-11-19 10:56:02,620 INFO [Listener at localhost/42675] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 4ce979cd3b1a8635c1e43f8856cd9983/family1 of 4ce979cd3b1a8635c1e43f8856cd9983 into 5e4f4cf88558481eb6089dda9c7e0b5a(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-19 10:56:02,620 DEBUG [Listener at localhost/42675] regionserver.HRegion(2289): Compaction status journal for 4ce979cd3b1a8635c1e43f8856cd9983: 2023-11-19 10:56:02,621 DEBUG [Listener at localhost/42675] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-19 10:56:02,621 DEBUG [Listener at localhost/42675] regionserver.HStore(1912): 4ce979cd3b1a8635c1e43f8856cd9983/family2 is initiating major compaction (all files) 2023-11-19 10:56:02,621 INFO [Listener at localhost/42675] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-19 10:56:02,621 INFO [Listener at localhost/42675] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-19 10:56:02,621 INFO [Listener at localhost/42675] regionserver.HRegion(2259): Starting compaction of 4ce979cd3b1a8635c1e43f8856cd9983/family2 in testMajorCompactionFromAdmin,1,1700391352088.4ce979cd3b1a8635c1e43f8856cd9983. 2023-11-19 10:56:02,621 INFO [Listener at localhost/42675] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/family2/a78ea115b57b41cb8edbae336fe75c6d, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/family2/c742c02875d34eed828b59c977879078, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/family2/64d9d898a4d44b9b93c2d913d419ab53, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/family2/b03db06687034b2cadf26d438b4a1ff8, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/family2/14aa913000ae4745a7dfc47616f37c19] into tmpdir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/.tmp, totalSize=25.4 K 2023-11-19 10:56:02,622 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting a78ea115b57b41cb8edbae336fe75c6d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700391354232 2023-11-19 10:56:02,622 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting c742c02875d34eed828b59c977879078, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700391356103 2023-11-19 10:56:02,622 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting 64d9d898a4d44b9b93c2d913d419ab53, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700391357205 2023-11-19 10:56:02,623 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting b03db06687034b2cadf26d438b4a1ff8, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700391358671 2023-11-19 10:56:02,623 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting 14aa913000ae4745a7dfc47616f37c19, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-19 10:56:02,627 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/family1/02943bd2e4614fd99c69c73632520adf, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/family1/cb9baa127a974b96aa466d4add63f512, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/family1/713bab5165754c4ab93c000e7102739e, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/family1/bd062114706c49bd91efcd46fa44bfea, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/family1/94d45646b937494ab6b43105e2f9db8f] to archive 2023-11-19 10:56:02,627 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:56:02,629 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/family1/02943bd2e4614fd99c69c73632520adf to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/family1/02943bd2e4614fd99c69c73632520adf 2023-11-19 10:56:02,630 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/family1/cb9baa127a974b96aa466d4add63f512 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/family1/cb9baa127a974b96aa466d4add63f512 2023-11-19 10:56:02,631 INFO [Listener at localhost/42675] throttle.PressureAwareThroughputController(145): 4ce979cd3b1a8635c1e43f8856cd9983#family2#compaction#199 average throughput is 0.35 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-19 10:56:02,631 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/family1/713bab5165754c4ab93c000e7102739e to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/family1/713bab5165754c4ab93c000e7102739e 2023-11-19 10:56:02,632 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/family1/bd062114706c49bd91efcd46fa44bfea to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/family1/bd062114706c49bd91efcd46fa44bfea 2023-11-19 10:56:02,633 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/family1/94d45646b937494ab6b43105e2f9db8f to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/family1/94d45646b937494ab6b43105e2f9db8f 2023-11-19 10:56:02,637 INFO [Listener at localhost/42675] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202311197156142d59ed45cb964cb5edbb56787f_del 2023-11-19 10:56:02,637 INFO [Listener at localhost/42675] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311197156142d59ed45cb964cb5edbb56787f_del to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202311197156142d59ed45cb964cb5edbb56787f_del 2023-11-19 10:56:03,449 INFO [Listener at localhost/42675] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 224fd24796dd4cf0add7968c6a3636c9 2023-11-19 10:56:03,450 DEBUG [Listener at localhost/42675] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/.tmp/family2/224fd24796dd4cf0add7968c6a3636c9 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/family2/224fd24796dd4cf0add7968c6a3636c9 2023-11-19 10:56:03,453 INFO [Listener at localhost/42675] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 224fd24796dd4cf0add7968c6a3636c9 2023-11-19 10:56:03,454 INFO [Listener at localhost/42675] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 4ce979cd3b1a8635c1e43f8856cd9983/family2 of 4ce979cd3b1a8635c1e43f8856cd9983 into 224fd24796dd4cf0add7968c6a3636c9(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-19 10:56:03,454 DEBUG [Listener at localhost/42675] regionserver.HRegion(2289): Compaction status journal for 4ce979cd3b1a8635c1e43f8856cd9983: 2023-11-19 10:56:03,454 DEBUG [Listener at localhost/42675] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-19 10:56:03,454 DEBUG [Listener at localhost/42675] regionserver.HStore(1912): 497f14d21350d42b3c82af489eba8bb7/family1 is initiating major compaction (all files) 2023-11-19 10:56:03,455 INFO [Listener at localhost/42675] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-19 10:56:03,455 INFO [Listener at localhost/42675] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-19 10:56:03,455 INFO [Listener at localhost/42675] regionserver.HRegion(2259): Starting compaction of 497f14d21350d42b3c82af489eba8bb7/family1 in testMajorCompactionFromAdmin,2,1700391352088.497f14d21350d42b3c82af489eba8bb7. 2023-11-19 10:56:03,455 INFO [Listener at localhost/42675] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/family1/f7c6f6dd3c1b4157976d54093cb3cd67, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/family1/62f7665130294eb5aa30e9e49beceb07, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/family1/e068c2167cc34d299750104ba57a4887, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/family1/b9fab8e58feb4aa2b41591cf815f878c, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/family1/fd165170c7944884a929afd1d255446c] into tmpdir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/.tmp, totalSize=27.1 K 2023-11-19 10:56:03,455 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting f7c6f6dd3c1b4157976d54093cb3cd67, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700391354232 2023-11-19 10:56:03,456 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting 62f7665130294eb5aa30e9e49beceb07, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700391356103 2023-11-19 10:56:03,456 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting e068c2167cc34d299750104ba57a4887, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700391357205 2023-11-19 10:56:03,456 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting b9fab8e58feb4aa2b41591cf815f878c, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700391358671 2023-11-19 10:56:03,456 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting fd165170c7944884a929afd1d255446c, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-19 10:56:03,464 INFO [Listener at localhost/42675] throttle.PressureAwareThroughputController(145): 497f14d21350d42b3c82af489eba8bb7#family1#compaction#200 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-19 10:56:03,501 INFO [Listener at localhost/42675] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231119c9a6a116999e4800aaa7bd6afae2ce4d_del 2023-11-19 10:56:03,501 INFO [Listener at localhost/42675] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231119c9a6a116999e4800aaa7bd6afae2ce4d_del to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231119c9a6a116999e4800aaa7bd6afae2ce4d_del 2023-11-19 10:56:03,531 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/family2/a78ea115b57b41cb8edbae336fe75c6d, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/family2/c742c02875d34eed828b59c977879078, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/family2/64d9d898a4d44b9b93c2d913d419ab53, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/family2/b03db06687034b2cadf26d438b4a1ff8, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/family2/14aa913000ae4745a7dfc47616f37c19] to archive 2023-11-19 10:56:03,532 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:56:03,533 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/family2/a78ea115b57b41cb8edbae336fe75c6d to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/family2/a78ea115b57b41cb8edbae336fe75c6d 2023-11-19 10:56:03,534 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/family2/c742c02875d34eed828b59c977879078 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/family2/c742c02875d34eed828b59c977879078 2023-11-19 10:56:03,535 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/family2/64d9d898a4d44b9b93c2d913d419ab53 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/family2/64d9d898a4d44b9b93c2d913d419ab53 2023-11-19 10:56:03,536 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/family2/b03db06687034b2cadf26d438b4a1ff8 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/family2/b03db06687034b2cadf26d438b4a1ff8 2023-11-19 10:56:03,537 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/family2/14aa913000ae4745a7dfc47616f37c19 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/family2/14aa913000ae4745a7dfc47616f37c19 2023-11-19 10:56:04,362 INFO [Listener at localhost/42675] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 421255cdbe324fab872c5a337262f744 2023-11-19 10:56:04,363 DEBUG [Listener at localhost/42675] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/.tmp/family1/421255cdbe324fab872c5a337262f744 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/family1/421255cdbe324fab872c5a337262f744 2023-11-19 10:56:04,385 INFO [Listener at localhost/42675] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 421255cdbe324fab872c5a337262f744 2023-11-19 10:56:04,386 INFO [Listener at localhost/42675] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 497f14d21350d42b3c82af489eba8bb7/family1 of 497f14d21350d42b3c82af489eba8bb7 into 421255cdbe324fab872c5a337262f744(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-19 10:56:04,386 DEBUG [Listener at localhost/42675] regionserver.HRegion(2289): Compaction status journal for 497f14d21350d42b3c82af489eba8bb7: 2023-11-19 10:56:04,387 DEBUG [Listener at localhost/42675] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-19 10:56:04,387 DEBUG [Listener at localhost/42675] regionserver.HStore(1912): 497f14d21350d42b3c82af489eba8bb7/family2 is initiating major compaction (all files) 2023-11-19 10:56:04,387 INFO [Listener at localhost/42675] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-19 10:56:04,387 INFO [Listener at localhost/42675] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-19 10:56:04,388 INFO [Listener at localhost/42675] regionserver.HRegion(2259): Starting compaction of 497f14d21350d42b3c82af489eba8bb7/family2 in testMajorCompactionFromAdmin,2,1700391352088.497f14d21350d42b3c82af489eba8bb7. 2023-11-19 10:56:04,388 INFO [Listener at localhost/42675] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/family2/36b3354077b645c8994ac3c2183de3af, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/family2/77b76d328ed24fd38b12502f9171050d, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/family2/2ef28b1fa7464dfb9f73b239289b5d76, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/family2/0b72f42dc41b4f538ab9c0de311ec7c4, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/family2/db5420d5fc114bf0bc3df1aed32dbec0] into tmpdir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/.tmp, totalSize=25.4 K 2023-11-19 10:56:04,389 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting 36b3354077b645c8994ac3c2183de3af, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700391354232 2023-11-19 10:56:04,389 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting 77b76d328ed24fd38b12502f9171050d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700391356103 2023-11-19 10:56:04,390 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting 2ef28b1fa7464dfb9f73b239289b5d76, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700391357205 2023-11-19 10:56:04,390 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting 0b72f42dc41b4f538ab9c0de311ec7c4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700391358671 2023-11-19 10:56:04,390 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting db5420d5fc114bf0bc3df1aed32dbec0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-19 10:56:04,398 INFO [Listener at localhost/42675] throttle.PressureAwareThroughputController(145): 497f14d21350d42b3c82af489eba8bb7#family2#compaction#201 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-19 10:56:04,427 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/family1/f7c6f6dd3c1b4157976d54093cb3cd67, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/family1/62f7665130294eb5aa30e9e49beceb07, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/family1/e068c2167cc34d299750104ba57a4887, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/family1/b9fab8e58feb4aa2b41591cf815f878c, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/family1/fd165170c7944884a929afd1d255446c] to archive 2023-11-19 10:56:04,428 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:56:04,429 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/family1/f7c6f6dd3c1b4157976d54093cb3cd67 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/family1/f7c6f6dd3c1b4157976d54093cb3cd67 2023-11-19 10:56:04,430 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/family1/62f7665130294eb5aa30e9e49beceb07 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/family1/62f7665130294eb5aa30e9e49beceb07 2023-11-19 10:56:04,431 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/family1/e068c2167cc34d299750104ba57a4887 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/family1/e068c2167cc34d299750104ba57a4887 2023-11-19 10:56:04,432 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/family1/b9fab8e58feb4aa2b41591cf815f878c to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/family1/b9fab8e58feb4aa2b41591cf815f878c 2023-11-19 10:56:04,432 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/family1/fd165170c7944884a929afd1d255446c to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/family1/fd165170c7944884a929afd1d255446c 2023-11-19 10:56:04,805 INFO [Listener at localhost/42675] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231119037cefba01e04a11bf423141797f780b_del 2023-11-19 10:56:04,805 INFO [Listener at localhost/42675] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231119037cefba01e04a11bf423141797f780b_del to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20231119037cefba01e04a11bf423141797f780b_del 2023-11-19 10:56:05,617 INFO [Listener at localhost/42675] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 26219582ef6b464f82d0245bdba7a3be 2023-11-19 10:56:05,618 DEBUG [Listener at localhost/42675] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/.tmp/family2/26219582ef6b464f82d0245bdba7a3be as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/family2/26219582ef6b464f82d0245bdba7a3be 2023-11-19 10:56:05,622 INFO [Listener at localhost/42675] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 26219582ef6b464f82d0245bdba7a3be 2023-11-19 10:56:05,623 INFO [Listener at localhost/42675] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 497f14d21350d42b3c82af489eba8bb7/family2 of 497f14d21350d42b3c82af489eba8bb7 into 26219582ef6b464f82d0245bdba7a3be(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-19 10:56:05,623 DEBUG [Listener at localhost/42675] regionserver.HRegion(2289): Compaction status journal for 497f14d21350d42b3c82af489eba8bb7: 2023-11-19 10:56:05,623 DEBUG [Listener at localhost/42675] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-19 10:56:05,623 DEBUG [Listener at localhost/42675] regionserver.HStore(1912): 335e7ed4b507c72c2048400c591d5abb/family1 is initiating major compaction (all files) 2023-11-19 10:56:05,623 INFO [Listener at localhost/42675] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-19 10:56:05,623 INFO [Listener at localhost/42675] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-19 10:56:05,623 INFO [Listener at localhost/42675] regionserver.HRegion(2259): Starting compaction of 335e7ed4b507c72c2048400c591d5abb/family1 in testMajorCompactionFromAdmin,,1700391352088.335e7ed4b507c72c2048400c591d5abb. 2023-11-19 10:56:05,623 INFO [Listener at localhost/42675] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/family1/c13a044ec7f94b9ab20f7ed5fe40f2cf, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/family1/2349856351ce49e5b4564870063a0dcd, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/family1/4ab2642e69a945fa935b1e9d49e5b3e4, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/family1/72b485cdddd44578a14685b7aff63d4f, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/family1/d3a2378afe4c4274b6e5958d48914328] into tmpdir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/.tmp, totalSize=27.1 K 2023-11-19 10:56:05,624 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting c13a044ec7f94b9ab20f7ed5fe40f2cf, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700391354231 2023-11-19 10:56:05,624 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting 2349856351ce49e5b4564870063a0dcd, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700391356103 2023-11-19 10:56:05,624 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting 4ab2642e69a945fa935b1e9d49e5b3e4, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700391357204 2023-11-19 10:56:05,625 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting 72b485cdddd44578a14685b7aff63d4f, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700391358670 2023-11-19 10:56:05,625 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting d3a2378afe4c4274b6e5958d48914328, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-19 10:56:05,627 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/family2/36b3354077b645c8994ac3c2183de3af, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/family2/77b76d328ed24fd38b12502f9171050d, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/family2/2ef28b1fa7464dfb9f73b239289b5d76, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/family2/0b72f42dc41b4f538ab9c0de311ec7c4, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/family2/db5420d5fc114bf0bc3df1aed32dbec0] to archive 2023-11-19 10:56:05,627 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:56:05,629 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/family2/36b3354077b645c8994ac3c2183de3af to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/family2/36b3354077b645c8994ac3c2183de3af 2023-11-19 10:56:05,630 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/family2/77b76d328ed24fd38b12502f9171050d to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/family2/77b76d328ed24fd38b12502f9171050d 2023-11-19 10:56:05,631 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/family2/2ef28b1fa7464dfb9f73b239289b5d76 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/family2/2ef28b1fa7464dfb9f73b239289b5d76 2023-11-19 10:56:05,632 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/family2/0b72f42dc41b4f538ab9c0de311ec7c4 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/family2/0b72f42dc41b4f538ab9c0de311ec7c4 2023-11-19 10:56:05,634 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/family2/db5420d5fc114bf0bc3df1aed32dbec0 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/family2/db5420d5fc114bf0bc3df1aed32dbec0 2023-11-19 10:56:05,635 INFO [Listener at localhost/42675] throttle.PressureAwareThroughputController(145): 335e7ed4b507c72c2048400c591d5abb#family1#compaction#202 average throughput is 0.43 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-19 10:56:06,071 INFO [Listener at localhost/42675] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202311199b8919897aa544bea92ad7bc326cd46a_del 2023-11-19 10:56:06,071 INFO [Listener at localhost/42675] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311199b8919897aa544bea92ad7bc326cd46a_del to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311199b8919897aa544bea92ad7bc326cd46a_del 2023-11-19 10:56:06,923 INFO [Listener at localhost/42675] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 07573f1eaec1485e9fe51c52d968a94b 2023-11-19 10:56:06,923 DEBUG [Listener at localhost/42675] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/.tmp/family1/07573f1eaec1485e9fe51c52d968a94b as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/family1/07573f1eaec1485e9fe51c52d968a94b 2023-11-19 10:56:06,945 INFO [Listener at localhost/42675] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 07573f1eaec1485e9fe51c52d968a94b 2023-11-19 10:56:06,946 INFO [Listener at localhost/42675] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 335e7ed4b507c72c2048400c591d5abb/family1 of 335e7ed4b507c72c2048400c591d5abb into 07573f1eaec1485e9fe51c52d968a94b(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-19 10:56:06,946 DEBUG [Listener at localhost/42675] regionserver.HRegion(2289): Compaction status journal for 335e7ed4b507c72c2048400c591d5abb: 2023-11-19 10:56:06,946 DEBUG [Listener at localhost/42675] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-19 10:56:06,946 DEBUG [Listener at localhost/42675] regionserver.HStore(1912): 335e7ed4b507c72c2048400c591d5abb/family2 is initiating major compaction (all files) 2023-11-19 10:56:06,946 INFO [Listener at localhost/42675] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-19 10:56:06,946 INFO [Listener at localhost/42675] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-19 10:56:06,946 INFO [Listener at localhost/42675] regionserver.HRegion(2259): Starting compaction of 335e7ed4b507c72c2048400c591d5abb/family2 in testMajorCompactionFromAdmin,,1700391352088.335e7ed4b507c72c2048400c591d5abb. 2023-11-19 10:56:06,946 INFO [Listener at localhost/42675] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/family2/ce40b4d8de4a45a3bebf556998b032e6, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/family2/c35b08e8c67b406386cd46dae300bb55, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/family2/6a4cebcf9b144258bd3dcd7811954931, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/family2/4d0ae1508ea149c5bd83ddc72a894b26, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/family2/6d12e80199d64d71846e12fcde0d0723] into tmpdir=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/.tmp, totalSize=25.4 K 2023-11-19 10:56:06,947 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting ce40b4d8de4a45a3bebf556998b032e6, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700391354231 2023-11-19 10:56:06,947 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting c35b08e8c67b406386cd46dae300bb55, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700391356103 2023-11-19 10:56:06,947 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting 6a4cebcf9b144258bd3dcd7811954931, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700391357204 2023-11-19 10:56:06,948 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting 4d0ae1508ea149c5bd83ddc72a894b26, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700391358670 2023-11-19 10:56:06,948 DEBUG [Listener at localhost/42675] compactions.Compactor(207): Compacting 6d12e80199d64d71846e12fcde0d0723, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-19 10:56:06,955 INFO [Listener at localhost/42675] throttle.PressureAwareThroughputController(145): 335e7ed4b507c72c2048400c591d5abb#family2#compaction#203 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-19 10:56:07,030 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/family1/c13a044ec7f94b9ab20f7ed5fe40f2cf, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/family1/2349856351ce49e5b4564870063a0dcd, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/family1/4ab2642e69a945fa935b1e9d49e5b3e4, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/family1/72b485cdddd44578a14685b7aff63d4f, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/family1/d3a2378afe4c4274b6e5958d48914328] to archive 2023-11-19 10:56:07,031 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:56:07,032 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/family1/c13a044ec7f94b9ab20f7ed5fe40f2cf to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/family1/c13a044ec7f94b9ab20f7ed5fe40f2cf 2023-11-19 10:56:07,033 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/family1/2349856351ce49e5b4564870063a0dcd to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/family1/2349856351ce49e5b4564870063a0dcd 2023-11-19 10:56:07,034 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/family1/4ab2642e69a945fa935b1e9d49e5b3e4 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/family1/4ab2642e69a945fa935b1e9d49e5b3e4 2023-11-19 10:56:07,035 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/family1/72b485cdddd44578a14685b7aff63d4f to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/family1/72b485cdddd44578a14685b7aff63d4f 2023-11-19 10:56:07,036 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/family1/d3a2378afe4c4274b6e5958d48914328 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/family1/d3a2378afe4c4274b6e5958d48914328 2023-11-19 10:56:07,362 INFO [Listener at localhost/42675] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231119584bacd300f54e2e92573b7878aed342_del 2023-11-19 10:56:07,362 INFO [Listener at localhost/42675] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231119584bacd300f54e2e92573b7878aed342_del to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20231119584bacd300f54e2e92573b7878aed342_del 2023-11-19 10:56:08,174 INFO [Listener at localhost/42675] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 01f660fbd38748edae456e22ebf53088 2023-11-19 10:56:08,175 DEBUG [Listener at localhost/42675] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/.tmp/family2/01f660fbd38748edae456e22ebf53088 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/family2/01f660fbd38748edae456e22ebf53088 2023-11-19 10:56:08,179 INFO [Listener at localhost/42675] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 01f660fbd38748edae456e22ebf53088 2023-11-19 10:56:08,180 INFO [Listener at localhost/42675] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 335e7ed4b507c72c2048400c591d5abb/family2 of 335e7ed4b507c72c2048400c591d5abb into 01f660fbd38748edae456e22ebf53088(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-19 10:56:08,180 DEBUG [Listener at localhost/42675] regionserver.HRegion(2289): Compaction status journal for 335e7ed4b507c72c2048400c591d5abb: 2023-11-19 10:56:08,183 DEBUG [Listener at localhost/42675] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-19 10:56:08,185 DEBUG [Listener at localhost/42675] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-19 10:56:08,188 DEBUG [Listener at localhost/42675] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-19 10:56:08,189 DEBUG [Listener at localhost/42675] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-19 10:56:08,194 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=33457] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x90\xEC\xB2\x02\xA6\xED\xBC\x88\x81c\x87w\xF3I\xFD9"\x10=#\x19HK\x88\xDA\xEC3\xBF1\x83\xA4<'z*\x10 \x94\xF1\xB1/d\xB2X\x19B\xB3Vkl\xB5\x172\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testMajorCompactionFromAdmin 2023-11-19 10:56:08,214 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] procedure2.ProcedureExecutor(1028): Stored pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-11-19 10:56:08,215 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-11-19 10:56:08,216 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-19 10:56:08,216 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=123, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700391968216 2023-11-19 10:56:08,216 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-19 10:56:08,231 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/family2/ce40b4d8de4a45a3bebf556998b032e6, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/family2/c35b08e8c67b406386cd46dae300bb55, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/family2/6a4cebcf9b144258bd3dcd7811954931, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/family2/4d0ae1508ea149c5bd83ddc72a894b26, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/family2/6d12e80199d64d71846e12fcde0d0723] to archive 2023-11-19 10:56:08,231 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:56:08,233 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/family2/ce40b4d8de4a45a3bebf556998b032e6 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/family2/ce40b4d8de4a45a3bebf556998b032e6 2023-11-19 10:56:08,234 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/family2/c35b08e8c67b406386cd46dae300bb55 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/family2/c35b08e8c67b406386cd46dae300bb55 2023-11-19 10:56:08,235 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/family2/6a4cebcf9b144258bd3dcd7811954931 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/family2/6a4cebcf9b144258bd3dcd7811954931 2023-11-19 10:56:08,236 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/family2/4d0ae1508ea149c5bd83ddc72a894b26 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/family2/4d0ae1508ea149c5bd83ddc72a894b26 2023-11-19 10:56:08,238 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/family2/6d12e80199d64d71846e12fcde0d0723 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/family2/6d12e80199d64d71846e12fcde0d0723 2023-11-19 10:56:08,548 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testMajorCompactionFromAdmin' and column 'family1' 2023-11-19 10:56:08,575 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202311199b8919897aa544bea92ad7bc326cd46a_del 2023-11-19 10:56:08,596 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202311199131b0952e424d75af0608eabcc8f45a_del 2023-11-19 10:56:08,616 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231119c9a6a116999e4800aaa7bd6afae2ce4d_del 2023-11-19 10:56:08,616 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testMajorCompactionFromAdmin' column='family1' 2023-11-19 10:56:08,617 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] zookeeper.ReadOnlyZKClient(139): Connect 0x126fb100 to 127.0.0.1:60497 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-19 10:56:08,622 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7f0b09b3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-19 10:56:08,622 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231119 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-19 10:56:08,779 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311199601d2c2bc6d41038ee3fa6ac27a632a to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311199601d2c2bc6d41038ee3fa6ac27a632a 2023-11-19 10:56:08,780 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231119 table='testMajorCompactionFromAdmin' column='family1' 2023-11-19 10:56:08,797 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-19 10:56:08,799 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43724, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-19 10:56:08,807 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-19 10:56:08,809 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45390, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-19 10:56:08,838 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231119/family1/27352679ac5c4ca4958b841fe6b094b2 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-11-19 10:56:08,839 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,,1700391352088.335e7ed4b507c72c2048400c591d5abb., hostname=jenkins-hbase4.apache.org,46035,1700391201579, seqNum=2 for row with hfile group [{family1,hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231119/family1/27352679ac5c4ca4958b841fe6b094b2}] 2023-11-19 10:56:08,843 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(763): Validating hfile at hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231119/family1/27352679ac5c4ca4958b841fe6b094b2 for inclusion in 335e7ed4b507c72c2048400c591d5abb/family1 2023-11-19 10:56:08,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-11-19 10:56:08,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(777): Region bounds: first= last=1 2023-11-19 10:56:08,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegion(2446): Flush status journal for 335e7ed4b507c72c2048400c591d5abb: 2023-11-19 10:56:08,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231119/family1/27352679ac5c4ca4958b841fe6b094b2 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionFromAdmin__ub026lcifok7t0sfq5pt0ja2ohbtrugtsqdfgek2meu5dk5bfohpep4e5mmdbt6b/family1/27352679ac5c4ca4958b841fe6b094b2 2023-11-19 10:56:08,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionFromAdmin__ub026lcifok7t0sfq5pt0ja2ohbtrugtsqdfgek2meu5dk5bfohpep4e5mmdbt6b/family1/27352679ac5c4ca4958b841fe6b094b2 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/family1/5ec461eafbd64dadb8aaf9952ba4983b_SeqId_28_ 2023-11-19 10:56:08,880 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(849): Loaded HFile hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionFromAdmin__ub026lcifok7t0sfq5pt0ja2ohbtrugtsqdfgek2meu5dk5bfohpep4e5mmdbt6b/family1/27352679ac5c4ca4958b841fe6b094b2 into 335e7ed4b507c72c2048400c591d5abb/family1 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/family1/5ec461eafbd64dadb8aaf9952ba4983b_SeqId_28_ - updating store file list. 2023-11-19 10:56:08,911 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(882): Loaded HFile hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/family1/5ec461eafbd64dadb8aaf9952ba4983b_SeqId_28_ into 335e7ed4b507c72c2048400c591d5abb/family1 2023-11-19 10:56:08,912 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(855): Successfully loaded hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionFromAdmin__ub026lcifok7t0sfq5pt0ja2ohbtrugtsqdfgek2meu5dk5bfohpep4e5mmdbt6b/family1/27352679ac5c4ca4958b841fe6b094b2 into 335e7ed4b507c72c2048400c591d5abb/family1 (new location: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/family1/5ec461eafbd64dadb8aaf9952ba4983b_SeqId_28_) 2023-11-19 10:56:08,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionFromAdmin__ub026lcifok7t0sfq5pt0ja2ohbtrugtsqdfgek2meu5dk5bfohpep4e5mmdbt6b/family1/27352679ac5c4ca4958b841fe6b094b2 2023-11-19 10:56:08,914 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231119 table='testMajorCompactionFromAdmin' column='family1' 2023-11-19 10:56:08,915 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:56:08,917 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231119438be611588343f2ba2ab1118dea29d2 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231119438be611588343f2ba2ab1118dea29d2 2023-11-19 10:56:08,918 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231119618107003ed5488c9b6a8a5c2d60b7c2 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231119618107003ed5488c9b6a8a5c2d60b7c2 2023-11-19 10:56:08,919 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311198748950a0d53439e9b56f10076f6bd93 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311198748950a0d53439e9b56f10076f6bd93 2023-11-19 10:56:08,923 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231119d6301b549b8a4945bfd172501bc96ea5 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231119d6301b549b8a4945bfd172501bc96ea5 2023-11-19 10:56:08,923 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-11-19 10:56:08,923 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231119' 2023-11-19 10:56:08,923 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231119 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-19 10:56:08,923 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231119 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-19 10:56:09,476 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023111953047e71042a4f4a8d99c915bd6d0448 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023111953047e71042a4f4a8d99c915bd6d0448 2023-11-19 10:56:09,477 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231119 table='testMajorCompactionFromAdmin' column='family1' 2023-11-19 10:56:09,516 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231119/family1/d99a3598f1fd497783832a202614b0d5 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-11-19 10:56:09,517 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,2,1700391352088.497f14d21350d42b3c82af489eba8bb7., hostname=jenkins-hbase4.apache.org,46035,1700391201579, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231119/family1/d99a3598f1fd497783832a202614b0d5}] 2023-11-19 10:56:09,518 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(763): Validating hfile at hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231119/family1/d99a3598f1fd497783832a202614b0d5 for inclusion in 497f14d21350d42b3c82af489eba8bb7/family1 2023-11-19 10:56:09,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-11-19 10:56:09,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-19 10:56:09,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegion(2446): Flush status journal for 497f14d21350d42b3c82af489eba8bb7: 2023-11-19 10:56:09,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231119/family1/d99a3598f1fd497783832a202614b0d5 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionFromAdmin__9qvml70ofvbfkpsi48ijhknskbk1v96bcehc1vggdas60hr6mp55kobjab2ona2/family1/d99a3598f1fd497783832a202614b0d5 2023-11-19 10:56:09,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionFromAdmin__9qvml70ofvbfkpsi48ijhknskbk1v96bcehc1vggdas60hr6mp55kobjab2ona2/family1/d99a3598f1fd497783832a202614b0d5 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/family1/8240c93e441749409823937a1420995c_SeqId_28_ 2023-11-19 10:56:09,541 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(849): Loaded HFile hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionFromAdmin__9qvml70ofvbfkpsi48ijhknskbk1v96bcehc1vggdas60hr6mp55kobjab2ona2/family1/d99a3598f1fd497783832a202614b0d5 into 497f14d21350d42b3c82af489eba8bb7/family1 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/family1/8240c93e441749409823937a1420995c_SeqId_28_ - updating store file list. 2023-11-19 10:56:09,562 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(882): Loaded HFile hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/family1/8240c93e441749409823937a1420995c_SeqId_28_ into 497f14d21350d42b3c82af489eba8bb7/family1 2023-11-19 10:56:09,562 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(855): Successfully loaded hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionFromAdmin__9qvml70ofvbfkpsi48ijhknskbk1v96bcehc1vggdas60hr6mp55kobjab2ona2/family1/d99a3598f1fd497783832a202614b0d5 into 497f14d21350d42b3c82af489eba8bb7/family1 (new location: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/family1/8240c93e441749409823937a1420995c_SeqId_28_) 2023-11-19 10:56:09,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionFromAdmin__9qvml70ofvbfkpsi48ijhknskbk1v96bcehc1vggdas60hr6mp55kobjab2ona2/family1/d99a3598f1fd497783832a202614b0d5 2023-11-19 10:56:09,564 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231119 table='testMajorCompactionFromAdmin' column='family1' 2023-11-19 10:56:09,565 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:56:09,566 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023111921189f7f09cb44d98bad12b62565b3a6 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023111921189f7f09cb44d98bad12b62565b3a6 2023-11-19 10:56:09,567 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311192dd5358c633b49aeac98b9fa3ff633ac to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311192dd5358c633b49aeac98b9fa3ff633ac 2023-11-19 10:56:09,568 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231119a6c90e84d5d0420097cbddb616ebf84c to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231119a6c90e84d5d0420097cbddb616ebf84c 2023-11-19 10:56:09,569 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231119e30dbb3881af4287b7dcd5b1a1a6d9b6 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231119e30dbb3881af4287b7dcd5b1a1a6d9b6 2023-11-19 10:56:09,569 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-11-19 10:56:09,569 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231119' 2023-11-19 10:56:09,569 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231119 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-19 10:56:09,569 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231119 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-19 10:56:10,524 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231119373dd638ebaa49dc8a01cddecbd55add to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231119373dd638ebaa49dc8a01cddecbd55add 2023-11-19 10:56:10,525 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231119 table='testMajorCompactionFromAdmin' column='family1' 2023-11-19 10:56:10,564 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231119/family1/0775afbe963e4b8287ecee40b7decf87 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-11-19 10:56:10,564 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,1,1700391352088.4ce979cd3b1a8635c1e43f8856cd9983., hostname=jenkins-hbase4.apache.org,46035,1700391201579, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231119/family1/0775afbe963e4b8287ecee40b7decf87}] 2023-11-19 10:56:10,566 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(763): Validating hfile at hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231119/family1/0775afbe963e4b8287ecee40b7decf87 for inclusion in 4ce979cd3b1a8635c1e43f8856cd9983/family1 2023-11-19 10:56:10,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-11-19 10:56:10,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-19 10:56:10,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegion(2446): Flush status journal for 4ce979cd3b1a8635c1e43f8856cd9983: 2023-11-19 10:56:10,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231119/family1/0775afbe963e4b8287ecee40b7decf87 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionFromAdmin__6o9q8mphhgjg18pip8q728287vbrclv0vpkm6j0p0a8rrp3jib5fs7rv6lnvijb/family1/0775afbe963e4b8287ecee40b7decf87 2023-11-19 10:56:10,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionFromAdmin__6o9q8mphhgjg18pip8q728287vbrclv0vpkm6j0p0a8rrp3jib5fs7rv6lnvijb/family1/0775afbe963e4b8287ecee40b7decf87 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/family1/d495f920eb1b423b985082129c66bff3_SeqId_28_ 2023-11-19 10:56:10,589 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(849): Loaded HFile hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionFromAdmin__6o9q8mphhgjg18pip8q728287vbrclv0vpkm6j0p0a8rrp3jib5fs7rv6lnvijb/family1/0775afbe963e4b8287ecee40b7decf87 into 4ce979cd3b1a8635c1e43f8856cd9983/family1 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/family1/d495f920eb1b423b985082129c66bff3_SeqId_28_ - updating store file list. 2023-11-19 10:56:10,610 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(882): Loaded HFile hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/family1/d495f920eb1b423b985082129c66bff3_SeqId_28_ into 4ce979cd3b1a8635c1e43f8856cd9983/family1 2023-11-19 10:56:10,610 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.HStore(855): Successfully loaded hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionFromAdmin__6o9q8mphhgjg18pip8q728287vbrclv0vpkm6j0p0a8rrp3jib5fs7rv6lnvijb/family1/0775afbe963e4b8287ecee40b7decf87 into 4ce979cd3b1a8635c1e43f8856cd9983/family1 (new location: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/family1/d495f920eb1b423b985082129c66bff3_SeqId_28_) 2023-11-19 10:56:10,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46035] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/staging/jenkins__testMajorCompactionFromAdmin__6o9q8mphhgjg18pip8q728287vbrclv0vpkm6j0p0a8rrp3jib5fs7rv6lnvijb/family1/0775afbe963e4b8287ecee40b7decf87 2023-11-19 10:56:10,611 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231119 table='testMajorCompactionFromAdmin' column='family1' 2023-11-19 10:56:10,612 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:56:10,613 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311194229e3b742844f9d90cb3d56d1f589ad to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311194229e3b742844f9d90cb3d56d1f589ad 2023-11-19 10:56:10,614 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023111953a03608ece8482daeedf8145798337d to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023111953a03608ece8482daeedf8145798337d 2023-11-19 10:56:10,615 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231119651cd53fff214860a9d1c3368d94ca10 to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231119651cd53fff214860a9d1c3368d94ca10 2023-11-19 10:56:10,616 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231119a9fd50cc1a4c462c9e41b439bc385a0f to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231119a9fd50cc1a4c462c9e41b439bc385a0f 2023-11-19 10:56:10,616 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-11-19 10:56:10,616 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231119' 2023-11-19 10:56:10,616 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231119 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-19 10:56:10,616 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testMajorCompactionFromAdmin' column='family1' 2023-11-19 10:56:10,616 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-19 10:56:10,616 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] compactions.PartitionedMobCompactor(367): [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311199b8919897aa544bea92ad7bc326cd46a_del] 2023-11-19 10:56:10,617 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:56:10,618 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311199b8919897aa544bea92ad7bc326cd46a_del to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311199b8919897aa544bea92ad7bc326cd46a_del 2023-11-19 10:56:10,618 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-11-19 10:56:10,618 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] compactions.PartitionedMobCompactor(367): [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311199131b0952e424d75af0608eabcc8f45a_del] 2023-11-19 10:56:10,618 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:56:10,619 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311199131b0952e424d75af0608eabcc8f45a_del to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311199131b0952e424d75af0608eabcc8f45a_del 2023-11-19 10:56:10,619 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-11-19 10:56:10,619 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] compactions.PartitionedMobCompactor(367): [hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231119c9a6a116999e4800aaa7bd6afae2ce4d_del] 2023-11-19 10:56:10,619 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] backup.HFileArchiver(360): Archiving compacted files. 2023-11-19 10:56:10,620 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231119c9a6a116999e4800aaa7bd6afae2ce4d_del to hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231119c9a6a116999e4800aaa7bd6afae2ce4d_del 2023-11-19 10:56:10,620 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-11-19 10:56:10,620 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700391204946] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-19 10:56:10,622 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=123, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-11-19 10:56:10,623 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=123, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE in 2.4080 sec 2023-11-19 10:56:10,640 DEBUG [Listener at localhost/42675] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-19 10:56:10,642 DEBUG [Listener at localhost/42675] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-19 10:56:10,645 DEBUG [Listener at localhost/42675] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-19 10:56:10,645 DEBUG [Listener at localhost/42675] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-19 10:56:10,649 INFO [Listener at localhost/42675] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-19 10:56:10,684 INFO [Listener at localhost/42675] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=250 (was 267), OpenFileDescriptor=677 (was 680), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=144 (was 162), ProcessCount=174 (was 174), AvailableMemoryMB=15818 (was 15831) 2023-11-19 10:56:10,685 DEBUG [Listener at localhost/42675] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0a11c17b to 127.0.0.1:60497 2023-11-19 10:56:10,685 DEBUG [Listener at localhost/42675] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-19 10:56:10,685 INFO [Listener at localhost/42675] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-11-19 10:56:10,685 INFO [Listener at localhost/42675] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-19 10:56:10,686 DEBUG [Listener at localhost/42675] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x77fd41f4 to 127.0.0.1:60497 2023-11-19 10:56:10,686 DEBUG [Listener at localhost/42675] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-19 10:56:10,686 DEBUG [Listener at localhost/42675] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-11-19 10:56:10,686 DEBUG [Listener at localhost/42675] util.JVMClusterUtil(257): Found active master hash=30575365, stopped=false 2023-11-19 10:56:10,686 INFO [Listener at localhost/42675] master.ServerManager(888): Cluster shutdown requested of master=jenkins-hbase4.apache.org,33457,1700391200382 2023-11-19 10:56:10,688 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-11-19 10:56:10,688 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-11-19 10:56:10,688 INFO [Listener at localhost/42675] procedure2.ProcedureExecutor(628): Stopping 2023-11-19 10:56:10,688 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-19 10:56:10,688 DEBUG [Listener at localhost/42675] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6d1d4b17 to 127.0.0.1:60497 2023-11-19 10:56:10,688 DEBUG [Listener at localhost/42675] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-19 10:56:10,688 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-19 10:56:10,689 INFO [Listener at localhost/42675] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,46035,1700391201579' ***** 2023-11-19 10:56:10,689 INFO [Listener at localhost/42675] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-11-19 10:56:10,689 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-19 10:56:10,689 INFO [RS:0;jenkins-hbase4:46035] regionserver.HeapMemoryManager(220): Stopping 2023-11-19 10:56:10,689 INFO [RS:0;jenkins-hbase4:46035] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-11-19 10:56:10,689 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-11-19 10:56:10,689 INFO [RS:0;jenkins-hbase4:46035] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-11-19 10:56:10,689 INFO [RS:0;jenkins-hbase4:46035] regionserver.HRegionServer(3305): Received CLOSE for 4ce979cd3b1a8635c1e43f8856cd9983 2023-11-19 10:56:10,690 INFO [RS:0;jenkins-hbase4:46035] regionserver.HRegionServer(3305): Received CLOSE for 4a83e887540ecadca9444556fadfc332 2023-11-19 10:56:10,690 INFO [RS:0;jenkins-hbase4:46035] regionserver.HRegionServer(3305): Received CLOSE for 497f14d21350d42b3c82af489eba8bb7 2023-11-19 10:56:10,690 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4ce979cd3b1a8635c1e43f8856cd9983, disabling compactions & flushes 2023-11-19 10:56:10,690 INFO [RS:0;jenkins-hbase4:46035] regionserver.HRegionServer(3305): Received CLOSE for cf60b3cd4f7a9228bda102f2a6171a3d 2023-11-19 10:56:10,690 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1700391352088.4ce979cd3b1a8635c1e43f8856cd9983. 2023-11-19 10:56:10,690 INFO [RS:0;jenkins-hbase4:46035] regionserver.HRegionServer(3305): Received CLOSE for f2cb6679d87b843f3747aea4a88ed8aa 2023-11-19 10:56:10,690 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1700391352088.4ce979cd3b1a8635c1e43f8856cd9983. 2023-11-19 10:56:10,690 INFO [RS:0;jenkins-hbase4:46035] regionserver.HRegionServer(3305): Received CLOSE for b427a1d00a803e63acb916b5a78a19da 2023-11-19 10:56:10,690 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1700391352088.4ce979cd3b1a8635c1e43f8856cd9983. after waiting 0 ms 2023-11-19 10:56:10,690 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1700391352088.4ce979cd3b1a8635c1e43f8856cd9983. 2023-11-19 10:56:10,690 INFO [RS:0;jenkins-hbase4:46035] regionserver.HRegionServer(3305): Received CLOSE for d0fd5365988a919676d862ed72444aed 2023-11-19 10:56:10,690 INFO [RS:0;jenkins-hbase4:46035] regionserver.HRegionServer(3305): Received CLOSE for 94897ac05c23e41d94b8f8d3dcd0e973 2023-11-19 10:56:10,690 INFO [RS:0;jenkins-hbase4:46035] regionserver.HRegionServer(3305): Received CLOSE for 335e7ed4b507c72c2048400c591d5abb 2023-11-19 10:56:10,690 INFO [RS:0;jenkins-hbase4:46035] regionserver.HRegionServer(3305): Received CLOSE for cb7ee8609abfbe5e360af47e0bf92474 2023-11-19 10:56:10,690 INFO [RS:0;jenkins-hbase4:46035] regionserver.HRegionServer(3305): Received CLOSE for 3bb6c0b2c9863082d1a21587d98896c0 2023-11-19 10:56:10,690 INFO [RS:0;jenkins-hbase4:46035] regionserver.HRegionServer(3305): Received CLOSE for bfe0e9384ea435498bea2232dc5c43aa 2023-11-19 10:56:10,690 INFO [RS:0;jenkins-hbase4:46035] regionserver.HRegionServer(3305): Received CLOSE for 81401826ca044bcce6b358200c9c2f2a 2023-11-19 10:56:10,690 INFO [RS:0;jenkins-hbase4:46035] regionserver.HRegionServer(3305): Received CLOSE for 7d69714ba10fe87dbfc7ff1b8a18f779 2023-11-19 10:56:10,690 INFO [RS:0;jenkins-hbase4:46035] regionserver.HRegionServer(3305): Received CLOSE for 637f0b3884286bfcfceb56152d715e9d 2023-11-19 10:56:10,690 INFO [RS:0;jenkins-hbase4:46035] regionserver.HRegionServer(3305): Received CLOSE for f1630f7551bce81ee7e30ea665d7671e 2023-11-19 10:56:10,690 INFO [RS:0;jenkins-hbase4:46035] regionserver.HRegionServer(3305): Received CLOSE for 6cb2537056386ddfd53df16ae102ba42 2023-11-19 10:56:10,690 INFO [RS:0;jenkins-hbase4:46035] regionserver.HRegionServer(3305): Received CLOSE for 8e4a8273d1606c34f37fa9a48dbe4086 2023-11-19 10:56:10,690 INFO [RS:0;jenkins-hbase4:46035] regionserver.HRegionServer(3305): Received CLOSE for 6bc32bc9f7c3f1d5eebc37dd041af4fe 2023-11-19 10:56:10,690 INFO [RS:0;jenkins-hbase4:46035] regionserver.HRegionServer(3305): Received CLOSE for cc4d248c67f2406eabe5365c5a2f50ca 2023-11-19 10:56:10,690 INFO [RS:0;jenkins-hbase4:46035] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:56:10,690 DEBUG [RS:0;jenkins-hbase4:46035] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x315590c1 to 127.0.0.1:60497 2023-11-19 10:56:10,691 DEBUG [RS:0;jenkins-hbase4:46035] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-19 10:56:10,691 INFO [RS:0;jenkins-hbase4:46035] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-11-19 10:56:10,691 INFO [RS:0;jenkins-hbase4:46035] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-11-19 10:56:10,691 INFO [RS:0;jenkins-hbase4:46035] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-11-19 10:56:10,691 INFO [RS:0;jenkins-hbase4:46035] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-11-19 10:56:10,691 INFO [RS:0;jenkins-hbase4:46035] regionserver.HRegionServer(1474): Waiting on 21 regions to close 2023-11-19 10:56:10,691 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-11-19 10:56:10,691 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-11-19 10:56:10,692 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-11-19 10:56:10,692 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-11-19 10:56:10,692 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-11-19 10:56:10,692 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=50.56 KB heapSize=78.23 KB 2023-11-19 10:56:10,692 DEBUG [RS:0;jenkins-hbase4:46035] regionserver.HRegionServer(1504): Waiting on 1588230740, 335e7ed4b507c72c2048400c591d5abb, 3bb6c0b2c9863082d1a21587d98896c0, 497f14d21350d42b3c82af489eba8bb7, 4a83e887540ecadca9444556fadfc332, 4ce979cd3b1a8635c1e43f8856cd9983, 637f0b3884286bfcfceb56152d715e9d, 6bc32bc9f7c3f1d5eebc37dd041af4fe, 6cb2537056386ddfd53df16ae102ba42, 7d69714ba10fe87dbfc7ff1b8a18f779, 81401826ca044bcce6b358200c9c2f2a, 8e4a8273d1606c34f37fa9a48dbe4086, 94897ac05c23e41d94b8f8d3dcd0e973, b427a1d00a803e63acb916b5a78a19da, bfe0e9384ea435498bea2232dc5c43aa, cb7ee8609abfbe5e360af47e0bf92474, cc4d248c67f2406eabe5365c5a2f50ca, cf60b3cd4f7a9228bda102f2a6171a3d, d0fd5365988a919676d862ed72444aed, f1630f7551bce81ee7e30ea665d7671e, f2cb6679d87b843f3747aea4a88ed8aa 2023-11-19 10:56:10,694 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/4ce979cd3b1a8635c1e43f8856cd9983/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-19 10:56:10,695 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1700391352088.4ce979cd3b1a8635c1e43f8856cd9983. 2023-11-19 10:56:10,695 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4ce979cd3b1a8635c1e43f8856cd9983: 2023-11-19 10:56:10,695 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,1,1700391352088.4ce979cd3b1a8635c1e43f8856cd9983. 2023-11-19 10:56:10,695 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4a83e887540ecadca9444556fadfc332, disabling compactions & flushes 2023-11-19 10:56:10,695 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332. 2023-11-19 10:56:10,695 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332. 2023-11-19 10:56:10,695 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332. after waiting 0 ms 2023-11-19 10:56:10,695 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332. 2023-11-19 10:56:10,698 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/4a83e887540ecadca9444556fadfc332/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-11-19 10:56:10,699 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332. 2023-11-19 10:56:10,699 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4a83e887540ecadca9444556fadfc332: 2023-11-19 10:56:10,699 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,1,1700391299530.4a83e887540ecadca9444556fadfc332. 2023-11-19 10:56:10,699 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 497f14d21350d42b3c82af489eba8bb7, disabling compactions & flushes 2023-11-19 10:56:10,699 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1700391352088.497f14d21350d42b3c82af489eba8bb7. 2023-11-19 10:56:10,699 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1700391352088.497f14d21350d42b3c82af489eba8bb7. 2023-11-19 10:56:10,699 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1700391352088.497f14d21350d42b3c82af489eba8bb7. after waiting 0 ms 2023-11-19 10:56:10,699 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1700391352088.497f14d21350d42b3c82af489eba8bb7. 2023-11-19 10:56:10,702 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/497f14d21350d42b3c82af489eba8bb7/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-19 10:56:10,703 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1700391352088.497f14d21350d42b3c82af489eba8bb7. 2023-11-19 10:56:10,703 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 497f14d21350d42b3c82af489eba8bb7: 2023-11-19 10:56:10,703 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=48.28 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/hbase/meta/1588230740/.tmp/info/0557490e85604dc3be5a88e993d224ff 2023-11-19 10:56:10,703 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,2,1700391352088.497f14d21350d42b3c82af489eba8bb7. 2023-11-19 10:56:10,703 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing cf60b3cd4f7a9228bda102f2a6171a3d, disabling compactions & flushes 2023-11-19 10:56:10,703 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1700391243138.cf60b3cd4f7a9228bda102f2a6171a3d. 2023-11-19 10:56:10,703 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1700391243138.cf60b3cd4f7a9228bda102f2a6171a3d. 2023-11-19 10:56:10,703 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1700391243138.cf60b3cd4f7a9228bda102f2a6171a3d. after waiting 0 ms 2023-11-19 10:56:10,703 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1700391243138.cf60b3cd4f7a9228bda102f2a6171a3d. 2023-11-19 10:56:10,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testScannerOnBulkLoadRefHFiles/cf60b3cd4f7a9228bda102f2a6171a3d/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-11-19 10:56:10,706 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0557490e85604dc3be5a88e993d224ff 2023-11-19 10:56:10,707 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1700391243138.cf60b3cd4f7a9228bda102f2a6171a3d. 2023-11-19 10:56:10,707 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for cf60b3cd4f7a9228bda102f2a6171a3d: 2023-11-19 10:56:10,707 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,2,1700391243138.cf60b3cd4f7a9228bda102f2a6171a3d. 2023-11-19 10:56:10,707 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f2cb6679d87b843f3747aea4a88ed8aa, disabling compactions & flushes 2023-11-19 10:56:10,707 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa. 2023-11-19 10:56:10,707 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa. 2023-11-19 10:56:10,707 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa. after waiting 0 ms 2023-11-19 10:56:10,707 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa. 2023-11-19 10:56:10,709 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f2cb6679d87b843f3747aea4a88ed8aa/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-11-19 10:56:10,710 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa. 2023-11-19 10:56:10,710 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f2cb6679d87b843f3747aea4a88ed8aa: 2023-11-19 10:56:10,710 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1700391205187.f2cb6679d87b843f3747aea4a88ed8aa. 2023-11-19 10:56:10,710 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b427a1d00a803e63acb916b5a78a19da, disabling compactions & flushes 2023-11-19 10:56:10,710 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1700391324155.b427a1d00a803e63acb916b5a78a19da. 2023-11-19 10:56:10,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1700391324155.b427a1d00a803e63acb916b5a78a19da. 2023-11-19 10:56:10,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1700391324155.b427a1d00a803e63acb916b5a78a19da. after waiting 0 ms 2023-11-19 10:56:10,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1700391324155.b427a1d00a803e63acb916b5a78a19da. 2023-11-19 10:56:10,712 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=102 B at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/hbase/meta/1588230740/.tmp/rep_barrier/be573b78506d4e70a100d1a45c3803ca 2023-11-19 10:56:10,714 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/b427a1d00a803e63acb916b5a78a19da/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-19 10:56:10,714 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1700391324155.b427a1d00a803e63acb916b5a78a19da. 2023-11-19 10:56:10,714 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b427a1d00a803e63acb916b5a78a19da: 2023-11-19 10:56:10,715 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,1,1700391324155.b427a1d00a803e63acb916b5a78a19da. 2023-11-19 10:56:10,715 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d0fd5365988a919676d862ed72444aed, disabling compactions & flushes 2023-11-19 10:56:10,715 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1700391243138.d0fd5365988a919676d862ed72444aed. 2023-11-19 10:56:10,715 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1700391243138.d0fd5365988a919676d862ed72444aed. 2023-11-19 10:56:10,715 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1700391243138.d0fd5365988a919676d862ed72444aed. after waiting 0 ms 2023-11-19 10:56:10,715 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1700391243138.d0fd5365988a919676d862ed72444aed. 2023-11-19 10:56:10,717 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for be573b78506d4e70a100d1a45c3803ca 2023-11-19 10:56:10,717 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testScannerOnBulkLoadRefHFiles/d0fd5365988a919676d862ed72444aed/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-11-19 10:56:10,718 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1700391243138.d0fd5365988a919676d862ed72444aed. 2023-11-19 10:56:10,718 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d0fd5365988a919676d862ed72444aed: 2023-11-19 10:56:10,718 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,1,1700391243138.d0fd5365988a919676d862ed72444aed. 2023-11-19 10:56:10,718 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 94897ac05c23e41d94b8f8d3dcd0e973, disabling compactions & flushes 2023-11-19 10:56:10,718 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1700391248149.94897ac05c23e41d94b8f8d3dcd0e973. 2023-11-19 10:56:10,718 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1700391248149.94897ac05c23e41d94b8f8d3dcd0e973. 2023-11-19 10:56:10,718 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1700391248149.94897ac05c23e41d94b8f8d3dcd0e973. after waiting 0 ms 2023-11-19 10:56:10,718 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1700391248149.94897ac05c23e41d94b8f8d3dcd0e973. 2023-11-19 10:56:10,721 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyPolicy/94897ac05c23e41d94b8f8d3dcd0e973/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-19 10:56:10,722 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1700391248149.94897ac05c23e41d94b8f8d3dcd0e973. 2023-11-19 10:56:10,722 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 94897ac05c23e41d94b8f8d3dcd0e973: 2023-11-19 10:56:10,722 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyPolicy,,1700391248149.94897ac05c23e41d94b8f8d3dcd0e973. 2023-11-19 10:56:10,722 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 335e7ed4b507c72c2048400c591d5abb, disabling compactions & flushes 2023-11-19 10:56:10,722 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1700391352088.335e7ed4b507c72c2048400c591d5abb. 2023-11-19 10:56:10,722 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1700391352088.335e7ed4b507c72c2048400c591d5abb. 2023-11-19 10:56:10,722 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1700391352088.335e7ed4b507c72c2048400c591d5abb. after waiting 0 ms 2023-11-19 10:56:10,722 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1700391352088.335e7ed4b507c72c2048400c591d5abb. 2023-11-19 10:56:10,725 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.18 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/hbase/meta/1588230740/.tmp/table/6efb91647e3a460b83a01d233e197e38 2023-11-19 10:56:10,726 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactedHFilesCleaner was stopped 2023-11-19 10:56:10,726 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionFromAdmin/335e7ed4b507c72c2048400c591d5abb/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-19 10:56:10,727 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1700391352088.335e7ed4b507c72c2048400c591d5abb. 2023-11-19 10:56:10,727 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 335e7ed4b507c72c2048400c591d5abb: 2023-11-19 10:56:10,727 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,,1700391352088.335e7ed4b507c72c2048400c591d5abb. 2023-11-19 10:56:10,727 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing cb7ee8609abfbe5e360af47e0bf92474, disabling compactions & flushes 2023-11-19 10:56:10,727 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1700391324155.cb7ee8609abfbe5e360af47e0bf92474. 2023-11-19 10:56:10,727 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1700391324155.cb7ee8609abfbe5e360af47e0bf92474. 2023-11-19 10:56:10,727 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1700391324155.cb7ee8609abfbe5e360af47e0bf92474. after waiting 0 ms 2023-11-19 10:56:10,727 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1700391324155.cb7ee8609abfbe5e360af47e0bf92474. 2023-11-19 10:56:10,728 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6efb91647e3a460b83a01d233e197e38 2023-11-19 10:56:10,729 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/hbase/meta/1588230740/.tmp/info/0557490e85604dc3be5a88e993d224ff as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/hbase/meta/1588230740/info/0557490e85604dc3be5a88e993d224ff 2023-11-19 10:56:10,730 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cb7ee8609abfbe5e360af47e0bf92474/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-19 10:56:10,731 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1700391324155.cb7ee8609abfbe5e360af47e0bf92474. 2023-11-19 10:56:10,731 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for cb7ee8609abfbe5e360af47e0bf92474: 2023-11-19 10:56:10,731 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,2,1700391324155.cb7ee8609abfbe5e360af47e0bf92474. 2023-11-19 10:56:10,731 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3bb6c0b2c9863082d1a21587d98896c0, disabling compactions & flushes 2023-11-19 10:56:10,731 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0. 2023-11-19 10:56:10,731 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0. 2023-11-19 10:56:10,731 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0. after waiting 0 ms 2023-11-19 10:56:10,731 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0. 2023-11-19 10:56:10,734 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/3bb6c0b2c9863082d1a21587d98896c0/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-11-19 10:56:10,734 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0557490e85604dc3be5a88e993d224ff 2023-11-19 10:56:10,735 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0. 2023-11-19 10:56:10,735 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/hbase/meta/1588230740/info/0557490e85604dc3be5a88e993d224ff, entries=226, sequenceid=130, filesize=37.9 K 2023-11-19 10:56:10,735 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3bb6c0b2c9863082d1a21587d98896c0: 2023-11-19 10:56:10,735 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,2,1700391299530.3bb6c0b2c9863082d1a21587d98896c0. 2023-11-19 10:56:10,735 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing bfe0e9384ea435498bea2232dc5c43aa, disabling compactions & flushes 2023-11-19 10:56:10,735 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1700391230188.bfe0e9384ea435498bea2232dc5c43aa. 2023-11-19 10:56:10,735 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1700391230188.bfe0e9384ea435498bea2232dc5c43aa. 2023-11-19 10:56:10,735 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1700391230188.bfe0e9384ea435498bea2232dc5c43aa. after waiting 0 ms 2023-11-19 10:56:10,735 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1700391230188.bfe0e9384ea435498bea2232dc5c43aa. 2023-11-19 10:56:10,735 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/hbase/meta/1588230740/.tmp/rep_barrier/be573b78506d4e70a100d1a45c3803ca as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/hbase/meta/1588230740/rep_barrier/be573b78506d4e70a100d1a45c3803ca 2023-11-19 10:56:10,737 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithWeeklyPolicy/bfe0e9384ea435498bea2232dc5c43aa/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-19 10:56:10,738 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1700391230188.bfe0e9384ea435498bea2232dc5c43aa. 2023-11-19 10:56:10,738 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for bfe0e9384ea435498bea2232dc5c43aa: 2023-11-19 10:56:10,738 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithWeeklyPolicy,,1700391230188.bfe0e9384ea435498bea2232dc5c43aa. 2023-11-19 10:56:10,738 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 81401826ca044bcce6b358200c9c2f2a, disabling compactions & flushes 2023-11-19 10:56:10,738 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a. 2023-11-19 10:56:10,738 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a. 2023-11-19 10:56:10,738 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a. after waiting 0 ms 2023-11-19 10:56:10,738 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a. 2023-11-19 10:56:10,739 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for be573b78506d4e70a100d1a45c3803ca 2023-11-19 10:56:10,739 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/hbase/meta/1588230740/rep_barrier/be573b78506d4e70a100d1a45c3803ca, entries=1, sequenceid=130, filesize=5.0 K 2023-11-19 10:56:10,740 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/hbase/meta/1588230740/.tmp/table/6efb91647e3a460b83a01d233e197e38 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/hbase/meta/1588230740/table/6efb91647e3a460b83a01d233e197e38 2023-11-19 10:56:10,741 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/81401826ca044bcce6b358200c9c2f2a/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-11-19 10:56:10,742 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a. 2023-11-19 10:56:10,742 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 81401826ca044bcce6b358200c9c2f2a: 2023-11-19 10:56:10,742 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700391261393.81401826ca044bcce6b358200c9c2f2a. 2023-11-19 10:56:10,743 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7d69714ba10fe87dbfc7ff1b8a18f779, disabling compactions & flushes 2023-11-19 10:56:10,743 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1700391203930.7d69714ba10fe87dbfc7ff1b8a18f779. 2023-11-19 10:56:10,743 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1700391203930.7d69714ba10fe87dbfc7ff1b8a18f779. 2023-11-19 10:56:10,743 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1700391203930.7d69714ba10fe87dbfc7ff1b8a18f779. after waiting 0 ms 2023-11-19 10:56:10,743 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1700391203930.7d69714ba10fe87dbfc7ff1b8a18f779. 2023-11-19 10:56:10,743 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 7d69714ba10fe87dbfc7ff1b8a18f779 1/1 column families, dataSize=109 B heapSize=592 B 2023-11-19 10:56:10,744 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6efb91647e3a460b83a01d233e197e38 2023-11-19 10:56:10,744 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/hbase/meta/1588230740/table/6efb91647e3a460b83a01d233e197e38, entries=27, sequenceid=130, filesize=6.6 K 2023-11-19 10:56:10,745 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~50.56 KB/51772, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 53ms, sequenceid=130, compaction requested=false 2023-11-19 10:56:10,749 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/hbase/meta/1588230740/recovered.edits/133.seqid, newMaxSeqId=133, maxSeqId=1 2023-11-19 10:56:10,749 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-11-19 10:56:10,749 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-11-19 10:56:10,749 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-11-19 10:56:10,749 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-11-19 10:56:10,781 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-11-19 10:56:10,892 DEBUG [RS:0;jenkins-hbase4:46035] regionserver.HRegionServer(1504): Waiting on 637f0b3884286bfcfceb56152d715e9d, 6bc32bc9f7c3f1d5eebc37dd041af4fe, 6cb2537056386ddfd53df16ae102ba42, 7d69714ba10fe87dbfc7ff1b8a18f779, 8e4a8273d1606c34f37fa9a48dbe4086, cc4d248c67f2406eabe5365c5a2f50ca, f1630f7551bce81ee7e30ea665d7671e 2023-11-19 10:56:11,093 DEBUG [RS:0;jenkins-hbase4:46035] regionserver.HRegionServer(1504): Waiting on 637f0b3884286bfcfceb56152d715e9d, 6bc32bc9f7c3f1d5eebc37dd041af4fe, 6cb2537056386ddfd53df16ae102ba42, 7d69714ba10fe87dbfc7ff1b8a18f779, 8e4a8273d1606c34f37fa9a48dbe4086, cc4d248c67f2406eabe5365c5a2f50ca, f1630f7551bce81ee7e30ea665d7671e 2023-11-19 10:56:11,149 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=109 B at sequenceid=7 (bloomFilter=true), to=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/hbase/namespace/7d69714ba10fe87dbfc7ff1b8a18f779/.tmp/info/77b05de5b69649d4929ce8d82e087074 2023-11-19 10:56:11,154 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/hbase/namespace/7d69714ba10fe87dbfc7ff1b8a18f779/.tmp/info/77b05de5b69649d4929ce8d82e087074 as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/hbase/namespace/7d69714ba10fe87dbfc7ff1b8a18f779/info/77b05de5b69649d4929ce8d82e087074 2023-11-19 10:56:11,158 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/hbase/namespace/7d69714ba10fe87dbfc7ff1b8a18f779/info/77b05de5b69649d4929ce8d82e087074, entries=3, sequenceid=7, filesize=4.8 K 2023-11-19 10:56:11,160 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for 7d69714ba10fe87dbfc7ff1b8a18f779 in 417ms, sequenceid=7, compaction requested=false 2023-11-19 10:56:11,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/hbase/namespace/7d69714ba10fe87dbfc7ff1b8a18f779/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=1 2023-11-19 10:56:11,164 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1700391203930.7d69714ba10fe87dbfc7ff1b8a18f779. 2023-11-19 10:56:11,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7d69714ba10fe87dbfc7ff1b8a18f779: 2023-11-19 10:56:11,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1700391203930.7d69714ba10fe87dbfc7ff1b8a18f779. 2023-11-19 10:56:11,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 637f0b3884286bfcfceb56152d715e9d, disabling compactions & flushes 2023-11-19 10:56:11,164 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d. 2023-11-19 10:56:11,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d. 2023-11-19 10:56:11,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d. after waiting 0 ms 2023-11-19 10:56:11,165 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d. 2023-11-19 10:56:11,168 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testCompactionWithHFileLink/637f0b3884286bfcfceb56152d715e9d/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-11-19 10:56:11,168 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d. 2023-11-19 10:56:11,168 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 637f0b3884286bfcfceb56152d715e9d: 2023-11-19 10:56:11,168 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,,1700391299530.637f0b3884286bfcfceb56152d715e9d. 2023-11-19 10:56:11,168 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f1630f7551bce81ee7e30ea665d7671e, disabling compactions & flushes 2023-11-19 10:56:11,168 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1700391218400.f1630f7551bce81ee7e30ea665d7671e. 2023-11-19 10:56:11,168 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1700391218400.f1630f7551bce81ee7e30ea665d7671e. 2023-11-19 10:56:11,168 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1700391218400.f1630f7551bce81ee7e30ea665d7671e. after waiting 0 ms 2023-11-19 10:56:11,168 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1700391218400.f1630f7551bce81ee7e30ea665d7671e. 2023-11-19 10:56:11,171 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithMonthlyPolicy/f1630f7551bce81ee7e30ea665d7671e/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-11-19 10:56:11,172 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1700391218400.f1630f7551bce81ee7e30ea665d7671e. 2023-11-19 10:56:11,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f1630f7551bce81ee7e30ea665d7671e: 2023-11-19 10:56:11,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithMonthlyPolicy,,1700391218400.f1630f7551bce81ee7e30ea665d7671e. 2023-11-19 10:56:11,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6cb2537056386ddfd53df16ae102ba42, disabling compactions & flushes 2023-11-19 10:56:11,172 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1700391340487.6cb2537056386ddfd53df16ae102ba42. 2023-11-19 10:56:11,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1700391340487.6cb2537056386ddfd53df16ae102ba42. 2023-11-19 10:56:11,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1700391340487.6cb2537056386ddfd53df16ae102ba42. after waiting 0 ms 2023-11-19 10:56:11,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1700391340487.6cb2537056386ddfd53df16ae102ba42. 2023-11-19 10:56:11,175 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMinorCompactionWithMonthlyPolicy/6cb2537056386ddfd53df16ae102ba42/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-11-19 10:56:11,175 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1700391340487.6cb2537056386ddfd53df16ae102ba42. 2023-11-19 10:56:11,175 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6cb2537056386ddfd53df16ae102ba42: 2023-11-19 10:56:11,175 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithMonthlyPolicy,,1700391340487.6cb2537056386ddfd53df16ae102ba42. 2023-11-19 10:56:11,175 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8e4a8273d1606c34f37fa9a48dbe4086, disabling compactions & flushes 2023-11-19 10:56:11,175 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1700391243138.8e4a8273d1606c34f37fa9a48dbe4086. 2023-11-19 10:56:11,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1700391243138.8e4a8273d1606c34f37fa9a48dbe4086. 2023-11-19 10:56:11,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1700391243138.8e4a8273d1606c34f37fa9a48dbe4086. after waiting 0 ms 2023-11-19 10:56:11,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1700391243138.8e4a8273d1606c34f37fa9a48dbe4086. 2023-11-19 10:56:11,178 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testScannerOnBulkLoadRefHFiles/8e4a8273d1606c34f37fa9a48dbe4086/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-11-19 10:56:11,178 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1700391243138.8e4a8273d1606c34f37fa9a48dbe4086. 2023-11-19 10:56:11,178 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8e4a8273d1606c34f37fa9a48dbe4086: 2023-11-19 10:56:11,178 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,,1700391243138.8e4a8273d1606c34f37fa9a48dbe4086. 2023-11-19 10:56:11,178 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6bc32bc9f7c3f1d5eebc37dd041af4fe, disabling compactions & flushes 2023-11-19 10:56:11,178 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe. 2023-11-19 10:56:11,178 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe. 2023-11-19 10:56:11,178 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe. after waiting 0 ms 2023-11-19 10:56:11,178 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe. 2023-11-19 10:56:11,181 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/6bc32bc9f7c3f1d5eebc37dd041af4fe/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-11-19 10:56:11,181 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe. 2023-11-19 10:56:11,181 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6bc32bc9f7c3f1d5eebc37dd041af4fe: 2023-11-19 10:56:11,181 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700391278399.6bc32bc9f7c3f1d5eebc37dd041af4fe. 2023-11-19 10:56:11,181 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing cc4d248c67f2406eabe5365c5a2f50ca, disabling compactions & flushes 2023-11-19 10:56:11,181 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1700391324155.cc4d248c67f2406eabe5365c5a2f50ca. 2023-11-19 10:56:11,181 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1700391324155.cc4d248c67f2406eabe5365c5a2f50ca. 2023-11-19 10:56:11,182 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1700391324155.cc4d248c67f2406eabe5365c5a2f50ca. after waiting 0 ms 2023-11-19 10:56:11,182 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1700391324155.cc4d248c67f2406eabe5365c5a2f50ca. 2023-11-19 10:56:11,184 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/data/ns/testMinorCompaction/cc4d248c67f2406eabe5365c5a2f50ca/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-19 10:56:11,185 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1700391324155.cc4d248c67f2406eabe5365c5a2f50ca. 2023-11-19 10:56:11,185 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for cc4d248c67f2406eabe5365c5a2f50ca: 2023-11-19 10:56:11,185 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,,1700391324155.cc4d248c67f2406eabe5365c5a2f50ca. 2023-11-19 10:56:11,293 INFO [RS:0;jenkins-hbase4:46035] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,46035,1700391201579; all regions closed. 2023-11-19 10:56:11,300 DEBUG [RS:0;jenkins-hbase4:46035] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/oldWALs 2023-11-19 10:56:11,300 INFO [RS:0;jenkins-hbase4:46035] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46035%2C1700391201579.meta:.meta(num 1700391203667) 2023-11-19 10:56:11,304 DEBUG [RS:0;jenkins-hbase4:46035] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/oldWALs 2023-11-19 10:56:11,304 INFO [RS:0;jenkins-hbase4:46035] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46035%2C1700391201579:(num 1700391203484) 2023-11-19 10:56:11,304 DEBUG [RS:0;jenkins-hbase4:46035] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-19 10:56:11,304 INFO [RS:0;jenkins-hbase4:46035] regionserver.LeaseManager(133): Closed leases 2023-11-19 10:56:11,304 INFO [RS:0;jenkins-hbase4:46035] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-11-19 10:56:11,305 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-11-19 10:56:11,305 INFO [RS:0;jenkins-hbase4:46035] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46035 2023-11-19 10:56:11,313 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46035,1700391201579 2023-11-19 10:56:11,313 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-11-19 10:56:11,313 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-11-19 10:56:11,315 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,46035,1700391201579] 2023-11-19 10:56:11,316 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,46035,1700391201579; numProcessing=1 2023-11-19 10:56:11,317 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,46035,1700391201579 already deleted, retry=false 2023-11-19 10:56:11,317 INFO [RegionServerTracker-0] master.ServerManager(554): Cluster shutdown set; jenkins-hbase4.apache.org,46035,1700391201579 expired; onlineServers=0 2023-11-19 10:56:11,317 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,33457,1700391200382' ***** 2023-11-19 10:56:11,317 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-11-19 10:56:11,317 DEBUG [M:0;jenkins-hbase4:33457] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@40ef813e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-11-19 10:56:11,317 INFO [M:0;jenkins-hbase4:33457] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,33457,1700391200382 2023-11-19 10:56:11,317 INFO [M:0;jenkins-hbase4:33457] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,33457,1700391200382; all regions closed. 2023-11-19 10:56:11,317 DEBUG [M:0;jenkins-hbase4:33457] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-19 10:56:11,317 DEBUG [M:0;jenkins-hbase4:33457] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-11-19 10:56:11,318 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-11-19 10:56:11,318 DEBUG [M:0;jenkins-hbase4:33457] cleaner.HFileCleaner(317): Stopping file delete threads 2023-11-19 10:56:11,318 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1700391203169] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1700391203169,5,FailOnTimeoutGroup] 2023-11-19 10:56:11,318 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1700391203172] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1700391203172,5,FailOnTimeoutGroup] 2023-11-19 10:56:11,318 INFO [M:0;jenkins-hbase4:33457] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-11-19 10:56:11,318 INFO [M:0;jenkins-hbase4:33457] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-11-19 10:56:11,318 INFO [M:0;jenkins-hbase4:33457] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-11-19 10:56:11,319 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-11-19 10:56:11,319 DEBUG [M:0;jenkins-hbase4:33457] master.HMaster(1512): Stopping service threads 2023-11-19 10:56:11,319 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-19 10:56:11,319 INFO [M:0;jenkins-hbase4:33457] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-11-19 10:56:11,319 ERROR [M:0;jenkins-hbase4:33457] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-20,5,PEWorkerGroup] Thread[HFileArchiver-21,5,PEWorkerGroup] Thread[HFileArchiver-22,5,PEWorkerGroup] 2023-11-19 10:56:11,319 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-11-19 10:56:11,320 INFO [M:0;jenkins-hbase4:33457] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-11-19 10:56:11,320 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-11-19 10:56:11,320 DEBUG [M:0;jenkins-hbase4:33457] zookeeper.ZKUtil(398): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-11-19 10:56:11,320 WARN [M:0;jenkins-hbase4:33457] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-11-19 10:56:11,320 INFO [M:0;jenkins-hbase4:33457] assignment.AssignmentManager(315): Stopping assignment manager 2023-11-19 10:56:11,321 INFO [M:0;jenkins-hbase4:33457] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-11-19 10:56:11,321 DEBUG [M:0;jenkins-hbase4:33457] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-11-19 10:56:11,321 INFO [M:0;jenkins-hbase4:33457] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-19 10:56:11,321 DEBUG [M:0;jenkins-hbase4:33457] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-19 10:56:11,321 DEBUG [M:0;jenkins-hbase4:33457] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-11-19 10:56:11,321 DEBUG [M:0;jenkins-hbase4:33457] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-19 10:56:11,321 INFO [M:0;jenkins-hbase4:33457] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=512.56 KB heapSize=598.32 KB 2023-11-19 10:56:11,415 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-19 10:56:11,415 INFO [RS:0;jenkins-hbase4:46035] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,46035,1700391201579; zookeeper connection closed. 2023-11-19 10:56:11,416 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): regionserver:46035-0x1000546872b0001, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-19 10:56:11,416 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1dad5ec8] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1dad5ec8 2023-11-19 10:56:11,416 INFO [Listener at localhost/42675] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-11-19 10:56:11,730 INFO [M:0;jenkins-hbase4:33457] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=512.56 KB at sequenceid=1006 (bloomFilter=true), to=hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/22a6d0019b494682ba8756795caa03be 2023-11-19 10:56:11,733 INFO [M:0;jenkins-hbase4:33457] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 22a6d0019b494682ba8756795caa03be 2023-11-19 10:56:11,733 DEBUG [M:0;jenkins-hbase4:33457] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/22a6d0019b494682ba8756795caa03be as hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/22a6d0019b494682ba8756795caa03be 2023-11-19 10:56:11,736 INFO [M:0;jenkins-hbase4:33457] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 22a6d0019b494682ba8756795caa03be 2023-11-19 10:56:11,736 INFO [M:0;jenkins-hbase4:33457] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/84ea6a34-068d-f1bd-60af-273a6f5da47f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/22a6d0019b494682ba8756795caa03be, entries=123, sequenceid=1006, filesize=33.3 K 2023-11-19 10:56:11,737 INFO [M:0;jenkins-hbase4:33457] regionserver.HRegion(2948): Finished flush of dataSize ~512.56 KB/524858, heapSize ~598.30 KB/612664, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 416ms, sequenceid=1006, compaction requested=false 2023-11-19 10:56:11,738 INFO [M:0;jenkins-hbase4:33457] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-19 10:56:11,738 DEBUG [M:0;jenkins-hbase4:33457] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-11-19 10:56:11,740 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-11-19 10:56:11,740 INFO [M:0;jenkins-hbase4:33457] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-11-19 10:56:11,741 INFO [M:0;jenkins-hbase4:33457] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33457 2023-11-19 10:56:11,743 DEBUG [M:0;jenkins-hbase4:33457] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,33457,1700391200382 already deleted, retry=false 2023-11-19 10:56:11,845 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-19 10:56:11,845 INFO [M:0;jenkins-hbase4:33457] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,33457,1700391200382; zookeeper connection closed. 2023-11-19 10:56:11,845 DEBUG [Listener at localhost/42675-EventThread] zookeeper.ZKWatcher(600): master:33457-0x1000546872b0000, quorum=127.0.0.1:60497, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-19 10:56:11,847 WARN [Listener at localhost/42675] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-11-19 10:56:11,850 INFO [Listener at localhost/42675] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-11-19 10:56:11,957 WARN [BP-671530366-172.31.14.131-1700391196931 heartbeating to localhost/127.0.0.1:36407] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-11-19 10:56:11,957 WARN [BP-671530366-172.31.14.131-1700391196931 heartbeating to localhost/127.0.0.1:36407] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-671530366-172.31.14.131-1700391196931 (Datanode Uuid 8e2fbbcd-c08b-4a03-a33d-a6e859d1463d) service to localhost/127.0.0.1:36407 2023-11-19 10:56:11,959 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/404937f1-f8cc-7c23-e42f-3dd0b22b5057/cluster_0d30b9ac-b1ea-f838-523d-c3632a7c9c3a/dfs/data/data1/current/BP-671530366-172.31.14.131-1700391196931] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-11-19 10:56:11,959 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/404937f1-f8cc-7c23-e42f-3dd0b22b5057/cluster_0d30b9ac-b1ea-f838-523d-c3632a7c9c3a/dfs/data/data2/current/BP-671530366-172.31.14.131-1700391196931] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-11-19 10:56:11,987 INFO [Listener at localhost/42675] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-11-19 10:56:12,133 INFO [Listener at localhost/42675] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-11-19 10:56:12,221 INFO [Listener at localhost/42675] hbase.HBaseTestingUtility(1293): Minicluster is down