2023-03-06 11:53:56,337 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor timeout: 13 mins 2023-03-06 11:53:56,613 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0ddf990b-bc92-2c37-86d7-812d88f764cd 2023-03-06 11:53:56,627 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=1, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-03-06 11:53:56,628 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0ddf990b-bc92-2c37-86d7-812d88f764cd/cluster_aae53e47-46ad-d770-1d84-dd40728b0050, deleteOnExit=true 2023-03-06 11:53:56,628 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-03-06 11:53:56,629 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0ddf990b-bc92-2c37-86d7-812d88f764cd/test.cache.data in system properties and HBase conf 2023-03-06 11:53:56,629 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0ddf990b-bc92-2c37-86d7-812d88f764cd/hadoop.tmp.dir in system properties and HBase conf 2023-03-06 11:53:56,629 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0ddf990b-bc92-2c37-86d7-812d88f764cd/hadoop.log.dir in system properties and HBase conf 2023-03-06 11:53:56,630 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0ddf990b-bc92-2c37-86d7-812d88f764cd/mapreduce.cluster.local.dir in system properties and HBase conf 2023-03-06 11:53:56,630 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0ddf990b-bc92-2c37-86d7-812d88f764cd/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-03-06 11:53:56,630 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-03-06 11:53:56,752 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-03-06 11:53:57,199 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-03-06 11:53:57,204 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0ddf990b-bc92-2c37-86d7-812d88f764cd/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-03-06 11:53:57,204 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0ddf990b-bc92-2c37-86d7-812d88f764cd/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-03-06 11:53:57,205 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0ddf990b-bc92-2c37-86d7-812d88f764cd/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-03-06 11:53:57,205 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0ddf990b-bc92-2c37-86d7-812d88f764cd/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-03-06 11:53:57,205 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0ddf990b-bc92-2c37-86d7-812d88f764cd/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-03-06 11:53:57,206 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0ddf990b-bc92-2c37-86d7-812d88f764cd/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-03-06 11:53:57,206 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0ddf990b-bc92-2c37-86d7-812d88f764cd/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-03-06 11:53:57,206 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0ddf990b-bc92-2c37-86d7-812d88f764cd/dfs.journalnode.edits.dir in system properties and HBase conf 2023-03-06 11:53:57,207 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0ddf990b-bc92-2c37-86d7-812d88f764cd/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-03-06 11:53:57,207 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0ddf990b-bc92-2c37-86d7-812d88f764cd/nfs.dump.dir in system properties and HBase conf 2023-03-06 11:53:57,208 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0ddf990b-bc92-2c37-86d7-812d88f764cd/java.io.tmpdir in system properties and HBase conf 2023-03-06 11:53:57,208 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0ddf990b-bc92-2c37-86d7-812d88f764cd/dfs.journalnode.edits.dir in system properties and HBase conf 2023-03-06 11:53:57,208 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0ddf990b-bc92-2c37-86d7-812d88f764cd/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-03-06 11:53:57,209 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0ddf990b-bc92-2c37-86d7-812d88f764cd/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-03-06 11:53:57,814 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-03-06 11:53:57,818 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-03-06 11:53:58,129 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-03-06 11:53:58,319 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-03-06 11:53:58,339 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-03-06 11:53:58,387 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-03-06 11:53:58,419 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0ddf990b-bc92-2c37-86d7-812d88f764cd/java.io.tmpdir/Jetty_localhost_40831_hdfs____.jqojp8/webapp 2023-03-06 11:53:58,559 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40831 2023-03-06 11:53:58,597 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-03-06 11:53:58,597 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-03-06 11:53:59,027 WARN [Listener at localhost/35391] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-03-06 11:53:59,201 WARN [Listener at localhost/35391] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-03-06 11:53:59,227 WARN [Listener at localhost/35391] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-03-06 11:53:59,235 INFO [Listener at localhost/35391] log.Slf4jLog(67): jetty-6.1.26 2023-03-06 11:53:59,242 INFO [Listener at localhost/35391] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0ddf990b-bc92-2c37-86d7-812d88f764cd/java.io.tmpdir/Jetty_localhost_43447_datanode____k4lnen/webapp 2023-03-06 11:53:59,357 INFO [Listener at localhost/35391] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43447 2023-03-06 11:53:59,729 WARN [Listener at localhost/46717] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-03-06 11:54:00,285 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8d6f01c495271613: Processing first storage report for DS-e3e48754-b6fe-4690-a19e-92bbbfa6d325 from datanode e60524ea-e91b-4b2e-946c-e54e40c52f9e 2023-03-06 11:54:00,286 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8d6f01c495271613: from storage DS-e3e48754-b6fe-4690-a19e-92bbbfa6d325 node DatanodeRegistration(127.0.0.1:37309, datanodeUuid=e60524ea-e91b-4b2e-946c-e54e40c52f9e, infoPort=42427, infoSecurePort=0, ipcPort=46717, storageInfo=lv=-57;cid=testClusterID;nsid=646312232;c=1678103637894), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-03-06 11:54:00,287 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8d6f01c495271613: Processing first storage report for DS-956817b2-786f-4887-a11d-3be65c752143 from datanode e60524ea-e91b-4b2e-946c-e54e40c52f9e 2023-03-06 11:54:00,287 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8d6f01c495271613: from storage DS-956817b2-786f-4887-a11d-3be65c752143 node DatanodeRegistration(127.0.0.1:37309, datanodeUuid=e60524ea-e91b-4b2e-946c-e54e40c52f9e, infoPort=42427, infoSecurePort=0, ipcPort=46717, storageInfo=lv=-57;cid=testClusterID;nsid=646312232;c=1678103637894), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-03-06 11:54:00,359 DEBUG [Listener at localhost/46717] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0ddf990b-bc92-2c37-86d7-812d88f764cd 2023-03-06 11:54:00,429 INFO [Listener at localhost/46717] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0ddf990b-bc92-2c37-86d7-812d88f764cd/cluster_aae53e47-46ad-d770-1d84-dd40728b0050/zookeeper_0, clientPort=62659, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0ddf990b-bc92-2c37-86d7-812d88f764cd/cluster_aae53e47-46ad-d770-1d84-dd40728b0050/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0ddf990b-bc92-2c37-86d7-812d88f764cd/cluster_aae53e47-46ad-d770-1d84-dd40728b0050/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-03-06 11:54:00,444 INFO [Listener at localhost/46717] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=62659 2023-03-06 11:54:00,455 INFO [Listener at localhost/46717] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-06 11:54:00,458 INFO [Listener at localhost/46717] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-06 11:54:01,116 INFO [Listener at localhost/46717] util.FSUtils(471): Created version file at hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc with version=8 2023-03-06 11:54:01,116 INFO [Listener at localhost/46717] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/hbase-staging 2023-03-06 11:54:01,433 INFO [Listener at localhost/46717] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-03-06 11:54:01,915 INFO [Listener at localhost/46717] client.ConnectionUtils(127): master/jenkins-hbase5:0 server-side Connection retries=3 2023-03-06 11:54:01,948 INFO [Listener at localhost/46717] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-03-06 11:54:01,948 INFO [Listener at localhost/46717] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-03-06 11:54:01,948 INFO [Listener at localhost/46717] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-03-06 11:54:01,949 INFO [Listener at localhost/46717] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-03-06 11:54:01,949 INFO [Listener at localhost/46717] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-03-06 11:54:02,094 INFO [Listener at localhost/46717] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-03-06 11:54:02,177 DEBUG [Listener at localhost/46717] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-03-06 11:54:02,275 INFO [Listener at localhost/46717] ipc.NettyRpcServer(120): Bind to /172.31.10.131:36301 2023-03-06 11:54:02,285 INFO [Listener at localhost/46717] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-06 11:54:02,287 INFO [Listener at localhost/46717] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-06 11:54:02,308 INFO [Listener at localhost/46717] zookeeper.RecoverableZooKeeper(93): Process identifier=master:36301 connecting to ZooKeeper ensemble=127.0.0.1:62659 2023-03-06 11:54:02,348 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:363010x0, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-03-06 11:54:02,351 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:36301-0x101162a25110000 connected 2023-03-06 11:54:02,382 DEBUG [Listener at localhost/46717] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-03-06 11:54:02,383 DEBUG [Listener at localhost/46717] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-03-06 11:54:02,386 DEBUG [Listener at localhost/46717] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-03-06 11:54:02,398 DEBUG [Listener at localhost/46717] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36301 2023-03-06 11:54:02,399 DEBUG [Listener at localhost/46717] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36301 2023-03-06 11:54:02,399 DEBUG [Listener at localhost/46717] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36301 2023-03-06 11:54:02,403 DEBUG [Listener at localhost/46717] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36301 2023-03-06 11:54:02,404 DEBUG [Listener at localhost/46717] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36301 2023-03-06 11:54:02,410 INFO [Listener at localhost/46717] master.HMaster(444): hbase.rootdir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc, hbase.cluster.distributed=false 2023-03-06 11:54:02,480 INFO [Listener at localhost/46717] client.ConnectionUtils(127): regionserver/jenkins-hbase5:0 server-side Connection retries=3 2023-03-06 11:54:02,480 INFO [Listener at localhost/46717] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-03-06 11:54:02,481 INFO [Listener at localhost/46717] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-03-06 11:54:02,481 INFO [Listener at localhost/46717] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-03-06 11:54:02,481 INFO [Listener at localhost/46717] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-03-06 11:54:02,481 INFO [Listener at localhost/46717] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-03-06 11:54:02,486 INFO [Listener at localhost/46717] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-03-06 11:54:02,489 INFO [Listener at localhost/46717] ipc.NettyRpcServer(120): Bind to /172.31.10.131:42547 2023-03-06 11:54:02,491 INFO [Listener at localhost/46717] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-03-06 11:54:02,497 DEBUG [Listener at localhost/46717] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-03-06 11:54:02,498 INFO [Listener at localhost/46717] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-06 11:54:02,501 INFO [Listener at localhost/46717] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-06 11:54:02,502 INFO [Listener at localhost/46717] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42547 connecting to ZooKeeper ensemble=127.0.0.1:62659 2023-03-06 11:54:02,506 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:425470x0, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-03-06 11:54:02,507 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:42547-0x101162a25110001 connected 2023-03-06 11:54:02,507 DEBUG [Listener at localhost/46717] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-03-06 11:54:02,508 DEBUG [Listener at localhost/46717] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-03-06 11:54:02,509 DEBUG [Listener at localhost/46717] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-03-06 11:54:02,509 DEBUG [Listener at localhost/46717] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42547 2023-03-06 11:54:02,510 DEBUG [Listener at localhost/46717] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42547 2023-03-06 11:54:02,512 DEBUG [Listener at localhost/46717] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42547 2023-03-06 11:54:02,512 DEBUG [Listener at localhost/46717] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42547 2023-03-06 11:54:02,513 DEBUG [Listener at localhost/46717] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42547 2023-03-06 11:54:02,514 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase5.apache.org,36301,1678103641259 2023-03-06 11:54:02,525 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-03-06 11:54:02,526 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase5.apache.org,36301,1678103641259 2023-03-06 11:54:02,544 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-03-06 11:54:02,544 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-03-06 11:54:02,544 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-06 11:54:02,545 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-03-06 11:54:02,546 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase5.apache.org,36301,1678103641259 from backup master directory 2023-03-06 11:54:02,546 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-03-06 11:54:02,549 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase5.apache.org,36301,1678103641259 2023-03-06 11:54:02,549 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-03-06 11:54:02,550 WARN [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-03-06 11:54:02,550 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase5.apache.org,36301,1678103641259 2023-03-06 11:54:02,553 INFO [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-03-06 11:54:02,554 INFO [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-03-06 11:54:02,640 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/hbase.id with ID: f0ccc252-15d2-40b4-8588-48d580a1e2f9 2023-03-06 11:54:02,683 INFO [master/jenkins-hbase5:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-06 11:54:02,701 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-06 11:54:02,744 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x1730ab8c to 127.0.0.1:62659 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-06 11:54:02,776 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@27045e06, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-06 11:54:02,799 INFO [master/jenkins-hbase5:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-03-06 11:54:02,800 INFO [master/jenkins-hbase5:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-03-06 11:54:02,817 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-03-06 11:54:02,817 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-03-06 11:54:02,819 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-03-06 11:54:02,823 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-03-06 11:54:02,824 INFO [master/jenkins-hbase5:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-03-06 11:54:02,859 INFO [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/MasterData/data/master/store-tmp 2023-03-06 11:54:02,888 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-06 11:54:02,888 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-03-06 11:54:02,888 INFO [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-06 11:54:02,888 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-06 11:54:02,888 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-03-06 11:54:02,889 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-06 11:54:02,889 INFO [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-06 11:54:02,889 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-03-06 11:54:02,890 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/MasterData/WALs/jenkins-hbase5.apache.org,36301,1678103641259 2023-03-06 11:54:02,914 INFO [master/jenkins-hbase5:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase5.apache.org%2C36301%2C1678103641259, suffix=, logDir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/MasterData/WALs/jenkins-hbase5.apache.org,36301,1678103641259, archiveDir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/MasterData/oldWALs, maxLogs=10 2023-03-06 11:54:02,974 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37309,DS-e3e48754-b6fe-4690-a19e-92bbbfa6d325,DISK] 2023-03-06 11:54:02,982 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-03-06 11:54:03,048 INFO [master/jenkins-hbase5:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/MasterData/WALs/jenkins-hbase5.apache.org,36301,1678103641259/jenkins-hbase5.apache.org%2C36301%2C1678103641259.1678103642924 2023-03-06 11:54:03,049 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37309,DS-e3e48754-b6fe-4690-a19e-92bbbfa6d325,DISK]] 2023-03-06 11:54:03,049 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-03-06 11:54:03,050 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-06 11:54:03,053 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-03-06 11:54:03,054 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-03-06 11:54:03,115 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-03-06 11:54:03,122 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-03-06 11:54:03,148 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-03-06 11:54:03,161 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-06 11:54:03,169 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-03-06 11:54:03,171 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-03-06 11:54:03,190 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-03-06 11:54:03,195 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-06 11:54:03,197 INFO [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61019974, jitterRate=-0.09073153138160706}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-06 11:54:03,197 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-03-06 11:54:03,199 INFO [master/jenkins-hbase5:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-03-06 11:54:03,218 INFO [master/jenkins-hbase5:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-03-06 11:54:03,218 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-03-06 11:54:03,221 INFO [master/jenkins-hbase5:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-03-06 11:54:03,223 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-03-06 11:54:03,258 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 35 msec 2023-03-06 11:54:03,258 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-03-06 11:54:03,287 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-03-06 11:54:03,293 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-03-06 11:54:03,318 INFO [master/jenkins-hbase5:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-03-06 11:54:03,321 INFO [master/jenkins-hbase5:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-03-06 11:54:03,324 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-03-06 11:54:03,329 INFO [master/jenkins-hbase5:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-03-06 11:54:03,333 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-03-06 11:54:03,335 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-06 11:54:03,337 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-03-06 11:54:03,337 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-03-06 11:54:03,350 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-03-06 11:54:03,354 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-03-06 11:54:03,354 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-03-06 11:54:03,354 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-06 11:54:03,355 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase5.apache.org,36301,1678103641259, sessionid=0x101162a25110000, setting cluster-up flag (Was=false) 2023-03-06 11:54:03,371 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-06 11:54:03,377 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-03-06 11:54:03,378 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase5.apache.org,36301,1678103641259 2023-03-06 11:54:03,382 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-06 11:54:03,391 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-03-06 11:54:03,392 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase5.apache.org,36301,1678103641259 2023-03-06 11:54:03,394 WARN [master/jenkins-hbase5:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.hbase-snapshot/.tmp 2023-03-06 11:54:03,417 INFO [RS:0;jenkins-hbase5:42547] regionserver.HRegionServer(952): ClusterId : f0ccc252-15d2-40b4-8588-48d580a1e2f9 2023-03-06 11:54:03,422 DEBUG [RS:0;jenkins-hbase5:42547] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-03-06 11:54:03,428 DEBUG [RS:0;jenkins-hbase5:42547] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-03-06 11:54:03,429 DEBUG [RS:0;jenkins-hbase5:42547] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-03-06 11:54:03,432 DEBUG [RS:0;jenkins-hbase5:42547] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-03-06 11:54:03,433 DEBUG [RS:0;jenkins-hbase5:42547] zookeeper.ReadOnlyZKClient(139): Connect 0x6c8db8b8 to 127.0.0.1:62659 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-06 11:54:03,439 DEBUG [RS:0;jenkins-hbase5:42547] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@624a5b59, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-06 11:54:03,440 DEBUG [RS:0;jenkins-hbase5:42547] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6675d3c8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase5.apache.org/172.31.10.131:0 2023-03-06 11:54:03,463 DEBUG [RS:0;jenkins-hbase5:42547] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase5:42547 2023-03-06 11:54:03,466 INFO [RS:0;jenkins-hbase5:42547] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-03-06 11:54:03,466 INFO [RS:0;jenkins-hbase5:42547] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-03-06 11:54:03,466 DEBUG [RS:0;jenkins-hbase5:42547] regionserver.HRegionServer(1023): About to register with Master. 2023-03-06 11:54:03,469 INFO [RS:0;jenkins-hbase5:42547] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase5.apache.org,36301,1678103641259 with isa=jenkins-hbase5.apache.org/172.31.10.131:42547, startcode=1678103642479 2023-03-06 11:54:03,490 DEBUG [RS:0;jenkins-hbase5:42547] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-03-06 11:54:03,529 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-03-06 11:54:03,543 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase5:0, corePoolSize=5, maxPoolSize=5 2023-03-06 11:54:03,543 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase5:0, corePoolSize=5, maxPoolSize=5 2023-03-06 11:54:03,543 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase5:0, corePoolSize=5, maxPoolSize=5 2023-03-06 11:54:03,543 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase5:0, corePoolSize=5, maxPoolSize=5 2023-03-06 11:54:03,544 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase5:0, corePoolSize=10, maxPoolSize=10 2023-03-06 11:54:03,544 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-03-06 11:54:03,544 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase5:0, corePoolSize=2, maxPoolSize=2 2023-03-06 11:54:03,544 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-03-06 11:54:03,550 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1678103673550 2023-03-06 11:54:03,553 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-03-06 11:54:03,556 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-03-06 11:54:03,556 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-03-06 11:54:03,559 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:51363, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-03-06 11:54:03,569 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-03-06 11:54:03,569 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-03-06 11:54:03,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:577) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-03-06 11:54:03,579 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-03-06 11:54:03,579 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-03-06 11:54:03,579 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-03-06 11:54:03,580 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-03-06 11:54:03,594 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-03-06 11:54:03,597 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-03-06 11:54:03,599 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-03-06 11:54:03,599 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-03-06 11:54:03,603 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-03-06 11:54:03,604 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-03-06 11:54:03,611 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.large.0-1678103643609,5,FailOnTimeoutGroup] 2023-03-06 11:54:03,614 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.small.0-1678103643611,5,FailOnTimeoutGroup] 2023-03-06 11:54:03,614 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-03-06 11:54:03,614 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-03-06 11:54:03,617 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-03-06 11:54:03,618 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-03-06 11:54:03,623 DEBUG [RS:0;jenkins-hbase5:42547] regionserver.HRegionServer(2829): Master is not running yet 2023-03-06 11:54:03,623 WARN [RS:0;jenkins-hbase5:42547] regionserver.HRegionServer(1031): reportForDuty failed; sleeping 100 ms and then retrying. 2023-03-06 11:54:03,724 INFO [RS:0;jenkins-hbase5:42547] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase5.apache.org,36301,1678103641259 with isa=jenkins-hbase5.apache.org/172.31.10.131:42547, startcode=1678103642479 2023-03-06 11:54:03,732 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.ServerManager(394): Registering regionserver=jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:03,738 DEBUG [RS:0;jenkins-hbase5:42547] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc 2023-03-06 11:54:03,738 DEBUG [RS:0;jenkins-hbase5:42547] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:35391 2023-03-06 11:54:03,738 DEBUG [RS:0;jenkins-hbase5:42547] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-03-06 11:54:03,744 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-03-06 11:54:03,745 DEBUG [RS:0;jenkins-hbase5:42547] zookeeper.ZKUtil(162): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:03,745 WARN [RS:0;jenkins-hbase5:42547] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-03-06 11:54:03,746 INFO [RS:0;jenkins-hbase5:42547] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-03-06 11:54:03,746 DEBUG [RS:0;jenkins-hbase5:42547] regionserver.HRegionServer(1947): logDir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/WALs/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:03,747 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase5.apache.org,42547,1678103642479] 2023-03-06 11:54:03,756 DEBUG [RS:0;jenkins-hbase5:42547] zookeeper.ZKUtil(162): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:03,766 DEBUG [RS:0;jenkins-hbase5:42547] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-03-06 11:54:03,774 INFO [RS:0;jenkins-hbase5:42547] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-03-06 11:54:03,793 INFO [RS:0;jenkins-hbase5:42547] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-03-06 11:54:03,796 INFO [RS:0;jenkins-hbase5:42547] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-06 11:54:03,797 INFO [RS:0;jenkins-hbase5:42547] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-06 11:54:03,798 INFO [RS:0;jenkins-hbase5:42547] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-03-06 11:54:03,805 INFO [RS:0;jenkins-hbase5:42547] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=100, unit=MILLISECONDS is enabled. 2023-03-06 11:54:03,805 DEBUG [RS:0;jenkins-hbase5:42547] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-03-06 11:54:03,805 DEBUG [RS:0;jenkins-hbase5:42547] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-03-06 11:54:03,805 DEBUG [RS:0;jenkins-hbase5:42547] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-03-06 11:54:03,806 DEBUG [RS:0;jenkins-hbase5:42547] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-03-06 11:54:03,806 DEBUG [RS:0;jenkins-hbase5:42547] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-03-06 11:54:03,806 DEBUG [RS:0;jenkins-hbase5:42547] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase5:0, corePoolSize=2, maxPoolSize=2 2023-03-06 11:54:03,806 DEBUG [RS:0;jenkins-hbase5:42547] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-03-06 11:54:03,806 DEBUG [RS:0;jenkins-hbase5:42547] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-03-06 11:54:03,806 DEBUG [RS:0;jenkins-hbase5:42547] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-03-06 11:54:03,806 DEBUG [RS:0;jenkins-hbase5:42547] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-03-06 11:54:03,807 INFO [RS:0;jenkins-hbase5:42547] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-03-06 11:54:03,807 INFO [RS:0;jenkins-hbase5:42547] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-03-06 11:54:03,807 INFO [RS:0;jenkins-hbase5:42547] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-03-06 11:54:03,823 INFO [RS:0;jenkins-hbase5:42547] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-03-06 11:54:03,825 INFO [RS:0;jenkins-hbase5:42547] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,42547,1678103642479-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-03-06 11:54:03,841 INFO [RS:0;jenkins-hbase5:42547] regionserver.Replication(203): jenkins-hbase5.apache.org,42547,1678103642479 started 2023-03-06 11:54:03,841 INFO [RS:0;jenkins-hbase5:42547] regionserver.HRegionServer(1638): Serving as jenkins-hbase5.apache.org,42547,1678103642479, RpcServer on jenkins-hbase5.apache.org/172.31.10.131:42547, sessionid=0x101162a25110001 2023-03-06 11:54:03,841 DEBUG [RS:0;jenkins-hbase5:42547] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-03-06 11:54:03,841 DEBUG [RS:0;jenkins-hbase5:42547] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:03,841 DEBUG [RS:0;jenkins-hbase5:42547] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase5.apache.org,42547,1678103642479' 2023-03-06 11:54:03,841 DEBUG [RS:0;jenkins-hbase5:42547] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:03,842 DEBUG [RS:0;jenkins-hbase5:42547] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:03,843 DEBUG [RS:0;jenkins-hbase5:42547] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-03-06 11:54:03,843 DEBUG [RS:0;jenkins-hbase5:42547] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-03-06 11:54:03,843 DEBUG [RS:0;jenkins-hbase5:42547] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:03,843 DEBUG [RS:0;jenkins-hbase5:42547] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase5.apache.org,42547,1678103642479' 2023-03-06 11:54:03,843 DEBUG [RS:0;jenkins-hbase5:42547] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-03-06 11:54:03,843 DEBUG [RS:0;jenkins-hbase5:42547] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-03-06 11:54:03,844 DEBUG [RS:0;jenkins-hbase5:42547] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-03-06 11:54:03,844 INFO [RS:0;jenkins-hbase5:42547] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-03-06 11:54:03,844 INFO [RS:0;jenkins-hbase5:42547] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-03-06 11:54:03,955 INFO [RS:0;jenkins-hbase5:42547] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase5.apache.org%2C42547%2C1678103642479, suffix=, logDir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/WALs/jenkins-hbase5.apache.org,42547,1678103642479, archiveDir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/oldWALs, maxLogs=32 2023-03-06 11:54:03,974 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37309,DS-e3e48754-b6fe-4690-a19e-92bbbfa6d325,DISK] 2023-03-06 11:54:03,978 INFO [RS:0;jenkins-hbase5:42547] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/WALs/jenkins-hbase5.apache.org,42547,1678103642479/jenkins-hbase5.apache.org%2C42547%2C1678103642479.1678103643957 2023-03-06 11:54:03,978 DEBUG [RS:0;jenkins-hbase5:42547] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37309,DS-e3e48754-b6fe-4690-a19e-92bbbfa6d325,DISK]] 2023-03-06 11:54:04,023 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-03-06 11:54:04,024 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-03-06 11:54:04,024 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc 2023-03-06 11:54:04,046 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-06 11:54:04,049 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-03-06 11:54:04,052 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/hbase/meta/1588230740/info 2023-03-06 11:54:04,053 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-03-06 11:54:04,054 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-06 11:54:04,054 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-03-06 11:54:04,057 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/hbase/meta/1588230740/rep_barrier 2023-03-06 11:54:04,057 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-03-06 11:54:04,058 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-06 11:54:04,058 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-03-06 11:54:04,060 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/hbase/meta/1588230740/table 2023-03-06 11:54:04,061 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-03-06 11:54:04,062 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-06 11:54:04,064 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/hbase/meta/1588230740 2023-03-06 11:54:04,065 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/hbase/meta/1588230740 2023-03-06 11:54:04,069 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-03-06 11:54:04,071 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-03-06 11:54:04,075 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-06 11:54:04,077 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66940302, jitterRate=-0.0025117695331573486}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-03-06 11:54:04,077 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-03-06 11:54:04,077 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-03-06 11:54:04,077 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-03-06 11:54:04,077 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-03-06 11:54:04,077 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-03-06 11:54:04,077 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-03-06 11:54:04,078 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-03-06 11:54:04,079 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-03-06 11:54:04,086 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-03-06 11:54:04,086 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-03-06 11:54:04,094 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-03-06 11:54:04,111 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-03-06 11:54:04,116 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-03-06 11:54:04,268 DEBUG [jenkins-hbase5:36301] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-03-06 11:54:04,272 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase5.apache.org,42547,1678103642479, state=OPENING 2023-03-06 11:54:04,281 DEBUG [PEWorker-5] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-03-06 11:54:04,283 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-06 11:54:04,285 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-03-06 11:54:04,287 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase5.apache.org,42547,1678103642479}] 2023-03-06 11:54:04,472 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:04,475 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-03-06 11:54:04,479 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:53592, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-03-06 11:54:04,492 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-03-06 11:54:04,492 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-03-06 11:54:04,496 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase5.apache.org%2C42547%2C1678103642479.meta, suffix=.meta, logDir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/WALs/jenkins-hbase5.apache.org,42547,1678103642479, archiveDir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/oldWALs, maxLogs=32 2023-03-06 11:54:04,515 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37309,DS-e3e48754-b6fe-4690-a19e-92bbbfa6d325,DISK] 2023-03-06 11:54:04,520 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/WALs/jenkins-hbase5.apache.org,42547,1678103642479/jenkins-hbase5.apache.org%2C42547%2C1678103642479.meta.1678103644497.meta 2023-03-06 11:54:04,521 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37309,DS-e3e48754-b6fe-4690-a19e-92bbbfa6d325,DISK]] 2023-03-06 11:54:04,521 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-03-06 11:54:04,523 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-03-06 11:54:04,541 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-03-06 11:54:04,547 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-03-06 11:54:04,553 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-03-06 11:54:04,553 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-06 11:54:04,554 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-03-06 11:54:04,554 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-03-06 11:54:04,557 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-03-06 11:54:04,559 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/hbase/meta/1588230740/info 2023-03-06 11:54:04,559 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/hbase/meta/1588230740/info 2023-03-06 11:54:04,560 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-03-06 11:54:04,561 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-06 11:54:04,561 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-03-06 11:54:04,563 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/hbase/meta/1588230740/rep_barrier 2023-03-06 11:54:04,563 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/hbase/meta/1588230740/rep_barrier 2023-03-06 11:54:04,566 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-03-06 11:54:04,567 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-06 11:54:04,567 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-03-06 11:54:04,569 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/hbase/meta/1588230740/table 2023-03-06 11:54:04,569 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/hbase/meta/1588230740/table 2023-03-06 11:54:04,570 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-03-06 11:54:04,571 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-06 11:54:04,572 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/hbase/meta/1588230740 2023-03-06 11:54:04,575 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/hbase/meta/1588230740 2023-03-06 11:54:04,579 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-03-06 11:54:04,585 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-03-06 11:54:04,587 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58744180, jitterRate=-0.12464350461959839}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-03-06 11:54:04,587 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-03-06 11:54:04,597 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1678103644464 2023-03-06 11:54:04,613 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-03-06 11:54:04,614 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-03-06 11:54:04,615 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase5.apache.org,42547,1678103642479, state=OPEN 2023-03-06 11:54:04,618 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-03-06 11:54:04,618 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-03-06 11:54:04,623 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-03-06 11:54:04,623 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase5.apache.org,42547,1678103642479 in 331 msec 2023-03-06 11:54:04,628 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-03-06 11:54:04,628 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 530 msec 2023-03-06 11:54:04,633 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.1820 sec 2023-03-06 11:54:04,633 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1678103644633, completionTime=-1 2023-03-06 11:54:04,634 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-03-06 11:54:04,634 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-03-06 11:54:04,700 DEBUG [hconnection-0x6a04a222-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-06 11:54:04,704 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:53596, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-06 11:54:04,723 INFO [master/jenkins-hbase5:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=1 2023-03-06 11:54:04,723 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1678103704723 2023-03-06 11:54:04,723 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1678103764723 2023-03-06 11:54:04,723 INFO [master/jenkins-hbase5:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 88 msec 2023-03-06 11:54:04,749 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,36301,1678103641259-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-03-06 11:54:04,750 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,36301,1678103641259-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-03-06 11:54:04,750 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,36301,1678103641259-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-03-06 11:54:04,752 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase5:36301, period=300000, unit=MILLISECONDS is enabled. 2023-03-06 11:54:04,752 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-03-06 11:54:04,765 DEBUG [master/jenkins-hbase5:0.Chore.1] janitor.CatalogJanitor(175): 2023-03-06 11:54:04,770 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-03-06 11:54:04,771 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-03-06 11:54:04,781 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-03-06 11:54:04,784 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-03-06 11:54:04,787 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-06 11:54:04,813 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/hbase/namespace/c4fb3434a20d7810ad775cbbe802313a 2023-03-06 11:54:04,816 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/hbase/namespace/c4fb3434a20d7810ad775cbbe802313a empty. 2023-03-06 11:54:04,817 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/hbase/namespace/c4fb3434a20d7810ad775cbbe802313a 2023-03-06 11:54:04,817 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-03-06 11:54:05,245 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-03-06 11:54:05,248 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => c4fb3434a20d7810ad775cbbe802313a, NAME => 'hbase:namespace,,1678103644771.c4fb3434a20d7810ad775cbbe802313a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp 2023-03-06 11:54:05,661 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1678103644771.c4fb3434a20d7810ad775cbbe802313a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-06 11:54:05,661 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing c4fb3434a20d7810ad775cbbe802313a, disabling compactions & flushes 2023-03-06 11:54:05,661 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1678103644771.c4fb3434a20d7810ad775cbbe802313a. 2023-03-06 11:54:05,661 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1678103644771.c4fb3434a20d7810ad775cbbe802313a. 2023-03-06 11:54:05,662 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1678103644771.c4fb3434a20d7810ad775cbbe802313a. after waiting 1 ms 2023-03-06 11:54:05,662 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1678103644771.c4fb3434a20d7810ad775cbbe802313a. 2023-03-06 11:54:05,662 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1678103644771.c4fb3434a20d7810ad775cbbe802313a. 2023-03-06 11:54:05,662 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for c4fb3434a20d7810ad775cbbe802313a: 2023-03-06 11:54:05,667 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-03-06 11:54:05,683 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1678103644771.c4fb3434a20d7810ad775cbbe802313a.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1678103645670"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678103645670"}]},"ts":"1678103645670"} 2023-03-06 11:54:05,710 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-06 11:54:05,712 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-06 11:54:05,716 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678103645712"}]},"ts":"1678103645712"} 2023-03-06 11:54:05,720 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-03-06 11:54:05,731 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c4fb3434a20d7810ad775cbbe802313a, ASSIGN}] 2023-03-06 11:54:05,734 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c4fb3434a20d7810ad775cbbe802313a, ASSIGN 2023-03-06 11:54:05,736 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=c4fb3434a20d7810ad775cbbe802313a, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,42547,1678103642479; forceNewPlan=false, retain=false 2023-03-06 11:54:05,886 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c4fb3434a20d7810ad775cbbe802313a, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:05,887 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1678103644771.c4fb3434a20d7810ad775cbbe802313a.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1678103645886"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678103645886"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678103645886"}]},"ts":"1678103645886"} 2023-03-06 11:54:05,891 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure c4fb3434a20d7810ad775cbbe802313a, server=jenkins-hbase5.apache.org,42547,1678103642479}] 2023-03-06 11:54:06,051 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1678103644771.c4fb3434a20d7810ad775cbbe802313a. 2023-03-06 11:54:06,052 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c4fb3434a20d7810ad775cbbe802313a, NAME => 'hbase:namespace,,1678103644771.c4fb3434a20d7810ad775cbbe802313a.', STARTKEY => '', ENDKEY => ''} 2023-03-06 11:54:06,053 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace c4fb3434a20d7810ad775cbbe802313a 2023-03-06 11:54:06,053 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1678103644771.c4fb3434a20d7810ad775cbbe802313a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-06 11:54:06,053 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for c4fb3434a20d7810ad775cbbe802313a 2023-03-06 11:54:06,053 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for c4fb3434a20d7810ad775cbbe802313a 2023-03-06 11:54:06,055 INFO [StoreOpener-c4fb3434a20d7810ad775cbbe802313a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region c4fb3434a20d7810ad775cbbe802313a 2023-03-06 11:54:06,057 DEBUG [StoreOpener-c4fb3434a20d7810ad775cbbe802313a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/hbase/namespace/c4fb3434a20d7810ad775cbbe802313a/info 2023-03-06 11:54:06,057 DEBUG [StoreOpener-c4fb3434a20d7810ad775cbbe802313a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/hbase/namespace/c4fb3434a20d7810ad775cbbe802313a/info 2023-03-06 11:54:06,058 INFO [StoreOpener-c4fb3434a20d7810ad775cbbe802313a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c4fb3434a20d7810ad775cbbe802313a columnFamilyName info 2023-03-06 11:54:06,059 INFO [StoreOpener-c4fb3434a20d7810ad775cbbe802313a-1] regionserver.HStore(310): Store=c4fb3434a20d7810ad775cbbe802313a/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-06 11:54:06,060 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/hbase/namespace/c4fb3434a20d7810ad775cbbe802313a 2023-03-06 11:54:06,061 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/hbase/namespace/c4fb3434a20d7810ad775cbbe802313a 2023-03-06 11:54:06,065 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for c4fb3434a20d7810ad775cbbe802313a 2023-03-06 11:54:06,069 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/hbase/namespace/c4fb3434a20d7810ad775cbbe802313a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-06 11:54:06,070 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened c4fb3434a20d7810ad775cbbe802313a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62341454, jitterRate=-0.07103994488716125}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-06 11:54:06,070 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for c4fb3434a20d7810ad775cbbe802313a: 2023-03-06 11:54:06,072 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1678103644771.c4fb3434a20d7810ad775cbbe802313a., pid=6, masterSystemTime=1678103646044 2023-03-06 11:54:06,076 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1678103644771.c4fb3434a20d7810ad775cbbe802313a. 2023-03-06 11:54:06,076 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1678103644771.c4fb3434a20d7810ad775cbbe802313a. 2023-03-06 11:54:06,077 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c4fb3434a20d7810ad775cbbe802313a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:06,077 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1678103644771.c4fb3434a20d7810ad775cbbe802313a.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1678103646076"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678103646076"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678103646076"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678103646076"}]},"ts":"1678103646076"} 2023-03-06 11:54:06,083 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-03-06 11:54:06,084 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure c4fb3434a20d7810ad775cbbe802313a, server=jenkins-hbase5.apache.org,42547,1678103642479 in 189 msec 2023-03-06 11:54:06,087 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-03-06 11:54:06,088 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=c4fb3434a20d7810ad775cbbe802313a, ASSIGN in 353 msec 2023-03-06 11:54:06,089 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-06 11:54:06,089 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678103646089"}]},"ts":"1678103646089"} 2023-03-06 11:54:06,092 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-03-06 11:54:06,095 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-03-06 11:54:06,097 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 1.3230 sec 2023-03-06 11:54:06,185 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-03-06 11:54:06,186 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-03-06 11:54:06,187 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-06 11:54:06,231 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-03-06 11:54:06,252 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-03-06 11:54:06,258 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 40 msec 2023-03-06 11:54:06,264 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-03-06 11:54:06,274 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-03-06 11:54:06,280 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 15 msec 2023-03-06 11:54:06,289 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-03-06 11:54:06,293 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-03-06 11:54:06,295 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.745sec 2023-03-06 11:54:06,296 INFO [master/jenkins-hbase5:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-03-06 11:54:06,298 INFO [master/jenkins-hbase5:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-03-06 11:54:06,298 INFO [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-03-06 11:54:06,299 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,36301,1678103641259-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-03-06 11:54:06,300 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,36301,1678103641259-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-03-06 11:54:06,311 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-03-06 11:54:06,327 DEBUG [Listener at localhost/46717] zookeeper.ReadOnlyZKClient(139): Connect 0x5759ba4d to 127.0.0.1:62659 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-06 11:54:06,331 DEBUG [Listener at localhost/46717] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@449b853a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-06 11:54:06,344 DEBUG [hconnection-0x684e302b-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-06 11:54:06,355 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:53604, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-06 11:54:06,365 INFO [Listener at localhost/46717] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase5.apache.org,36301,1678103641259 2023-03-06 11:54:06,366 DEBUG [Listener at localhost/46717] zookeeper.ReadOnlyZKClient(139): Connect 0x47652242 to 127.0.0.1:62659 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-06 11:54:06,370 DEBUG [Listener at localhost/46717] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@143ae868, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-06 11:54:06,371 INFO [Listener at localhost/46717] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-06 11:54:06,392 INFO [Listener at localhost/46717] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=209, OpenFileDescriptor=475, MaxFileDescriptor=60000, SystemLoadAverage=351, ProcessCount=160, AvailableMemoryMB=10270 2023-03-06 11:54:06,403 DEBUG [Listener at localhost/46717] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-06 11:54:06,406 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:49302, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-06 11:54:06,419 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.HMaster$4(2112): Client=jenkins//172.31.10.131 create 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-06 11:54:06,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:06,423 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_PRE_OPERATION 2023-03-06 11:54:06,425 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-06 11:54:06,427 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(697): Client=jenkins//172.31.10.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthly" procId is: 9 2023-03-06 11:54:06,428 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4 2023-03-06 11:54:06,430 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4 empty. 2023-03-06 11:54:06,432 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4 2023-03-06 11:54:06,432 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthly regions 2023-03-06 11:54:06,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-03-06 11:54:06,457 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-03-06 11:54:06,464 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(7675): creating {ENCODED => 53b32d3064df8c51ca0fd7bd317a96a4, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp 2023-03-06 11:54:06,479 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-06 11:54:06,479 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1604): Closing 53b32d3064df8c51ca0fd7bd317a96a4, disabling compactions & flushes 2023-03-06 11:54:06,479 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4. 2023-03-06 11:54:06,479 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4. 2023-03-06 11:54:06,479 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4. after waiting 0 ms 2023-03-06 11:54:06,479 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4. 2023-03-06 11:54:06,479 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4. 2023-03-06 11:54:06,479 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1558): Region close journal for 53b32d3064df8c51ca0fd7bd317a96a4: 2023-03-06 11:54:06,485 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ADD_TO_META 2023-03-06 11:54:06,487 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1678103646486"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678103646486"}]},"ts":"1678103646486"} 2023-03-06 11:54:06,489 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-06 11:54:06,491 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-06 11:54:06,491 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678103646491"}]},"ts":"1678103646491"} 2023-03-06 11:54:06,494 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLING in hbase:meta 2023-03-06 11:54:06,500 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=53b32d3064df8c51ca0fd7bd317a96a4, ASSIGN}] 2023-03-06 11:54:06,503 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=53b32d3064df8c51ca0fd7bd317a96a4, ASSIGN 2023-03-06 11:54:06,507 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=53b32d3064df8c51ca0fd7bd317a96a4, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,42547,1678103642479; forceNewPlan=false, retain=false 2023-03-06 11:54:06,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-03-06 11:54:06,658 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=53b32d3064df8c51ca0fd7bd317a96a4, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:06,658 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1678103646658"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678103646658"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678103646658"}]},"ts":"1678103646658"} 2023-03-06 11:54:06,662 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 53b32d3064df8c51ca0fd7bd317a96a4, server=jenkins-hbase5.apache.org,42547,1678103642479}] 2023-03-06 11:54:06,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-03-06 11:54:06,821 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4. 2023-03-06 11:54:06,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 53b32d3064df8c51ca0fd7bd317a96a4, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4.', STARTKEY => '', ENDKEY => ''} 2023-03-06 11:54:06,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 53b32d3064df8c51ca0fd7bd317a96a4 2023-03-06 11:54:06,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-06 11:54:06,822 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 53b32d3064df8c51ca0fd7bd317a96a4 2023-03-06 11:54:06,822 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 53b32d3064df8c51ca0fd7bd317a96a4 2023-03-06 11:54:06,825 INFO [StoreOpener-53b32d3064df8c51ca0fd7bd317a96a4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 53b32d3064df8c51ca0fd7bd317a96a4 2023-03-06 11:54:06,827 DEBUG [StoreOpener-53b32d3064df8c51ca0fd7bd317a96a4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1 2023-03-06 11:54:06,827 DEBUG [StoreOpener-53b32d3064df8c51ca0fd7bd317a96a4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1 2023-03-06 11:54:06,830 INFO [StoreOpener-53b32d3064df8c51ca0fd7bd317a96a4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 53b32d3064df8c51ca0fd7bd317a96a4 columnFamilyName family1 2023-03-06 11:54:06,833 INFO [StoreOpener-53b32d3064df8c51ca0fd7bd317a96a4-1] regionserver.HStore(310): Store=53b32d3064df8c51ca0fd7bd317a96a4/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-06 11:54:06,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4 2023-03-06 11:54:06,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4 2023-03-06 11:54:06,842 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 53b32d3064df8c51ca0fd7bd317a96a4 2023-03-06 11:54:06,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-06 11:54:06,850 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 53b32d3064df8c51ca0fd7bd317a96a4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72309872, jitterRate=0.07750105857849121}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-06 11:54:06,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 53b32d3064df8c51ca0fd7bd317a96a4: 2023-03-06 11:54:06,852 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4., pid=11, masterSystemTime=1678103646815 2023-03-06 11:54:06,855 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4. 2023-03-06 11:54:06,855 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4. 2023-03-06 11:54:06,856 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=53b32d3064df8c51ca0fd7bd317a96a4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:06,857 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1678103646856"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678103646856"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678103646856"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678103646856"}]},"ts":"1678103646856"} 2023-03-06 11:54:06,865 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-03-06 11:54:06,865 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 53b32d3064df8c51ca0fd7bd317a96a4, server=jenkins-hbase5.apache.org,42547,1678103642479 in 198 msec 2023-03-06 11:54:06,869 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-03-06 11:54:06,869 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=53b32d3064df8c51ca0fd7bd317a96a4, ASSIGN in 365 msec 2023-03-06 11:54:06,872 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-06 11:54:06,873 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678103646873"}]},"ts":"1678103646873"} 2023-03-06 11:54:06,876 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLED in hbase:meta 2023-03-06 11:54:06,879 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_POST_OPERATION 2023-03-06 11:54:06,883 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 461 msec 2023-03-06 11:54:07,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-03-06 11:54:07,049 INFO [Listener at localhost/46717] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthly, procId: 9 completed 2023-03-06 11:54:07,071 DEBUG [hconnection-0x137d7f40-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-06 11:54:07,075 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:53620, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-06 11:54:07,241 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:54:07,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:07,281 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-06 11:54:07,281 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:07,282 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-06 11:54:07,282 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-06 11:54:07,282 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:07,282 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:07,284 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:07,284 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:07,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:07,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:07,284 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:07,284 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:54:07,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:07,285 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:07,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:54:07,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:07,285 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:07,287 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:07,287 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-06 11:54:07,287 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:07,288 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-06 11:54:07,288 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-06 11:54:07,289 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:54:07,289 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4. 2023-03-06 11:54:07,289 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4. started... 2023-03-06 11:54:07,290 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 53b32d3064df8c51ca0fd7bd317a96a4 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-06 11:54:07,428 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130fc6832d3d2d84539b6c0909e8ccf8967 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130fc6832d3d2d84539b6c0909e8ccf8967 2023-03-06 11:54:07,843 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/.tmp/family1/fde9192d90ad461d9b277b764334d3bd 2023-03-06 11:54:07,856 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/.tmp/family1/fde9192d90ad461d9b277b764334d3bd as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/fde9192d90ad461d9b277b764334d3bd 2023-03-06 11:54:07,867 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/fde9192d90ad461d9b277b764334d3bd, entries=1000, sequenceid=5, filesize=175.8 K 2023-03-06 11:54:07,870 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 53b32d3064df8c51ca0fd7bd317a96a4 in 580ms, sequenceid=5, compaction requested=false 2023-03-06 11:54:07,871 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-06 11:54:07,874 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 53b32d3064df8c51ca0fd7bd317a96a4: 2023-03-06 11:54:07,874 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4. 2023-03-06 11:54:07,874 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-06 11:54:07,875 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-06 11:54:07,875 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:07,875 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-06 11:54:07,875 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-06 11:54:07,877 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:07,877 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:07,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:07,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:07,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:07,877 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:07,877 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:54:07,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:07,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:07,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:07,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:07,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:07,879 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-06 11:54:07,879 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-06 11:54:07,879 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@485baed6[Count = 0] remaining members to acquire global barrier 2023-03-06 11:54:07,879 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:07,881 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:07,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:07,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:07,881 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-06 11:54:07,881 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-06 11:54:07,881 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:54:07,881 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:07,881 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:54:07,883 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:07,883 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-06 11:54:07,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:07,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:07,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:07,883 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:07,883 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-06 11:54:07,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:07,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:07,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:07,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:07,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:07,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:07,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:07,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:54:07,886 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-06 11:54:07,886 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-06 11:54:07,887 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:54:07,887 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:54:07,887 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:07,887 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:54:07,890 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:07,890 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:07,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:07,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:07,890 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:07,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:07,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:07,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:07,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:07,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:07,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:07,891 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:07,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:07,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:07,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:07,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:07,893 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:07,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:07,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:07,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:07,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:07,900 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:07,900 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:07,900 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:07,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:07,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:07,900 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:07,900 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:07,900 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-06 11:54:07,901 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:54:07,900 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:07,901 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:07,901 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:07,901 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:07,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:07,901 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:07,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:07,902 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-06 11:54:07,903 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:54:08,003 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:54:08,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:54:08,018 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:54:08,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-06 11:54:08,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:08,021 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-06 11:54:08,022 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:08,022 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-06 11:54:08,022 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-06 11:54:08,023 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:08,023 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:08,024 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:08,024 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:08,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:08,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:08,025 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:08,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:08,025 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:54:08,025 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:08,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:54:08,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:08,026 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:08,026 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-06 11:54:08,026 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:08,026 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-06 11:54:08,026 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:08,027 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-06 11:54:08,027 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-06 11:54:08,027 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:54:08,027 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4. 2023-03-06 11:54:08,027 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4. started... 2023-03-06 11:54:08,027 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 53b32d3064df8c51ca0fd7bd317a96a4 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-06 11:54:08,451 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511287af63de388244ddcb9aa16eceee976a7 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511287af63de388244ddcb9aa16eceee976a7 2023-03-06 11:54:08,863 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/.tmp/family1/14c04d68216849ad918cf163c60608fb 2023-03-06 11:54:08,873 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/.tmp/family1/14c04d68216849ad918cf163c60608fb as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/14c04d68216849ad918cf163c60608fb 2023-03-06 11:54:08,881 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/14c04d68216849ad918cf163c60608fb, entries=1, sequenceid=9, filesize=5.0 K 2023-03-06 11:54:08,883 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 53b32d3064df8c51ca0fd7bd317a96a4 in 856ms, sequenceid=9, compaction requested=false 2023-03-06 11:54:08,883 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 53b32d3064df8c51ca0fd7bd317a96a4: 2023-03-06 11:54:08,883 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4. 2023-03-06 11:54:08,883 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-06 11:54:08,883 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-06 11:54:08,883 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:08,884 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-06 11:54:08,884 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-06 11:54:08,886 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:08,886 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:08,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:08,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:08,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:08,886 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:08,886 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:54:08,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:08,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:08,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:08,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:08,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:08,888 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-06 11:54:08,888 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@76028123[Count = 0] remaining members to acquire global barrier 2023-03-06 11:54:08,888 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-06 11:54:08,888 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:08,891 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:08,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:08,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:08,891 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-06 11:54:08,891 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-06 11:54:08,891 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:54:08,891 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:08,892 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:54:08,893 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-06 11:54:08,893 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:08,893 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:08,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:08,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:08,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:08,893 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-06 11:54:08,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:08,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:08,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:08,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:08,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:08,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:08,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:08,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:54:08,897 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-06 11:54:08,897 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-06 11:54:08,897 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:54:08,897 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:54:08,897 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:08,897 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:54:08,902 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:08,902 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:08,902 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:08,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:08,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:08,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:08,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:08,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:08,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:08,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:08,902 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:08,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:08,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:08,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:08,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:08,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:08,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:08,904 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:08,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:08,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:08,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:08,909 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:08,909 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:08,909 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:08,909 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:08,909 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:08,909 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-06 11:54:08,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:08,909 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:08,909 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-06 11:54:08,910 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:54:08,909 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:08,910 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:08,910 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:08,910 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:08,910 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:08,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:08,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:08,910 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-06 11:54:08,910 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:54:09,010 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:54:09,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:54:09,020 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:54:09,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-06 11:54:09,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:09,023 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-06 11:54:09,023 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:09,024 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-06 11:54:09,024 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-06 11:54:09,024 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:09,024 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:09,026 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:09,026 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:09,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:09,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:09,026 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:09,026 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:54:09,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:09,027 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:09,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:54:09,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:09,027 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:09,028 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-06 11:54:09,028 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:09,028 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-06 11:54:09,028 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:09,028 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-06 11:54:09,028 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-06 11:54:09,028 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:54:09,028 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4. 2023-03-06 11:54:09,029 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4. started... 2023-03-06 11:54:09,029 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 53b32d3064df8c51ca0fd7bd317a96a4 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-06 11:54:09,454 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201c0c0e69e2a5d476ca1122844bae3c83b to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201c0c0e69e2a5d476ca1122844bae3c83b 2023-03-06 11:54:09,866 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/.tmp/family1/37d5f3c0ba514de798604ab3806aa25a 2023-03-06 11:54:09,876 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/.tmp/family1/37d5f3c0ba514de798604ab3806aa25a as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/37d5f3c0ba514de798604ab3806aa25a 2023-03-06 11:54:09,884 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/37d5f3c0ba514de798604ab3806aa25a, entries=1, sequenceid=13, filesize=5.0 K 2023-03-06 11:54:09,885 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 53b32d3064df8c51ca0fd7bd317a96a4 in 856ms, sequenceid=13, compaction requested=true 2023-03-06 11:54:09,885 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 53b32d3064df8c51ca0fd7bd317a96a4: 2023-03-06 11:54:09,885 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4. 2023-03-06 11:54:09,885 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-06 11:54:09,886 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-06 11:54:09,886 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:09,886 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-06 11:54:09,886 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-06 11:54:09,888 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:09,888 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:09,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:09,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:09,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:09,889 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:09,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:09,889 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:54:09,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:09,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:09,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:09,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:09,891 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-06 11:54:09,891 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3a51683f[Count = 0] remaining members to acquire global barrier 2023-03-06 11:54:09,891 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-06 11:54:09,891 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:09,892 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:09,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:09,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:09,892 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-06 11:54:09,892 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-06 11:54:09,892 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:54:09,892 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:09,892 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:54:09,895 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:09,895 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-06 11:54:09,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:09,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:09,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:09,895 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:09,895 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-06 11:54:09,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:09,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:09,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:09,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:09,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:09,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:09,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:09,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:54:09,899 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-06 11:54:09,899 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-06 11:54:09,899 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:54:09,899 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:54:09,899 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:09,899 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:54:09,901 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:09,901 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:09,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:09,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:09,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:09,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:09,901 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:09,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:09,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:09,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:09,902 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:09,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:09,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:09,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:09,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:09,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:09,903 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:09,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:09,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:09,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:09,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:09,907 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:09,907 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:09,907 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:09,907 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:09,907 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:09,907 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:09,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:09,907 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-06 11:54:09,908 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:54:09,907 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:09,908 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-06 11:54:09,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:09,908 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:09,908 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:09,908 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:09,908 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-06 11:54:09,909 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:09,909 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:54:09,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:10,009 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:54:10,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:54:10,020 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:54:10,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-06 11:54:10,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:10,025 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-06 11:54:10,025 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:10,026 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-06 11:54:10,026 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-06 11:54:10,027 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:10,027 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:10,028 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:10,029 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:10,029 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:54:10,029 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:10,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:10,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:10,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:10,031 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:10,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:54:10,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:10,031 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:10,031 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-06 11:54:10,031 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:10,032 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-06 11:54:10,032 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:10,032 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-06 11:54:10,032 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-06 11:54:10,032 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:54:10,032 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4. 2023-03-06 11:54:10,032 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4. started... 2023-03-06 11:54:10,033 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 53b32d3064df8c51ca0fd7bd317a96a4 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-06 11:54:10,069 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205755ad8593ea14e42b3749e43619a0cf9 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205755ad8593ea14e42b3749e43619a0cf9 2023-03-06 11:54:10,072 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-06 11:54:10,142 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-03-06 11:54:10,143 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-03-06 11:54:10,489 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/.tmp/family1/b99e1e3ae4f44192ae3e815b8936c780 2023-03-06 11:54:10,502 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/.tmp/family1/b99e1e3ae4f44192ae3e815b8936c780 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/b99e1e3ae4f44192ae3e815b8936c780 2023-03-06 11:54:10,512 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/b99e1e3ae4f44192ae3e815b8936c780, entries=1, sequenceid=17, filesize=5.0 K 2023-03-06 11:54:10,514 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 53b32d3064df8c51ca0fd7bd317a96a4 in 482ms, sequenceid=17, compaction requested=true 2023-03-06 11:54:10,514 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 53b32d3064df8c51ca0fd7bd317a96a4: 2023-03-06 11:54:10,514 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4. 2023-03-06 11:54:10,514 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-06 11:54:10,515 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-06 11:54:10,515 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:10,516 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-06 11:54:10,516 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-06 11:54:10,518 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:10,519 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:10,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:10,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:10,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:10,519 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:10,519 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:54:10,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:10,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:10,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:10,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:10,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:10,521 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-06 11:54:10,521 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@111a5ca1[Count = 0] remaining members to acquire global barrier 2023-03-06 11:54:10,521 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-06 11:54:10,521 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:10,524 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:10,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:10,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:10,524 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-06 11:54:10,524 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-06 11:54:10,524 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:54:10,524 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:10,524 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:54:10,526 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-06 11:54:10,526 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:10,526 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:10,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:10,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:10,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:10,526 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-06 11:54:10,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:10,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:10,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:10,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:10,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:10,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:10,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:10,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:54:10,531 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-06 11:54:10,531 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-06 11:54:10,531 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:54:10,531 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:54:10,531 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:10,531 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:54:10,533 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:10,533 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:10,533 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:10,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:10,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:10,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:10,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:10,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:10,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:10,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:10,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:10,534 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:10,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:10,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:10,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:10,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:10,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:10,536 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:10,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:10,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:10,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:10,542 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:10,543 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:10,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:10,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:10,543 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:10,543 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:10,543 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:10,543 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:10,543 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:10,543 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:10,543 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-06 11:54:10,543 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:54:10,543 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:10,543 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:10,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:10,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:10,543 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-06 11:54:10,544 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-06 11:54:10,544 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:54:10,644 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:54:10,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:54:10,654 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:54:10,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-06 11:54:10,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:10,656 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-06 11:54:10,656 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:10,657 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-06 11:54:10,657 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-06 11:54:10,657 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:10,657 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:10,658 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:10,658 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:10,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:10,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:10,659 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:10,659 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:54:10,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:10,659 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:10,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:54:10,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:10,660 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:10,660 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-06 11:54:10,660 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:10,660 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-06 11:54:10,660 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:10,661 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-06 11:54:10,661 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-06 11:54:10,661 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:54:10,661 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4. 2023-03-06 11:54:10,661 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4. started... 2023-03-06 11:54:10,661 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 53b32d3064df8c51ca0fd7bd317a96a4 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-06 11:54:11,083 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512282f4f5aa7eec24d6f85925248d74a56b4 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512282f4f5aa7eec24d6f85925248d74a56b4 2023-03-06 11:54:11,428 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-03-06 11:54:11,428 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-03-06 11:54:11,497 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/.tmp/family1/6626c2ca5c56498eb2f00f22b6cb0ebd 2023-03-06 11:54:11,507 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/.tmp/family1/6626c2ca5c56498eb2f00f22b6cb0ebd as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/6626c2ca5c56498eb2f00f22b6cb0ebd 2023-03-06 11:54:11,514 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/6626c2ca5c56498eb2f00f22b6cb0ebd, entries=1, sequenceid=21, filesize=5.0 K 2023-03-06 11:54:11,516 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 53b32d3064df8c51ca0fd7bd317a96a4 in 855ms, sequenceid=21, compaction requested=true 2023-03-06 11:54:11,516 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 53b32d3064df8c51ca0fd7bd317a96a4: 2023-03-06 11:54:11,516 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4. 2023-03-06 11:54:11,516 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-06 11:54:11,517 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-06 11:54:11,517 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:11,517 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-06 11:54:11,517 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-06 11:54:11,523 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:11,523 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:11,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:11,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:11,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:11,523 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:11,523 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:54:11,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:11,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:11,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:11,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:11,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:11,525 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-06 11:54:11,525 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4a26d4a[Count = 0] remaining members to acquire global barrier 2023-03-06 11:54:11,525 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-06 11:54:11,525 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:11,526 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:11,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:11,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:11,527 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-06 11:54:11,527 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-06 11:54:11,527 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:54:11,527 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:11,527 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:54:11,528 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-06 11:54:11,528 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:11,528 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:11,528 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-06 11:54:11,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:11,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:11,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:11,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:11,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:11,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:11,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:11,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:11,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:11,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:11,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:54:11,531 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-06 11:54:11,531 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-06 11:54:11,531 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:54:11,531 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:54:11,531 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:11,531 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:54:11,534 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:11,534 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:11,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:11,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:11,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:11,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:11,534 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:11,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:11,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:11,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:11,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:11,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:11,535 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:11,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:11,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:11,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:11,537 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:11,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:11,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:11,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:11,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:11,539 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:11,539 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:11,539 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:11,539 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:11,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:11,539 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:11,540 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-06 11:54:11,540 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:11,539 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-06 11:54:11,540 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:54:11,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:11,539 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:11,540 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:11,540 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:11,540 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:11,541 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-06 11:54:11,541 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:54:11,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:11,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:11,641 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:54:11,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:54:11,651 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:54:11,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-06 11:54:11,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:11,654 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-06 11:54:11,654 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:11,655 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-06 11:54:11,655 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-06 11:54:11,655 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:11,655 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:11,656 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:11,657 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:11,657 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:11,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:11,657 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:11,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:11,657 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:54:11,658 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:11,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:54:11,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:11,659 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:11,659 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-06 11:54:11,659 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:11,659 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-06 11:54:11,659 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:11,659 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-06 11:54:11,661 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-06 11:54:11,661 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4. 2023-03-06 11:54:11,661 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:54:11,661 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4. started... 2023-03-06 11:54:11,661 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 53b32d3064df8c51ca0fd7bd317a96a4 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-06 11:54:12,091 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231d9edb467ed254957a07eebfcf5fddc65 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231d9edb467ed254957a07eebfcf5fddc65 2023-03-06 11:54:12,501 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/.tmp/family1/be92cfee2019474eaf798d6990191afa 2023-03-06 11:54:12,511 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/.tmp/family1/be92cfee2019474eaf798d6990191afa as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/be92cfee2019474eaf798d6990191afa 2023-03-06 11:54:12,518 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/be92cfee2019474eaf798d6990191afa, entries=1, sequenceid=25, filesize=5.0 K 2023-03-06 11:54:12,520 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 53b32d3064df8c51ca0fd7bd317a96a4 in 859ms, sequenceid=25, compaction requested=true 2023-03-06 11:54:12,520 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 53b32d3064df8c51ca0fd7bd317a96a4: 2023-03-06 11:54:12,520 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4. 2023-03-06 11:54:12,520 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-06 11:54:12,521 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-06 11:54:12,521 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:12,521 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-06 11:54:12,521 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-06 11:54:12,523 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:12,523 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:12,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:12,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:12,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:12,523 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:12,524 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:54:12,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:12,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:12,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:12,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:12,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:12,526 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-06 11:54:12,526 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@664bef64[Count = 0] remaining members to acquire global barrier 2023-03-06 11:54:12,526 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-06 11:54:12,526 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:12,527 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:12,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:12,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:12,527 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-06 11:54:12,527 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-06 11:54:12,527 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:54:12,528 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:12,528 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:54:12,529 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-06 11:54:12,529 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:12,529 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:12,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:12,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:12,529 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-06 11:54:12,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:12,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:12,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:12,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:12,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:12,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:12,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:12,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:12,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:54:12,533 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-06 11:54:12,533 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-06 11:54:12,533 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:54:12,533 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:54:12,533 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:12,533 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:54:12,538 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:12,538 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:12,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:12,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:12,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:12,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:12,538 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:12,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:12,539 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:12,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:12,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:12,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:12,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:12,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:12,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:12,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:12,540 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:12,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:12,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:12,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:12,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:12,543 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:12,543 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:12,543 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:12,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:12,543 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-06 11:54:12,543 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:12,543 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-06 11:54:12,543 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:54:12,543 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:12,543 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:12,543 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:12,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:12,544 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:12,544 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:12,544 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:12,544 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-06 11:54:12,544 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:54:12,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:12,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:12,645 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:54:12,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:54:12,653 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:54:12,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-06 11:54:12,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:12,656 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-06 11:54:12,656 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:12,656 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-06 11:54:12,656 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-06 11:54:12,657 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:12,657 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:12,658 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:12,658 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:12,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:12,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:12,658 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:12,659 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:54:12,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:12,660 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:12,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:54:12,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:12,660 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:12,660 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-06 11:54:12,660 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:12,661 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-06 11:54:12,661 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:12,661 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-06 11:54:12,661 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-06 11:54:12,661 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:54:12,661 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4. 2023-03-06 11:54:12,661 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4. started... 2023-03-06 11:54:12,662 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 53b32d3064df8c51ca0fd7bd317a96a4 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-06 11:54:13,082 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010163d278f0e9084cdabe043062bf4fd9df to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010163d278f0e9084cdabe043062bf4fd9df 2023-03-06 11:54:13,491 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/.tmp/family1/1c8b2dbaf58a4fbf9f21d24adb3682cd 2023-03-06 11:54:13,500 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/.tmp/family1/1c8b2dbaf58a4fbf9f21d24adb3682cd as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/1c8b2dbaf58a4fbf9f21d24adb3682cd 2023-03-06 11:54:13,509 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/1c8b2dbaf58a4fbf9f21d24adb3682cd, entries=1, sequenceid=29, filesize=5.0 K 2023-03-06 11:54:13,510 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 53b32d3064df8c51ca0fd7bd317a96a4 in 848ms, sequenceid=29, compaction requested=true 2023-03-06 11:54:13,510 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 53b32d3064df8c51ca0fd7bd317a96a4: 2023-03-06 11:54:13,511 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4. 2023-03-06 11:54:13,511 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-06 11:54:13,511 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-06 11:54:13,511 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:13,511 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-06 11:54:13,512 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-06 11:54:13,514 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:13,514 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:13,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:13,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:13,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:13,514 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:13,514 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:54:13,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:13,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:13,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:13,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:13,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:13,516 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-06 11:54:13,516 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@57ea6302[Count = 0] remaining members to acquire global barrier 2023-03-06 11:54:13,516 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-06 11:54:13,516 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:13,517 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:13,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:13,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:13,518 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-06 11:54:13,518 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-06 11:54:13,518 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:54:13,518 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:13,518 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:54:13,521 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-06 11:54:13,521 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:13,521 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:13,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:13,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:13,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:13,522 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-06 11:54:13,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:13,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:13,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:13,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:13,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:13,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:13,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:13,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:54:13,525 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-06 11:54:13,525 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-06 11:54:13,525 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:54:13,525 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:54:13,525 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:13,525 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:54:13,527 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:13,527 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:13,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:13,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:13,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:13,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:13,527 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:13,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:13,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:13,528 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:13,528 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:13,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:13,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:13,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:13,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:13,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:13,529 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:13,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:13,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:13,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:13,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:13,539 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:13,540 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:13,540 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:13,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:13,540 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:13,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:13,540 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-06 11:54:13,540 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:13,540 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:13,540 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:54:13,541 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-06 11:54:13,541 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:13,541 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:13,541 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:13,541 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:13,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:13,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:13,541 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-06 11:54:13,541 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:54:13,641 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:54:13,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:54:13,652 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:54:13,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-06 11:54:13,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:13,655 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-06 11:54:13,655 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:13,656 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-06 11:54:13,656 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-06 11:54:13,656 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:13,657 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:13,658 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:13,658 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:13,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:13,658 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:13,658 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:54:13,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:13,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:13,659 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:13,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:54:13,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:13,660 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:13,660 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-06 11:54:13,661 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:13,661 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-06 11:54:13,661 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:13,667 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-06 11:54:13,668 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-06 11:54:13,668 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:54:13,668 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4. 2023-03-06 11:54:13,668 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4. started... 2023-03-06 11:54:13,668 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 53b32d3064df8c51ca0fd7bd317a96a4 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-06 11:54:13,701 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103c2b02bfa7c94462d9a7018514efe9e2b to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103c2b02bfa7c94462d9a7018514efe9e2b 2023-03-06 11:54:14,122 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/.tmp/family1/516aaff289a5418c801e1757cf3aef2a 2023-03-06 11:54:14,131 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/.tmp/family1/516aaff289a5418c801e1757cf3aef2a as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/516aaff289a5418c801e1757cf3aef2a 2023-03-06 11:54:14,139 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/516aaff289a5418c801e1757cf3aef2a, entries=1, sequenceid=33, filesize=5.0 K 2023-03-06 11:54:14,140 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 53b32d3064df8c51ca0fd7bd317a96a4 in 472ms, sequenceid=33, compaction requested=true 2023-03-06 11:54:14,141 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 53b32d3064df8c51ca0fd7bd317a96a4: 2023-03-06 11:54:14,141 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4. 2023-03-06 11:54:14,141 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-06 11:54:14,141 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-06 11:54:14,141 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:14,141 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-06 11:54:14,141 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-06 11:54:14,143 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:14,143 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:14,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:14,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:14,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:14,143 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:14,143 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:54:14,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:14,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:14,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:14,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:14,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:14,145 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-06 11:54:14,145 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@14d6d20a[Count = 0] remaining members to acquire global barrier 2023-03-06 11:54:14,145 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-06 11:54:14,145 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:14,147 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:14,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:14,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:14,147 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-06 11:54:14,147 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-06 11:54:14,147 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:54:14,147 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:14,147 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:54:14,148 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-06 11:54:14,148 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:14,148 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:14,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:14,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:14,149 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-06 11:54:14,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:14,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:14,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:14,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:14,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:14,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:14,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:14,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:14,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:54:14,153 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-06 11:54:14,153 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-06 11:54:14,153 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:54:14,153 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:54:14,153 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:14,153 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:54:14,162 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:14,162 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:14,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:14,162 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:14,162 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:14,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:14,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:14,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:14,163 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:14,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:14,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:14,163 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:14,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:14,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:14,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:14,165 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:14,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:14,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:14,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:14,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:14,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:14,167 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:14,167 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:14,167 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:14,167 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:14,167 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:14,167 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:14,167 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:14,167 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-06 11:54:14,167 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:14,167 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:14,167 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:14,167 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:14,167 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:54:14,168 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-06 11:54:14,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:14,168 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-06 11:54:14,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:14,169 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:54:14,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:14,269 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:54:14,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:54:14,278 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:54:14,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-06 11:54:14,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:14,281 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-06 11:54:14,281 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:14,281 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-06 11:54:14,281 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-06 11:54:14,282 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:14,282 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:14,283 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:14,283 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:14,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:14,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:14,284 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:14,284 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:54:14,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:14,285 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:14,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:54:14,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:14,285 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:14,286 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-06 11:54:14,286 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:14,287 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-06 11:54:14,287 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:14,287 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-06 11:54:14,288 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-06 11:54:14,288 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:54:14,288 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4. 2023-03-06 11:54:14,288 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4. started... 2023-03-06 11:54:14,288 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 53b32d3064df8c51ca0fd7bd317a96a4 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-06 11:54:14,715 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907e4585be7fc5c4e8e84110b1637e264eb to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20150907e4585be7fc5c4e8e84110b1637e264eb 2023-03-06 11:54:14,725 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/.tmp/family1/7910776b37b34580be4b057ff1753f94 2023-03-06 11:54:14,734 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/.tmp/family1/7910776b37b34580be4b057ff1753f94 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/7910776b37b34580be4b057ff1753f94 2023-03-06 11:54:14,742 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/7910776b37b34580be4b057ff1753f94, entries=1, sequenceid=37, filesize=5.0 K 2023-03-06 11:54:14,743 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 53b32d3064df8c51ca0fd7bd317a96a4 in 455ms, sequenceid=37, compaction requested=true 2023-03-06 11:54:14,743 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 53b32d3064df8c51ca0fd7bd317a96a4: 2023-03-06 11:54:14,744 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4. 2023-03-06 11:54:14,744 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-06 11:54:14,744 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-06 11:54:14,744 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:14,744 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-06 11:54:14,744 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-06 11:54:14,748 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:14,748 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:14,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:14,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:14,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:14,749 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:14,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:14,749 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:54:14,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:14,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:14,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:14,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:14,751 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-06 11:54:14,751 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@38925e7[Count = 0] remaining members to acquire global barrier 2023-03-06 11:54:14,751 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-06 11:54:14,751 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:14,752 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:14,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:14,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:14,752 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-06 11:54:14,752 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-06 11:54:14,752 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:54:14,752 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:14,752 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:54:14,754 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:14,754 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-06 11:54:14,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:14,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:14,754 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:14,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:14,754 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-06 11:54:14,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:14,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:14,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:14,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:14,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:14,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:14,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:14,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:54:14,758 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-06 11:54:14,758 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-06 11:54:14,758 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:54:14,759 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:54:14,759 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:14,759 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:54:14,762 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:14,762 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:14,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:14,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:14,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:14,762 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:14,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:14,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:14,762 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:14,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:14,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:14,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:14,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:14,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:14,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:14,764 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:14,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:14,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:14,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:14,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:14,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:14,766 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:14,766 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:14,766 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:14,766 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:14,766 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-06 11:54:14,767 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:54:14,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:14,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:14,766 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:14,767 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-06 11:54:14,766 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:14,767 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:14,767 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:14,768 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-06 11:54:14,768 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:14,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:14,768 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:14,768 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:54:14,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:14,868 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:54:14,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:54:14,876 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:54:14,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-06 11:54:14,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:14,878 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-06 11:54:14,879 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:14,879 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-06 11:54:14,879 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-06 11:54:14,880 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:14,880 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:14,881 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:14,881 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:14,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:14,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:14,882 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:14,882 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:54:14,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:14,882 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:14,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:54:14,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:14,882 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:14,883 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-06 11:54:14,883 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:14,883 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-06 11:54:14,883 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:14,884 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-06 11:54:14,884 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-06 11:54:14,884 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:54:14,884 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4. 2023-03-06 11:54:14,884 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4. started... 2023-03-06 11:54:14,884 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 53b32d3064df8c51ca0fd7bd317a96a4 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-06 11:54:15,305 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511208d7e506ae7af4514a4d9e3c49f051604 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511208d7e506ae7af4514a4d9e3c49f051604 2023-03-06 11:54:15,750 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/.tmp/family1/7c8e3686daf845a6989499ea563f4ab6 2023-03-06 11:54:15,758 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/.tmp/family1/7c8e3686daf845a6989499ea563f4ab6 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/7c8e3686daf845a6989499ea563f4ab6 2023-03-06 11:54:15,765 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/7c8e3686daf845a6989499ea563f4ab6, entries=1, sequenceid=41, filesize=5.0 K 2023-03-06 11:54:15,766 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 53b32d3064df8c51ca0fd7bd317a96a4 in 882ms, sequenceid=41, compaction requested=true 2023-03-06 11:54:15,766 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 53b32d3064df8c51ca0fd7bd317a96a4: 2023-03-06 11:54:15,766 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4. 2023-03-06 11:54:15,766 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-06 11:54:15,766 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-06 11:54:15,766 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:15,767 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-06 11:54:15,767 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-06 11:54:15,768 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:15,768 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:15,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:15,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:15,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:15,769 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:15,769 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:54:15,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:15,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:15,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:15,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:15,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:15,770 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-06 11:54:15,770 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3a80ca3d[Count = 0] remaining members to acquire global barrier 2023-03-06 11:54:15,770 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-06 11:54:15,770 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:15,773 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:15,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:15,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:15,773 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-06 11:54:15,773 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-06 11:54:15,773 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:54:15,773 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:15,773 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:54:15,777 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-06 11:54:15,777 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:15,777 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:15,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:15,777 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-06 11:54:15,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:15,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:15,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:15,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:15,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:15,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:15,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:15,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:15,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:15,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:54:15,781 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-06 11:54:15,781 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-06 11:54:15,781 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:54:15,781 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:54:15,781 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:15,781 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:54:15,783 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:15,783 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:15,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:15,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:15,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:15,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:15,783 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:15,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:15,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:15,784 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:15,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:15,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:15,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:15,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:15,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:15,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:15,785 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:15,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:15,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:15,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:15,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:15,788 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:15,788 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:15,788 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:15,788 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:15,788 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:15,788 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:15,788 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:15,788 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:15,788 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:15,788 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-06 11:54:15,788 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:54:15,788 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:15,788 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:15,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:15,789 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-06 11:54:15,789 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:54:15,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:15,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:15,889 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:54:15,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:54:15,896 DEBUG [Listener at localhost/46717] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-03-06 11:54:15,898 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:33660, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-03-06 11:54:15,900 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=36301] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:15,916 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-06 11:54:15,917 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-06 11:54:15,919 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-06 11:54:15,919 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=12, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678104255919 2023-03-06 11:54:15,922 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-06 11:54:15,927 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-03-06 11:54:15,927 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-06 11:54:15,927 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] zookeeper.ReadOnlyZKClient(139): Connect 0x0682fd75 to 127.0.0.1:62659 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-06 11:54:15,936 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@30c9d948, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-06 11:54:15,938 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-06 11:54:16,419 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103b74159dea976439c9976c8aa218cacbc to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103b74159dea976439c9976c8aa218cacbc 2023-03-06 11:54:16,420 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-06 11:54:16,452 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-06 11:54:16,454 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:34124, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-06 11:54:16,489 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-06 11:54:16,492 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:33664, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-06 11:54:16,533 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/c0a3f9ada148494cafa1d5c0d9234e4a first=Optional[r3] last=Optional[r6] 2023-03-06 11:54:16,546 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4., hostname=jenkins-hbase5.apache.org,42547,1678103642479, seqNum=2 for row with hfile group [{family1,hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/c0a3f9ada148494cafa1d5c0d9234e4a}] 2023-03-06 11:54:16,562 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(763): Validating hfile at hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/c0a3f9ada148494cafa1d5c0d9234e4a for inclusion in 53b32d3064df8c51ca0fd7bd317a96a4/family1 2023-03-06 11:54:16,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-03-06 11:54:16,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(777): Region bounds: first= last= 2023-03-06 11:54:16,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegion(2446): Flush status journal for 53b32d3064df8c51ca0fd7bd317a96a4: 2023-03-06 11:54:16,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/c0a3f9ada148494cafa1d5c0d9234e4a to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__rvrdrivgerlvl3k2d8f12jjkuen2u0i4l2g8ppvaus94p05t5sdcp4r0ngh46p73/family1/c0a3f9ada148494cafa1d5c0d9234e4a 2023-03-06 11:54:16,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__rvrdrivgerlvl3k2d8f12jjkuen2u0i4l2g8ppvaus94p05t5sdcp4r0ngh46p73/family1/c0a3f9ada148494cafa1d5c0d9234e4a as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/dfaee4b627584042a6b444c68c2bb036_SeqId_44_ 2023-03-06 11:54:16,574 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(849): Loaded HFile hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__rvrdrivgerlvl3k2d8f12jjkuen2u0i4l2g8ppvaus94p05t5sdcp4r0ngh46p73/family1/c0a3f9ada148494cafa1d5c0d9234e4a into 53b32d3064df8c51ca0fd7bd317a96a4/family1 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/dfaee4b627584042a6b444c68c2bb036_SeqId_44_ - updating store file list. 2023-03-06 11:54:16,580 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(882): Loaded HFile hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/dfaee4b627584042a6b444c68c2bb036_SeqId_44_ into 53b32d3064df8c51ca0fd7bd317a96a4/family1 2023-03-06 11:54:16,580 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(855): Successfully loaded hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__rvrdrivgerlvl3k2d8f12jjkuen2u0i4l2g8ppvaus94p05t5sdcp4r0ngh46p73/family1/c0a3f9ada148494cafa1d5c0d9234e4a into 53b32d3064df8c51ca0fd7bd317a96a4/family1 (new location: hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/dfaee4b627584042a6b444c68c2bb036_SeqId_44_) 2023-03-06 11:54:16,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__rvrdrivgerlvl3k2d8f12jjkuen2u0i4l2g8ppvaus94p05t5sdcp4r0ngh46p73/family1/c0a3f9ada148494cafa1d5c0d9234e4a 2023-03-06 11:54:16,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-06 11:54:16,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51357 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-06 11:54:16,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(1912): 53b32d3064df8c51ca0fd7bd317a96a4/family1 is initiating minor compaction 2023-03-06 11:54:16,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@642b8fce; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-06 11:54:16,592 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 53b32d3064df8c51ca0fd7bd317a96a4/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4. 2023-03-06 11:54:16,592 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/14c04d68216849ad918cf163c60608fb, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/37d5f3c0ba514de798604ab3806aa25a, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/b99e1e3ae4f44192ae3e815b8936c780, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/6626c2ca5c56498eb2f00f22b6cb0ebd, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/be92cfee2019474eaf798d6990191afa, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/1c8b2dbaf58a4fbf9f21d24adb3682cd, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/516aaff289a5418c801e1757cf3aef2a, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/7910776b37b34580be4b057ff1753f94, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/7c8e3686daf845a6989499ea563f4ab6, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/dfaee4b627584042a6b444c68c2bb036_SeqId_44_] into tmpdir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/.tmp, totalSize=50.2 K 2023-03-06 11:54:16,593 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting 14c04d68216849ad918cf163c60608fb, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-06 11:54:16,593 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting 37d5f3c0ba514de798604ab3806aa25a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-06 11:54:16,593 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting b99e1e3ae4f44192ae3e815b8936c780, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-06 11:54:16,593 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting 6626c2ca5c56498eb2f00f22b6cb0ebd, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-06 11:54:16,593 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting be92cfee2019474eaf798d6990191afa, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-06 11:54:16,593 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting 1c8b2dbaf58a4fbf9f21d24adb3682cd, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-06 11:54:16,593 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting 516aaff289a5418c801e1757cf3aef2a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-06 11:54:16,593 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting 7910776b37b34580be4b057ff1753f94, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-06 11:54:16,594 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting 7c8e3686daf845a6989499ea563f4ab6, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-06 11:54:16,594 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting dfaee4b627584042a6b444c68c2bb036_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-06 11:54:16,607 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-06 11:54:16,609 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:54:16,614 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512282f4f5aa7eec24d6f85925248d74a56b4 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512282f4f5aa7eec24d6f85925248d74a56b4 2023-03-06 11:54:16,616 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231d9edb467ed254957a07eebfcf5fddc65 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231d9edb467ed254957a07eebfcf5fddc65 2023-03-06 11:54:16,618 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010163d278f0e9084cdabe043062bf4fd9df to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010163d278f0e9084cdabe043062bf4fd9df 2023-03-06 11:54:16,620 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103c2b02bfa7c94462d9a7018514efe9e2b to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103c2b02bfa7c94462d9a7018514efe9e2b 2023-03-06 11:54:16,620 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 4 expired mob files are deleted 2023-03-06 11:54:16,620 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-03-06 11:54:16,621 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-06 11:54:16,621 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-06 11:54:16,621 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-06 11:54:16,621 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-06 11:54:16,621 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-06 11:54:16,621 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-06 11:54:16,621 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-06 11:54:16,621 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-06 11:54:16,647 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] throttle.PressureAwareThroughputController(145): 53b32d3064df8c51ca0fd7bd317a96a4#family1#compaction#10 average throughput is 0.29 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-06 11:54:17,474 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/.tmp/family1/aee1cebbce9a413abcce3ceabd558289 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/aee1cebbce9a413abcce3ceabd558289 2023-03-06 11:54:17,491 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 53b32d3064df8c51ca0fd7bd317a96a4/family1 of 53b32d3064df8c51ca0fd7bd317a96a4 into aee1cebbce9a413abcce3ceabd558289(size=6.6 K), total size for store is 182.5 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-06 11:54:17,491 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 53b32d3064df8c51ca0fd7bd317a96a4: 2023-03-06 11:54:17,492 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4., storeName=family1, fileCount=10, fileSize=50.2 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.5 K), priority=2, time=1678103656590; duration=0sec 2023-03-06 11:54:17,493 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-06 11:54:17,518 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/14c04d68216849ad918cf163c60608fb, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/37d5f3c0ba514de798604ab3806aa25a, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/b99e1e3ae4f44192ae3e815b8936c780, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/6626c2ca5c56498eb2f00f22b6cb0ebd, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/be92cfee2019474eaf798d6990191afa, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/1c8b2dbaf58a4fbf9f21d24adb3682cd, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/516aaff289a5418c801e1757cf3aef2a, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/7910776b37b34580be4b057ff1753f94, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/7c8e3686daf845a6989499ea563f4ab6, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/dfaee4b627584042a6b444c68c2bb036_SeqId_44_] to archive 2023-03-06 11:54:17,520 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:54:17,520 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512058a28928d4a0e4dfab18630c6940b984e to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512058a28928d4a0e4dfab18630c6940b984e 2023-03-06 11:54:17,522 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-06 11:54:17,523 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/14c04d68216849ad918cf163c60608fb to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/14c04d68216849ad918cf163c60608fb 2023-03-06 11:54:17,527 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/37d5f3c0ba514de798604ab3806aa25a to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/37d5f3c0ba514de798604ab3806aa25a 2023-03-06 11:54:17,529 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/b99e1e3ae4f44192ae3e815b8936c780 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/b99e1e3ae4f44192ae3e815b8936c780 2023-03-06 11:54:17,531 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/6626c2ca5c56498eb2f00f22b6cb0ebd to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/6626c2ca5c56498eb2f00f22b6cb0ebd 2023-03-06 11:54:17,534 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/be92cfee2019474eaf798d6990191afa to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/be92cfee2019474eaf798d6990191afa 2023-03-06 11:54:17,536 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/1c8b2dbaf58a4fbf9f21d24adb3682cd to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/1c8b2dbaf58a4fbf9f21d24adb3682cd 2023-03-06 11:54:17,538 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/516aaff289a5418c801e1757cf3aef2a to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/516aaff289a5418c801e1757cf3aef2a 2023-03-06 11:54:17,540 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/7910776b37b34580be4b057ff1753f94 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/7910776b37b34580be4b057ff1753f94 2023-03-06 11:54:17,542 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/7c8e3686daf845a6989499ea563f4ab6 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/7c8e3686daf845a6989499ea563f4ab6 2023-03-06 11:54:17,544 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/dfaee4b627584042a6b444c68c2bb036_SeqId_44_ to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/dfaee4b627584042a6b444c68c2bb036_SeqId_44_ 2023-03-06 11:54:17,558 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f5f97ccf706144aa9a69b94962567029 first=Optional[r00] last=Optional[r2] 2023-03-06 11:54:17,560 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4., hostname=jenkins-hbase5.apache.org,42547,1678103642479, seqNum=2 for row with hfile group [{family1,hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f5f97ccf706144aa9a69b94962567029}] 2023-03-06 11:54:17,562 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(763): Validating hfile at hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f5f97ccf706144aa9a69b94962567029 for inclusion in 53b32d3064df8c51ca0fd7bd317a96a4/family1 2023-03-06 11:54:17,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-03-06 11:54:17,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(777): Region bounds: first= last= 2023-03-06 11:54:17,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegion(2446): Flush status journal for 53b32d3064df8c51ca0fd7bd317a96a4: 2023-03-06 11:54:17,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f5f97ccf706144aa9a69b94962567029 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__l4lef633iri0kbkfkcitk8vpcosj4tirp1h92f5764muknd6pbqn0vlfi17q969r/family1/f5f97ccf706144aa9a69b94962567029 2023-03-06 11:54:17,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__l4lef633iri0kbkfkcitk8vpcosj4tirp1h92f5764muknd6pbqn0vlfi17q969r/family1/f5f97ccf706144aa9a69b94962567029 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/6aa5af5c92124f38ad3874fc00f268fd_SeqId_47_ 2023-03-06 11:54:17,573 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(849): Loaded HFile hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__l4lef633iri0kbkfkcitk8vpcosj4tirp1h92f5764muknd6pbqn0vlfi17q969r/family1/f5f97ccf706144aa9a69b94962567029 into 53b32d3064df8c51ca0fd7bd317a96a4/family1 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/6aa5af5c92124f38ad3874fc00f268fd_SeqId_47_ - updating store file list. 2023-03-06 11:54:17,581 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(882): Loaded HFile hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/6aa5af5c92124f38ad3874fc00f268fd_SeqId_47_ into 53b32d3064df8c51ca0fd7bd317a96a4/family1 2023-03-06 11:54:17,581 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(855): Successfully loaded hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__l4lef633iri0kbkfkcitk8vpcosj4tirp1h92f5764muknd6pbqn0vlfi17q969r/family1/f5f97ccf706144aa9a69b94962567029 into 53b32d3064df8c51ca0fd7bd317a96a4/family1 (new location: hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/6aa5af5c92124f38ad3874fc00f268fd_SeqId_47_) 2023-03-06 11:54:17,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__l4lef633iri0kbkfkcitk8vpcosj4tirp1h92f5764muknd6pbqn0vlfi17q969r/family1/f5f97ccf706144aa9a69b94962567029 2023-03-06 11:54:17,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-06 11:54:17,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 367249 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-06 11:54:17,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(1912): 53b32d3064df8c51ca0fd7bd317a96a4/family1 is initiating minor compaction (all files) 2023-03-06 11:54:17,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@d10bc37; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-06 11:54:17,583 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 53b32d3064df8c51ca0fd7bd317a96a4/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4. 2023-03-06 11:54:17,584 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/fde9192d90ad461d9b277b764334d3bd, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/aee1cebbce9a413abcce3ceabd558289, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/6aa5af5c92124f38ad3874fc00f268fd_SeqId_47_] into tmpdir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/.tmp, totalSize=358.6 K 2023-03-06 11:54:17,585 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting fde9192d90ad461d9b277b764334d3bd, keycount=1000, bloomtype=ROW, size=175.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878806372 2023-03-06 11:54:17,585 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting aee1cebbce9a413abcce3ceabd558289, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621206372 2023-03-06 11:54:17,586 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting 6aa5af5c92124f38ad3874fc00f268fd_SeqId_47_, keycount=1002, bloomtype=ROW, size=176.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878806372 2023-03-06 11:54:17,586 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-06 11:54:17,588 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:54:17,590 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130fc6832d3d2d84539b6c0909e8ccf8967 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130fc6832d3d2d84539b6c0909e8ccf8967 2023-03-06 11:54:17,592 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201c0c0e69e2a5d476ca1122844bae3c83b to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201c0c0e69e2a5d476ca1122844bae3c83b 2023-03-06 11:54:17,594 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205755ad8593ea14e42b3749e43619a0cf9 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205755ad8593ea14e42b3749e43619a0cf9 2023-03-06 11:54:17,594 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 3 expired mob files are deleted 2023-03-06 11:54:17,594 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-03-06 11:54:17,595 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-06 11:54:17,595 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-06 11:54:17,595 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-06 11:54:17,596 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=12, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-06 11:54:17,598 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 1.6910 sec 2023-03-06 11:54:17,626 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] throttle.PressureAwareThroughputController(145): 53b32d3064df8c51ca0fd7bd317a96a4#family1#compaction#11 average throughput is 6.35 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-06 11:54:17,781 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.HMaster$12(2454): Client=jenkins//172.31.10.131 modify table testMajorCompactionWithWeeklyFollowedByMonthly from 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-03-06 11:54:17,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:17,896 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-03-06 11:54:17,898 DEBUG [PEWorker-2] util.FSTableDescriptors(519): Deleted hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-03-06 11:54:17,898 INFO [PEWorker-2] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-03-06 11:54:17,908 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly}] 2023-03-06 11:54:17,926 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=53b32d3064df8c51ca0fd7bd317a96a4, REOPEN/MOVE}] 2023-03-06 11:54:17,928 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=53b32d3064df8c51ca0fd7bd317a96a4, REOPEN/MOVE 2023-03-06 11:54:17,929 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=53b32d3064df8c51ca0fd7bd317a96a4, regionState=CLOSING, regionLocation=jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:17,930 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1678103657929"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678103657929"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678103657929"}]},"ts":"1678103657929"} 2023-03-06 11:54:17,933 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE; CloseRegionProcedure 53b32d3064df8c51ca0fd7bd317a96a4, server=jenkins-hbase5.apache.org,42547,1678103642479}] 2023-03-06 11:54:18,072 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/.tmp/family1/c4a5eeca92014a709d5f6c7274ccc4a2 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/c4a5eeca92014a709d5f6c7274ccc4a2 2023-03-06 11:54:18,080 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 53b32d3064df8c51ca0fd7bd317a96a4/family1 of 53b32d3064df8c51ca0fd7bd317a96a4 into c4a5eeca92014a709d5f6c7274ccc4a2(size=177.2 K), total size for store is 177.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-06 11:54:18,080 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 53b32d3064df8c51ca0fd7bd317a96a4: 2023-03-06 11:54:18,081 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4., storeName=family1, fileCount=3, fileSize=358.6 K (175.8 K, 6.6 K, 176.2 K), priority=2, time=1678103657583; duration=0sec 2023-03-06 11:54:18,081 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-06 11:54:18,093 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(109): Close 53b32d3064df8c51ca0fd7bd317a96a4 2023-03-06 11:54:18,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 53b32d3064df8c51ca0fd7bd317a96a4, disabling compactions & flushes 2023-03-06 11:54:18,093 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4. 2023-03-06 11:54:18,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4. 2023-03-06 11:54:18,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4. after waiting 0 ms 2023-03-06 11:54:18,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4. 2023-03-06 11:54:18,096 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/fde9192d90ad461d9b277b764334d3bd, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/aee1cebbce9a413abcce3ceabd558289, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/6aa5af5c92124f38ad3874fc00f268fd_SeqId_47_] to archive 2023-03-06 11:54:18,097 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:54:18,099 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/fde9192d90ad461d9b277b764334d3bd to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/fde9192d90ad461d9b277b764334d3bd 2023-03-06 11:54:18,101 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/aee1cebbce9a413abcce3ceabd558289 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/aee1cebbce9a413abcce3ceabd558289 2023-03-06 11:54:18,102 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/6aa5af5c92124f38ad3874fc00f268fd_SeqId_47_ to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/6aa5af5c92124f38ad3874fc00f268fd_SeqId_47_ 2023-03-06 11:54:18,110 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-03-06 11:54:18,112 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4. 2023-03-06 11:54:18,112 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 53b32d3064df8c51ca0fd7bd317a96a4: 2023-03-06 11:54:18,112 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 53b32d3064df8c51ca0fd7bd317a96a4 to self. 2023-03-06 11:54:18,114 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(147): Closed 53b32d3064df8c51ca0fd7bd317a96a4 2023-03-06 11:54:18,115 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=53b32d3064df8c51ca0fd7bd317a96a4, regionState=CLOSED 2023-03-06 11:54:18,115 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1678103658115"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678103658115"}]},"ts":"1678103658115"} 2023-03-06 11:54:18,120 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-03-06 11:54:18,120 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; CloseRegionProcedure 53b32d3064df8c51ca0fd7bd317a96a4, server=jenkins-hbase5.apache.org,42547,1678103642479 in 184 msec 2023-03-06 11:54:18,121 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=53b32d3064df8c51ca0fd7bd317a96a4, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase5.apache.org,42547,1678103642479; forceNewPlan=false, retain=true 2023-03-06 11:54:18,271 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=53b32d3064df8c51ca0fd7bd317a96a4, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:18,272 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1678103658271"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678103658271"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678103658271"}]},"ts":"1678103658271"} 2023-03-06 11:54:18,274 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=15, state=RUNNABLE; OpenRegionProcedure 53b32d3064df8c51ca0fd7bd317a96a4, server=jenkins-hbase5.apache.org,42547,1678103642479}] 2023-03-06 11:54:18,430 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4. 2023-03-06 11:54:18,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 53b32d3064df8c51ca0fd7bd317a96a4, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4.', STARTKEY => '', ENDKEY => ''} 2023-03-06 11:54:18,431 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 53b32d3064df8c51ca0fd7bd317a96a4 2023-03-06 11:54:18,431 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-06 11:54:18,431 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 53b32d3064df8c51ca0fd7bd317a96a4 2023-03-06 11:54:18,431 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 53b32d3064df8c51ca0fd7bd317a96a4 2023-03-06 11:54:18,432 INFO [StoreOpener-53b32d3064df8c51ca0fd7bd317a96a4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 53b32d3064df8c51ca0fd7bd317a96a4 2023-03-06 11:54:18,433 DEBUG [StoreOpener-53b32d3064df8c51ca0fd7bd317a96a4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1 2023-03-06 11:54:18,434 DEBUG [StoreOpener-53b32d3064df8c51ca0fd7bd317a96a4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1 2023-03-06 11:54:18,434 INFO [StoreOpener-53b32d3064df8c51ca0fd7bd317a96a4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 53b32d3064df8c51ca0fd7bd317a96a4 columnFamilyName family1 2023-03-06 11:54:18,442 DEBUG [StoreOpener-53b32d3064df8c51ca0fd7bd317a96a4-1] regionserver.HStore(539): loaded hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/c4a5eeca92014a709d5f6c7274ccc4a2 2023-03-06 11:54:18,442 INFO [StoreOpener-53b32d3064df8c51ca0fd7bd317a96a4-1] regionserver.HStore(310): Store=53b32d3064df8c51ca0fd7bd317a96a4/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-06 11:54:18,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4 2023-03-06 11:54:18,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4 2023-03-06 11:54:18,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 53b32d3064df8c51ca0fd7bd317a96a4 2023-03-06 11:54:18,449 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 53b32d3064df8c51ca0fd7bd317a96a4; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66936638, jitterRate=-0.0025663673877716064}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-06 11:54:18,449 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 53b32d3064df8c51ca0fd7bd317a96a4: 2023-03-06 11:54:18,450 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4., pid=17, masterSystemTime=1678103658426 2023-03-06 11:54:18,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4. 2023-03-06 11:54:18,452 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4. 2023-03-06 11:54:18,453 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=53b32d3064df8c51ca0fd7bd317a96a4, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:18,453 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1678103658452"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678103658452"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678103658452"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678103658452"}]},"ts":"1678103658452"} 2023-03-06 11:54:18,456 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=15 2023-03-06 11:54:18,457 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=15, state=SUCCESS; OpenRegionProcedure 53b32d3064df8c51ca0fd7bd317a96a4, server=jenkins-hbase5.apache.org,42547,1678103642479 in 180 msec 2023-03-06 11:54:18,459 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-03-06 11:54:18,459 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=53b32d3064df8c51ca0fd7bd317a96a4, REOPEN/MOVE in 531 msec 2023-03-06 11:54:18,462 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=13 2023-03-06 11:54:18,462 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=13, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 553 msec 2023-03-06 11:54:18,464 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 679 msec 2023-03-06 11:54:18,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=13 2023-03-06 11:54:18,473 INFO [Listener at localhost/46717] compactions.TestMobCompactor(278): alter status finished 2023-03-06 11:54:18,474 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=36301] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-06 11:54:18,476 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-06 11:54:18,477 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-06 11:54:18,478 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-06 11:54:18,478 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678104258478 2023-03-06 11:54:18,479 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-06 11:54:18,480 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-03-06 11:54:18,480 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-06 11:54:18,480 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] zookeeper.ReadOnlyZKClient(139): Connect 0x6ea72963 to 127.0.0.1:62659 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-06 11:54:18,485 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@763a50e4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-06 11:54:18,486 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-06 11:54:18,486 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-06 11:54:18,486 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-06 11:54:18,486 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-06 11:54:18,486 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-06 11:54:19,322 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128593c0cc557994438a31ca86334dbb7bd to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128593c0cc557994438a31ca86334dbb7bd 2023-03-06 11:54:19,323 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-06 11:54:19,337 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-06 11:54:19,339 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:34134, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-06 11:54:19,346 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-06 11:54:19,348 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:33666, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-06 11:54:19,359 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/038b288bee5a420780f98954e3cb0108 first=Optional[r05] last=Optional[r8] 2023-03-06 11:54:19,360 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4., hostname=jenkins-hbase5.apache.org,42547,1678103642479, seqNum=51 for row with hfile group [{family1,hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/038b288bee5a420780f98954e3cb0108}] 2023-03-06 11:54:19,366 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(763): Validating hfile at hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/038b288bee5a420780f98954e3cb0108 for inclusion in 53b32d3064df8c51ca0fd7bd317a96a4/family1 2023-03-06 11:54:19,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-03-06 11:54:19,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(777): Region bounds: first= last= 2023-03-06 11:54:19,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegion(2446): Flush status journal for 53b32d3064df8c51ca0fd7bd317a96a4: 2023-03-06 11:54:19,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/038b288bee5a420780f98954e3cb0108 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__evorvmkedirqh1ceivkhkdniqrluda1jonfifstk41ba5midmp9vij0864bg5iig/family1/038b288bee5a420780f98954e3cb0108 2023-03-06 11:54:19,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__evorvmkedirqh1ceivkhkdniqrluda1jonfifstk41ba5midmp9vij0864bg5iig/family1/038b288bee5a420780f98954e3cb0108 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/4f97c027b7d842a0b9a3a04a553451d0_SeqId_53_ 2023-03-06 11:54:19,375 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(849): Loaded HFile hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__evorvmkedirqh1ceivkhkdniqrluda1jonfifstk41ba5midmp9vij0864bg5iig/family1/038b288bee5a420780f98954e3cb0108 into 53b32d3064df8c51ca0fd7bd317a96a4/family1 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/4f97c027b7d842a0b9a3a04a553451d0_SeqId_53_ - updating store file list. 2023-03-06 11:54:19,381 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(882): Loaded HFile hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/4f97c027b7d842a0b9a3a04a553451d0_SeqId_53_ into 53b32d3064df8c51ca0fd7bd317a96a4/family1 2023-03-06 11:54:19,381 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(855): Successfully loaded hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__evorvmkedirqh1ceivkhkdniqrluda1jonfifstk41ba5midmp9vij0864bg5iig/family1/038b288bee5a420780f98954e3cb0108 into 53b32d3064df8c51ca0fd7bd317a96a4/family1 (new location: hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/family1/4f97c027b7d842a0b9a3a04a553451d0_SeqId_53_) 2023-03-06 11:54:19,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__evorvmkedirqh1ceivkhkdniqrluda1jonfifstk41ba5midmp9vij0864bg5iig/family1/038b288bee5a420780f98954e3cb0108 2023-03-06 11:54:19,384 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-06 11:54:19,385 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:54:19,387 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511208d7e506ae7af4514a4d9e3c49f051604 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511208d7e506ae7af4514a4d9e3c49f051604 2023-03-06 11:54:19,388 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511287af63de388244ddcb9aa16eceee976a7 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511287af63de388244ddcb9aa16eceee976a7 2023-03-06 11:54:19,388 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 2 expired mob files are deleted 2023-03-06 11:54:19,388 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-03-06 11:54:19,389 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-06 11:54:19,389 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-06 11:54:19,389 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-06 11:54:19,389 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-06 11:54:19,389 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-06 11:54:19,390 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-06 11:54:19,392 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 915 msec 2023-03-06 11:54:19,468 INFO [Listener at localhost/46717] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=249 (was 209) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-385596688_15 at /127.0.0.1:52340 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-385596688_15 at /127.0.0.1:52384 [Waiting for operation #14] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-385596688_15 at /127.0.0.1:52310 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RSProcedureDispatcher-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-385596688_15 at /127.0.0.1:52558 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x66cd70ef-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-385596688_15 at /127.0.0.1:52502 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-385596688_15 at /127.0.0.1:52514 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62659@0x0682fd75 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/1675418083.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x66cd70ef-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS:0;jenkins-hbase5:42547-shortCompactions-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:549) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62659@0x6ea72963-SendThread(127.0.0.1:62659) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: hconnection-0x66cd70ef-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62659@0x6ea72963-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62659@0x6ea72963 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/1675418083.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-385596688_15 at /127.0.0.1:52436 [Waiting for operation #26] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-385596688_15 at /127.0.0.1:52414 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobCompactor-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-385596688_15 at /127.0.0.1:52428 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3328f0e3-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x66cd70ef-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-385596688_15 at /127.0.0.1:52616 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1949813811_15 at /127.0.0.1:52486 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-385596688_15 at /127.0.0.1:52562 [Waiting for operation #14] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62659@0x0682fd75-SendThread(127.0.0.1:62659) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3328f0e3-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-385596688_15 at /127.0.0.1:52364 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-385596688_15 at /127.0.0.1:52544 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3328f0e3-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-385596688_15 at /127.0.0.1:52398 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62659@0x0682fd75-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x66cd70ef-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-385596688_15 at /127.0.0.1:52608 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=593 (was 475) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=304 (was 351), ProcessCount=160 (was 160), AvailableMemoryMB=10024 (was 10270) 2023-03-06 11:54:19,480 INFO [Listener at localhost/46717] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=249, OpenFileDescriptor=593, MaxFileDescriptor=60000, SystemLoadAverage=304, ProcessCount=160, AvailableMemoryMB=10023 2023-03-06 11:54:19,482 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.HMaster$4(2112): Client=jenkins//172.31.10.131 create 'testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-03-06 11:54:19,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:19,485 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-03-06 11:54:19,485 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(697): Client=jenkins//172.31.10.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithMonthlyPolicy" procId is: 19 2023-03-06 11:54:19,486 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-06 11:54:19,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-03-06 11:54:19,487 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08 2023-03-06 11:54:19,488 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08 empty. 2023-03-06 11:54:19,488 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08 2023-03-06 11:54:19,488 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithMonthlyPolicy regions 2023-03-06 11:54:19,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-03-06 11:54:19,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-03-06 11:54:19,898 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-03-06 11:54:19,899 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6bbeca1f31f3e780fe3cccddcf90df08, NAME => 'testMajorCompactionWithMonthlyPolicy,,1678103659482.6bbeca1f31f3e780fe3cccddcf90df08.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp 2023-03-06 11:54:20,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-03-06 11:54:20,306 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1678103659482.6bbeca1f31f3e780fe3cccddcf90df08.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-06 11:54:20,306 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing 6bbeca1f31f3e780fe3cccddcf90df08, disabling compactions & flushes 2023-03-06 11:54:20,306 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1678103659482.6bbeca1f31f3e780fe3cccddcf90df08. 2023-03-06 11:54:20,306 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1678103659482.6bbeca1f31f3e780fe3cccddcf90df08. 2023-03-06 11:54:20,306 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1678103659482.6bbeca1f31f3e780fe3cccddcf90df08. after waiting 0 ms 2023-03-06 11:54:20,306 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1678103659482.6bbeca1f31f3e780fe3cccddcf90df08. 2023-03-06 11:54:20,306 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1678103659482.6bbeca1f31f3e780fe3cccddcf90df08. 2023-03-06 11:54:20,306 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 6bbeca1f31f3e780fe3cccddcf90df08: 2023-03-06 11:54:20,309 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-03-06 11:54:20,310 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithMonthlyPolicy,,1678103659482.6bbeca1f31f3e780fe3cccddcf90df08.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1678103660310"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678103660310"}]},"ts":"1678103660310"} 2023-03-06 11:54:20,312 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-06 11:54:20,313 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-06 11:54:20,313 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678103660313"}]},"ts":"1678103660313"} 2023-03-06 11:54:20,315 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-03-06 11:54:20,317 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=6bbeca1f31f3e780fe3cccddcf90df08, ASSIGN}] 2023-03-06 11:54:20,319 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=6bbeca1f31f3e780fe3cccddcf90df08, ASSIGN 2023-03-06 11:54:20,319 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=6bbeca1f31f3e780fe3cccddcf90df08, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,42547,1678103642479; forceNewPlan=false, retain=false 2023-03-06 11:54:20,470 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=6bbeca1f31f3e780fe3cccddcf90df08, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:20,471 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithMonthlyPolicy,,1678103659482.6bbeca1f31f3e780fe3cccddcf90df08.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1678103660470"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678103660470"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678103660470"}]},"ts":"1678103660470"} 2023-03-06 11:54:20,473 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure 6bbeca1f31f3e780fe3cccddcf90df08, server=jenkins-hbase5.apache.org,42547,1678103642479}] 2023-03-06 11:54:20,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-03-06 11:54:20,629 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithMonthlyPolicy,,1678103659482.6bbeca1f31f3e780fe3cccddcf90df08. 2023-03-06 11:54:20,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6bbeca1f31f3e780fe3cccddcf90df08, NAME => 'testMajorCompactionWithMonthlyPolicy,,1678103659482.6bbeca1f31f3e780fe3cccddcf90df08.', STARTKEY => '', ENDKEY => ''} 2023-03-06 11:54:20,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithMonthlyPolicy 6bbeca1f31f3e780fe3cccddcf90df08 2023-03-06 11:54:20,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1678103659482.6bbeca1f31f3e780fe3cccddcf90df08.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-06 11:54:20,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 6bbeca1f31f3e780fe3cccddcf90df08 2023-03-06 11:54:20,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 6bbeca1f31f3e780fe3cccddcf90df08 2023-03-06 11:54:20,632 INFO [StoreOpener-6bbeca1f31f3e780fe3cccddcf90df08-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 6bbeca1f31f3e780fe3cccddcf90df08 2023-03-06 11:54:20,633 DEBUG [StoreOpener-6bbeca1f31f3e780fe3cccddcf90df08-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1 2023-03-06 11:54:20,633 DEBUG [StoreOpener-6bbeca1f31f3e780fe3cccddcf90df08-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1 2023-03-06 11:54:20,634 INFO [StoreOpener-6bbeca1f31f3e780fe3cccddcf90df08-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6bbeca1f31f3e780fe3cccddcf90df08 columnFamilyName family1 2023-03-06 11:54:20,636 INFO [StoreOpener-6bbeca1f31f3e780fe3cccddcf90df08-1] regionserver.HStore(310): Store=6bbeca1f31f3e780fe3cccddcf90df08/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-06 11:54:20,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08 2023-03-06 11:54:20,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08 2023-03-06 11:54:20,642 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 6bbeca1f31f3e780fe3cccddcf90df08 2023-03-06 11:54:20,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-06 11:54:20,644 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 6bbeca1f31f3e780fe3cccddcf90df08; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65277223, jitterRate=-0.027293577790260315}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-06 11:54:20,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 6bbeca1f31f3e780fe3cccddcf90df08: 2023-03-06 11:54:20,645 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithMonthlyPolicy,,1678103659482.6bbeca1f31f3e780fe3cccddcf90df08., pid=21, masterSystemTime=1678103660625 2023-03-06 11:54:20,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithMonthlyPolicy,,1678103659482.6bbeca1f31f3e780fe3cccddcf90df08. 2023-03-06 11:54:20,647 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithMonthlyPolicy,,1678103659482.6bbeca1f31f3e780fe3cccddcf90df08. 2023-03-06 11:54:20,648 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=6bbeca1f31f3e780fe3cccddcf90df08, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:20,648 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithMonthlyPolicy,,1678103659482.6bbeca1f31f3e780fe3cccddcf90df08.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1678103660648"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678103660648"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678103660648"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678103660648"}]},"ts":"1678103660648"} 2023-03-06 11:54:20,652 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=20 2023-03-06 11:54:20,653 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure 6bbeca1f31f3e780fe3cccddcf90df08, server=jenkins-hbase5.apache.org,42547,1678103642479 in 177 msec 2023-03-06 11:54:20,655 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=20, resume processing ppid=19 2023-03-06 11:54:20,655 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=19, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=6bbeca1f31f3e780fe3cccddcf90df08, ASSIGN in 336 msec 2023-03-06 11:54:20,655 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-06 11:54:20,656 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678103660655"}]},"ts":"1678103660655"} 2023-03-06 11:54:20,657 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-03-06 11:54:20,659 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-03-06 11:54:20,661 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy in 1.1770 sec 2023-03-06 11:54:21,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-03-06 11:54:21,593 INFO [Listener at localhost/46717] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithMonthlyPolicy, procId: 19 completed 2023-03-06 11:54:21,639 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:54:21,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:21,642 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-06 11:54:21,642 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:21,642 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-06 11:54:21,642 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-06 11:54:21,643 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:21,643 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:21,644 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:21,644 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:21,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:21,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:21,644 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:21,644 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:54:21,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:21,645 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:21,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:54:21,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:21,645 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:21,646 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:21,646 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-06 11:54:21,646 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:21,646 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-06 11:54:21,646 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-06 11:54:21,646 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:54:21,646 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1678103659482.6bbeca1f31f3e780fe3cccddcf90df08. 2023-03-06 11:54:21,646 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1678103659482.6bbeca1f31f3e780fe3cccddcf90df08. started... 2023-03-06 11:54:21,647 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6bbeca1f31f3e780fe3cccddcf90df08 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-06 11:54:22,070 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130d90cfc40a57e440fb9db39b131f90c5f to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130d90cfc40a57e440fb9db39b131f90c5f 2023-03-06 11:54:22,145 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithMonthlyPolicy' 2023-03-06 11:54:22,474 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/.tmp/family1/d43ad9b161dd41e0a9d5b0e48c2ed19c 2023-03-06 11:54:22,481 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/.tmp/family1/d43ad9b161dd41e0a9d5b0e48c2ed19c as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/d43ad9b161dd41e0a9d5b0e48c2ed19c 2023-03-06 11:54:22,486 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/d43ad9b161dd41e0a9d5b0e48c2ed19c, entries=1000, sequenceid=5, filesize=166.0 K 2023-03-06 11:54:22,488 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 6bbeca1f31f3e780fe3cccddcf90df08 in 841ms, sequenceid=5, compaction requested=false 2023-03-06 11:54:22,488 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6bbeca1f31f3e780fe3cccddcf90df08: 2023-03-06 11:54:22,488 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1678103659482.6bbeca1f31f3e780fe3cccddcf90df08. 2023-03-06 11:54:22,488 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-06 11:54:22,488 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-06 11:54:22,488 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:22,489 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-06 11:54:22,489 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-06 11:54:22,490 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:22,490 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:22,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:22,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:22,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:22,490 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:22,490 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:54:22,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:22,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:22,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:22,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:22,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:22,492 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-06 11:54:22,492 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3ef65c1c[Count = 0] remaining members to acquire global barrier 2023-03-06 11:54:22,492 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-06 11:54:22,492 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:22,493 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:22,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:22,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:22,494 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-06 11:54:22,494 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-06 11:54:22,494 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:54:22,494 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:22,494 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:54:22,495 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-06 11:54:22,495 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:22,495 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:22,495 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-06 11:54:22,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:22,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:22,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:22,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:22,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:22,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:22,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:22,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:22,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:22,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:22,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:54:22,498 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-06 11:54:22,498 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-06 11:54:22,498 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:54:22,498 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:54:22,498 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:22,498 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:54:22,502 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:22,502 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:22,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:22,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:22,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:22,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:22,502 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:22,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:22,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:22,503 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:22,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:22,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:22,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:22,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:22,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:22,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:22,505 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:22,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:22,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:22,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:22,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:22,507 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:22,507 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:22,507 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:22,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:22,507 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:22,507 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-06 11:54:22,507 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:54:22,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:22,507 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-06 11:54:22,507 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:22,507 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:22,507 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:22,508 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:22,508 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-06 11:54:22,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:22,508 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:54:22,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:22,508 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:22,508 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:22,608 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:54:22,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:54:22,615 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:54:22,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-06 11:54:22,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:22,617 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-06 11:54:22,617 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:22,618 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-06 11:54:22,618 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-06 11:54:22,618 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:22,618 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:22,620 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:22,620 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:22,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:22,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:22,620 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:22,620 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:54:22,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:22,621 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:22,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:54:22,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:22,621 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:22,621 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-06 11:54:22,621 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:22,621 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-06 11:54:22,621 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:22,622 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-06 11:54:22,622 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-06 11:54:22,622 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:54:22,622 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1678103659482.6bbeca1f31f3e780fe3cccddcf90df08. 2023-03-06 11:54:22,622 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1678103659482.6bbeca1f31f3e780fe3cccddcf90df08. started... 2023-03-06 11:54:22,622 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6bbeca1f31f3e780fe3cccddcf90df08 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-06 11:54:23,037 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112863c46c09890f49e48ea39e329b7bf06a to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015112863c46c09890f49e48ea39e329b7bf06a 2023-03-06 11:54:23,043 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/.tmp/family1/5b7a1617dde44615bf4c48fa0caea55a 2023-03-06 11:54:23,048 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/.tmp/family1/5b7a1617dde44615bf4c48fa0caea55a as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/5b7a1617dde44615bf4c48fa0caea55a 2023-03-06 11:54:23,053 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/5b7a1617dde44615bf4c48fa0caea55a, entries=1, sequenceid=9, filesize=5.0 K 2023-03-06 11:54:23,054 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 6bbeca1f31f3e780fe3cccddcf90df08 in 432ms, sequenceid=9, compaction requested=false 2023-03-06 11:54:23,054 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6bbeca1f31f3e780fe3cccddcf90df08: 2023-03-06 11:54:23,054 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1678103659482.6bbeca1f31f3e780fe3cccddcf90df08. 2023-03-06 11:54:23,054 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-06 11:54:23,054 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-06 11:54:23,054 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:23,054 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-06 11:54:23,054 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-06 11:54:23,056 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:23,056 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:23,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:23,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:23,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:23,056 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:23,056 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:54:23,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:23,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:23,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:23,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:23,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:23,058 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-06 11:54:23,058 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1c129f4a[Count = 0] remaining members to acquire global barrier 2023-03-06 11:54:23,058 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-06 11:54:23,058 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:23,060 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:23,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:23,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:23,060 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-06 11:54:23,060 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-06 11:54:23,060 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:54:23,060 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:23,060 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:54:23,062 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-06 11:54:23,062 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:23,062 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:23,062 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-06 11:54:23,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:23,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:23,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:23,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:23,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:23,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:23,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:23,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:23,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:23,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:23,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:54:23,065 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-06 11:54:23,065 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-06 11:54:23,065 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:54:23,065 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:54:23,065 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:23,065 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:54:23,066 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:23,066 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:23,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:23,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:23,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:23,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:23,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:23,066 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:23,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:23,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:23,067 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:23,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:23,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:23,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:23,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:23,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:23,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:23,068 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:23,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:23,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:23,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:23,080 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:23,080 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:23,080 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:23,080 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-06 11:54:23,080 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:23,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:23,080 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-06 11:54:23,080 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:54:23,080 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:23,080 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:23,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:23,080 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:23,081 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:23,081 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:23,081 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:23,081 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-06 11:54:23,081 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:54:23,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:23,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:23,181 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:54:23,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:54:23,188 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:54:23,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-06 11:54:23,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:23,190 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-06 11:54:23,190 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:23,191 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-06 11:54:23,191 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-06 11:54:23,191 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:23,191 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:23,193 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:23,193 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:23,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:23,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:23,193 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:23,193 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:54:23,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:23,193 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:23,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:54:23,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:23,194 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:23,194 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-06 11:54:23,194 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:23,194 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-06 11:54:23,194 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:23,195 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-06 11:54:23,195 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-06 11:54:23,195 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:54:23,195 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1678103659482.6bbeca1f31f3e780fe3cccddcf90df08. 2023-03-06 11:54:23,195 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1678103659482.6bbeca1f31f3e780fe3cccddcf90df08. started... 2023-03-06 11:54:23,195 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6bbeca1f31f3e780fe3cccddcf90df08 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-06 11:54:23,610 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201c20bcc62076c4a98a6dc9a7212ddbe11 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201c20bcc62076c4a98a6dc9a7212ddbe11 2023-03-06 11:54:23,644 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-06 11:54:24,016 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/.tmp/family1/c7db2c559607457cbb6a3e9636f343d2 2023-03-06 11:54:24,023 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/.tmp/family1/c7db2c559607457cbb6a3e9636f343d2 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/c7db2c559607457cbb6a3e9636f343d2 2023-03-06 11:54:24,029 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/c7db2c559607457cbb6a3e9636f343d2, entries=1, sequenceid=13, filesize=4.9 K 2023-03-06 11:54:24,030 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6bbeca1f31f3e780fe3cccddcf90df08 in 835ms, sequenceid=13, compaction requested=true 2023-03-06 11:54:24,030 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6bbeca1f31f3e780fe3cccddcf90df08: 2023-03-06 11:54:24,030 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1678103659482.6bbeca1f31f3e780fe3cccddcf90df08. 2023-03-06 11:54:24,030 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-06 11:54:24,030 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-06 11:54:24,030 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:24,030 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-06 11:54:24,030 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-06 11:54:24,074 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:24,074 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:24,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:24,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:24,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:24,074 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:24,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:24,074 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:54:24,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:24,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:24,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:24,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:24,076 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-06 11:54:24,076 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@567e3732[Count = 0] remaining members to acquire global barrier 2023-03-06 11:54:24,076 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-06 11:54:24,076 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:24,152 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:24,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:24,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:24,153 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:24,153 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:54:24,153 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-06 11:54:24,153 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-06 11:54:24,153 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:54:24,228 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-06 11:54:24,228 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:24,228 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:24,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:24,228 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-06 11:54:24,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:24,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:24,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:24,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:24,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:24,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:24,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:24,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:24,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:24,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:54:24,231 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-06 11:54:24,231 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-06 11:54:24,231 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:54:24,231 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:54:24,231 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:24,231 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:54:24,274 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:24,274 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:24,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:24,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:24,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:24,274 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:24,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:24,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:24,274 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:24,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:24,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:24,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:24,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:24,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:24,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:24,275 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:24,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:24,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:24,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:24,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:24,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:24,335 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:24,335 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:24,335 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:24,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:24,335 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:24,335 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-06 11:54:24,336 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:54:24,335 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:24,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:24,336 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:24,336 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:24,337 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:24,337 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-06 11:54:24,337 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:24,337 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-06 11:54:24,337 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:54:24,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:24,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:24,337 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:24,437 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:54:24,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:54:24,443 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:54:24,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-06 11:54:24,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:24,446 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-06 11:54:24,446 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:24,447 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-06 11:54:24,447 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-06 11:54:24,448 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:24,448 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:24,489 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:24,489 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:24,489 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:24,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:24,490 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:24,490 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:54:24,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:24,490 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:24,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:54:24,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:24,491 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:24,491 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-06 11:54:24,491 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:24,491 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-06 11:54:24,491 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:24,492 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-06 11:54:24,492 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-06 11:54:24,492 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:54:24,492 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1678103659482.6bbeca1f31f3e780fe3cccddcf90df08. 2023-03-06 11:54:24,492 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1678103659482.6bbeca1f31f3e780fe3cccddcf90df08. started... 2023-03-06 11:54:24,492 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6bbeca1f31f3e780fe3cccddcf90df08 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-06 11:54:24,907 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512054d33ef8cbe0843dba61db2ce5409e739 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512054d33ef8cbe0843dba61db2ce5409e739 2023-03-06 11:54:25,315 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/.tmp/family1/e4a63627cba949bcbc7b7442cd0f1fd3 2023-03-06 11:54:25,321 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/.tmp/family1/e4a63627cba949bcbc7b7442cd0f1fd3 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/e4a63627cba949bcbc7b7442cd0f1fd3 2023-03-06 11:54:25,325 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/e4a63627cba949bcbc7b7442cd0f1fd3, entries=1, sequenceid=17, filesize=4.9 K 2023-03-06 11:54:25,326 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6bbeca1f31f3e780fe3cccddcf90df08 in 834ms, sequenceid=17, compaction requested=true 2023-03-06 11:54:25,326 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6bbeca1f31f3e780fe3cccddcf90df08: 2023-03-06 11:54:25,326 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1678103659482.6bbeca1f31f3e780fe3cccddcf90df08. 2023-03-06 11:54:25,326 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-06 11:54:25,327 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-06 11:54:25,327 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:25,327 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-06 11:54:25,327 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-06 11:54:25,328 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:25,328 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:25,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:25,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:25,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:25,329 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:25,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:25,329 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:54:25,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:25,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:25,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:25,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:25,330 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-06 11:54:25,330 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6a13cee2[Count = 0] remaining members to acquire global barrier 2023-03-06 11:54:25,330 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-06 11:54:25,331 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:25,332 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:25,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:25,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:25,332 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-06 11:54:25,332 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-06 11:54:25,332 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:54:25,332 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:25,332 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:54:25,333 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-06 11:54:25,333 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:25,333 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:25,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:25,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:25,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:25,333 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-06 11:54:25,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:25,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:25,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:25,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:25,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:25,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:25,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:25,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:54:25,337 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-06 11:54:25,337 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-06 11:54:25,337 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:54:25,337 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:54:25,337 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:25,337 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:54:25,340 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:25,340 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:25,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:25,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:25,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:25,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:25,340 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:25,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:25,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:25,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:25,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:25,340 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:25,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:25,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:25,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:25,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:25,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:25,342 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:25,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:25,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:25,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:25,344 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:25,344 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:25,344 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:25,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:25,344 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:25,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:25,344 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:25,344 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-06 11:54:25,344 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:54:25,344 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:25,344 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:25,344 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:25,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:25,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:25,345 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:25,345 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:25,345 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-06 11:54:25,345 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:54:25,445 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:54:25,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:54:25,451 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:54:25,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-06 11:54:25,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:25,453 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-06 11:54:25,453 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:25,453 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-06 11:54:25,453 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-06 11:54:25,454 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:25,454 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:25,455 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:25,455 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:25,455 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:25,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:25,455 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:25,455 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:54:25,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:25,455 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:25,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:54:25,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:25,456 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:25,456 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-06 11:54:25,456 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:25,456 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-06 11:54:25,456 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:25,457 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-06 11:54:25,457 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-06 11:54:25,457 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:54:25,457 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1678103659482.6bbeca1f31f3e780fe3cccddcf90df08. 2023-03-06 11:54:25,457 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1678103659482.6bbeca1f31f3e780fe3cccddcf90df08. started... 2023-03-06 11:54:25,457 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6bbeca1f31f3e780fe3cccddcf90df08 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-06 11:54:25,874 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122861c3823d282b4ebbbbba4de16409a256 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015122861c3823d282b4ebbbbba4de16409a256 2023-03-06 11:54:25,885 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/.tmp/family1/39ec484196aa40e4bc7188c644f684be 2023-03-06 11:54:25,893 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/.tmp/family1/39ec484196aa40e4bc7188c644f684be as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/39ec484196aa40e4bc7188c644f684be 2023-03-06 11:54:25,899 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/39ec484196aa40e4bc7188c644f684be, entries=1, sequenceid=21, filesize=4.9 K 2023-03-06 11:54:25,901 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6bbeca1f31f3e780fe3cccddcf90df08 in 444ms, sequenceid=21, compaction requested=true 2023-03-06 11:54:25,901 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6bbeca1f31f3e780fe3cccddcf90df08: 2023-03-06 11:54:25,901 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1678103659482.6bbeca1f31f3e780fe3cccddcf90df08. 2023-03-06 11:54:25,901 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-06 11:54:25,901 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-06 11:54:25,901 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:25,901 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-06 11:54:25,901 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-06 11:54:25,903 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:25,903 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:25,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:25,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:25,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:25,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:25,908 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:25,908 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:54:25,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:25,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:25,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:25,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:25,910 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-06 11:54:25,910 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@66897900[Count = 0] remaining members to acquire global barrier 2023-03-06 11:54:25,910 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-06 11:54:25,910 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:25,912 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:25,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:25,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:25,913 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-06 11:54:25,913 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-06 11:54:25,913 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:25,913 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:54:25,913 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:54:25,915 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-06 11:54:25,915 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:25,915 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:25,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:25,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:25,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:25,915 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-06 11:54:25,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:25,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:25,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:25,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:25,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:25,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:25,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:25,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:54:25,918 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-06 11:54:25,918 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-06 11:54:25,919 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:54:25,919 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:54:25,919 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:25,919 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:54:25,927 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:25,927 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:25,927 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:25,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:25,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:25,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:25,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:25,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:25,927 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:25,928 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:25,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:25,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:25,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:25,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:25,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:25,929 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:25,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:25,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:25,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:25,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:25,931 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:25,931 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:25,931 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:25,931 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:25,931 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-06 11:54:25,932 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:25,931 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:25,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:25,932 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:25,932 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:54:25,932 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-06 11:54:25,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:25,933 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-06 11:54:25,933 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:54:25,932 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:25,933 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:25,933 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:25,933 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:25,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:26,033 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:54:26,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:54:26,040 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:54:26,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-06 11:54:26,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:26,042 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-06 11:54:26,042 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:26,043 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-06 11:54:26,043 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-06 11:54:26,043 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:26,043 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:26,045 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:26,045 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:26,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:26,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:26,045 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:26,045 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:54:26,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:26,046 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:26,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:54:26,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:26,046 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:26,046 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-06 11:54:26,046 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:26,046 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-06 11:54:26,046 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:26,047 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-06 11:54:26,049 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-06 11:54:26,049 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:54:26,049 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1678103659482.6bbeca1f31f3e780fe3cccddcf90df08. 2023-03-06 11:54:26,049 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1678103659482.6bbeca1f31f3e780fe3cccddcf90df08. started... 2023-03-06 11:54:26,049 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6bbeca1f31f3e780fe3cccddcf90df08 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-06 11:54:26,471 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231ce13d5afd5ff4aa2ae1fea6ecee8da83 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231ce13d5afd5ff4aa2ae1fea6ecee8da83 2023-03-06 11:54:26,477 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/.tmp/family1/ecc28d2466aa4c318b55bf279a9787f8 2023-03-06 11:54:26,484 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/.tmp/family1/ecc28d2466aa4c318b55bf279a9787f8 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/ecc28d2466aa4c318b55bf279a9787f8 2023-03-06 11:54:26,489 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/ecc28d2466aa4c318b55bf279a9787f8, entries=1, sequenceid=25, filesize=4.9 K 2023-03-06 11:54:26,490 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6bbeca1f31f3e780fe3cccddcf90df08 in 441ms, sequenceid=25, compaction requested=true 2023-03-06 11:54:26,490 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6bbeca1f31f3e780fe3cccddcf90df08: 2023-03-06 11:54:26,490 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1678103659482.6bbeca1f31f3e780fe3cccddcf90df08. 2023-03-06 11:54:26,490 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-06 11:54:26,490 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-06 11:54:26,490 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:26,490 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-06 11:54:26,490 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-06 11:54:26,492 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:26,492 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:26,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:26,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:26,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:26,492 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:26,493 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:54:26,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:26,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:26,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:26,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:26,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:26,494 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-06 11:54:26,494 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6e695254[Count = 0] remaining members to acquire global barrier 2023-03-06 11:54:26,494 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-06 11:54:26,494 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:26,496 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:26,496 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:26,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:26,496 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-06 11:54:26,497 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-06 11:54:26,497 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:54:26,497 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:26,497 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:54:26,498 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-06 11:54:26,498 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:26,498 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:26,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:26,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:26,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:26,498 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-06 11:54:26,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:26,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:26,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:26,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:26,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:26,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:26,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:26,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:54:26,501 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-06 11:54:26,501 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-06 11:54:26,501 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:54:26,501 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:54:26,501 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:26,501 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:54:26,502 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:26,502 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:26,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:26,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:26,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:26,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:26,503 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:26,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:26,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:26,503 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:26,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:26,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:26,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:26,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:26,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:26,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:26,504 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:26,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:26,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:26,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:26,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:26,506 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:26,506 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:26,507 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:26,507 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:26,507 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:26,507 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:26,507 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:26,507 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-06 11:54:26,507 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:54:26,507 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:26,508 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-06 11:54:26,507 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:26,508 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:26,508 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-06 11:54:26,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:26,508 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:54:26,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:26,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:26,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:26,608 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:54:26,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:54:26,615 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:54:26,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-06 11:54:26,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:26,617 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-06 11:54:26,617 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:26,618 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-06 11:54:26,618 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-06 11:54:26,618 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:26,618 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:26,620 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:26,621 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:26,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:26,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:26,621 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:26,621 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:54:26,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:26,621 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:26,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:54:26,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:26,622 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:26,622 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-06 11:54:26,622 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:26,622 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-06 11:54:26,622 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:26,623 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-06 11:54:26,623 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-06 11:54:26,623 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:54:26,623 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1678103659482.6bbeca1f31f3e780fe3cccddcf90df08. 2023-03-06 11:54:26,623 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1678103659482.6bbeca1f31f3e780fe3cccddcf90df08. started... 2023-03-06 11:54:26,623 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6bbeca1f31f3e780fe3cccddcf90df08 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-06 11:54:27,041 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101ac6c3440f7c14d5cb7b5575967aaaa8e to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101ac6c3440f7c14d5cb7b5575967aaaa8e 2023-03-06 11:54:27,051 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/.tmp/family1/424090b0b8ac4781a126134448f0c823 2023-03-06 11:54:27,060 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/.tmp/family1/424090b0b8ac4781a126134448f0c823 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/424090b0b8ac4781a126134448f0c823 2023-03-06 11:54:27,065 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/424090b0b8ac4781a126134448f0c823, entries=1, sequenceid=29, filesize=4.9 K 2023-03-06 11:54:27,067 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6bbeca1f31f3e780fe3cccddcf90df08 in 444ms, sequenceid=29, compaction requested=true 2023-03-06 11:54:27,067 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6bbeca1f31f3e780fe3cccddcf90df08: 2023-03-06 11:54:27,067 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1678103659482.6bbeca1f31f3e780fe3cccddcf90df08. 2023-03-06 11:54:27,067 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-06 11:54:27,067 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-06 11:54:27,067 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:27,067 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-06 11:54:27,067 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-06 11:54:27,069 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,069 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:27,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:27,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:27,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:27,069 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:27,069 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:54:27,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:27,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:27,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:27,071 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-06 11:54:27,071 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@49093f0c[Count = 0] remaining members to acquire global barrier 2023-03-06 11:54:27,071 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-06 11:54:27,071 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,072 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,072 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-06 11:54:27,072 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:27,072 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:54:27,072 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-06 11:54:27,072 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:54:27,074 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-06 11:54:27,074 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:27,074 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:27,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:27,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:27,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:27,074 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-06 11:54:27,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:27,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:27,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:27,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:27,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:27,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:54:27,077 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-06 11:54:27,077 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-06 11:54:27,077 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:54:27,077 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:54:27,077 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,077 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:54:27,081 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,081 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,081 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:27,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:27,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:27,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:27,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:27,082 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:27,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:27,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:27,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,083 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:27,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:27,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:27,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:27,086 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:27,086 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:27,086 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-06 11:54:27,086 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:54:27,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:27,086 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:27,086 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:27,086 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-06 11:54:27,086 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:27,087 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,087 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-06 11:54:27,087 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:54:27,087 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:27,087 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:27,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:27,087 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,087 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,187 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:54:27,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:54:27,194 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:54:27,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-06 11:54:27,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,195 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-06 11:54:27,195 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:27,196 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-06 11:54:27,196 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-06 11:54:27,196 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,196 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,197 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:27,198 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:27,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:27,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:27,198 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:27,198 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:54:27,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,198 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:54:27,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,199 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,199 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-06 11:54:27,199 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,199 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-06 11:54:27,199 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:27,200 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-06 11:54:27,200 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-06 11:54:27,201 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:54:27,201 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1678103659482.6bbeca1f31f3e780fe3cccddcf90df08. 2023-03-06 11:54:27,201 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1678103659482.6bbeca1f31f3e780fe3cccddcf90df08. started... 2023-03-06 11:54:27,201 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6bbeca1f31f3e780fe3cccddcf90df08 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-06 11:54:27,618 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010388aff3f87dfa4622b583c707910b1830 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010388aff3f87dfa4622b583c707910b1830 2023-03-06 11:54:27,630 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/.tmp/family1/3a5fa02b73bc4719a1bcbbc46e9c2652 2023-03-06 11:54:27,641 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/.tmp/family1/3a5fa02b73bc4719a1bcbbc46e9c2652 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/3a5fa02b73bc4719a1bcbbc46e9c2652 2023-03-06 11:54:27,647 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/3a5fa02b73bc4719a1bcbbc46e9c2652, entries=1, sequenceid=33, filesize=4.9 K 2023-03-06 11:54:27,649 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6bbeca1f31f3e780fe3cccddcf90df08 in 448ms, sequenceid=33, compaction requested=true 2023-03-06 11:54:27,649 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6bbeca1f31f3e780fe3cccddcf90df08: 2023-03-06 11:54:27,649 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1678103659482.6bbeca1f31f3e780fe3cccddcf90df08. 2023-03-06 11:54:27,649 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-06 11:54:27,649 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-06 11:54:27,649 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:27,649 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-06 11:54:27,649 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-06 11:54:27,651 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:27,651 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:27,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:27,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:27,651 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,651 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:54:27,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:27,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:27,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:27,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:27,653 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-06 11:54:27,653 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3d199c11[Count = 0] remaining members to acquire global barrier 2023-03-06 11:54:27,653 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-06 11:54:27,653 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,655 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,655 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-06 11:54:27,655 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-06 11:54:27,655 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:54:27,655 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:27,655 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:54:27,660 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-06 11:54:27,660 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:27,660 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:27,660 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-06 11:54:27,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:27,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:27,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:27,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:27,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:27,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:27,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:27,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:27,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:54:27,663 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-06 11:54:27,663 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-06 11:54:27,664 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:54:27,664 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:54:27,664 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,664 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:54:27,665 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,665 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:27,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:27,665 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:27,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,666 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:27,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:27,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:27,666 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:27,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:27,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,668 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:27,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:27,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:27,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:27,671 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:27,672 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,672 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,672 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:27,672 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:27,672 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:27,672 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:27,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:27,672 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:27,672 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,672 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-06 11:54:27,672 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:54:27,672 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,672 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,672 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-06 11:54:27,672 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-06 11:54:27,672 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:27,673 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:54:27,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:27,773 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:54:27,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:54:27,779 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:54:27,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-06 11:54:27,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,782 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-06 11:54:27,782 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:27,783 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-06 11:54:27,783 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-06 11:54:27,783 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,783 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,784 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:27,784 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:27,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:27,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:27,785 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:27,785 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:54:27,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,786 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:54:27,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,786 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,786 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-06 11:54:27,786 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,787 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-06 11:54:27,787 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:27,787 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-06 11:54:27,787 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-06 11:54:27,787 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:54:27,787 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1678103659482.6bbeca1f31f3e780fe3cccddcf90df08. 2023-03-06 11:54:27,787 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1678103659482.6bbeca1f31f3e780fe3cccddcf90df08. started... 2023-03-06 11:54:27,788 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6bbeca1f31f3e780fe3cccddcf90df08 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-06 11:54:27,807 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509074ce0c934e2fb466aade112ca994acad4 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201509074ce0c934e2fb466aade112ca994acad4 2023-03-06 11:54:27,813 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/.tmp/family1/feca09892afa4743b73c71568c5fbd85 2023-03-06 11:54:27,824 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/.tmp/family1/feca09892afa4743b73c71568c5fbd85 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/feca09892afa4743b73c71568c5fbd85 2023-03-06 11:54:27,832 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/feca09892afa4743b73c71568c5fbd85, entries=1, sequenceid=37, filesize=4.9 K 2023-03-06 11:54:27,834 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6bbeca1f31f3e780fe3cccddcf90df08 in 46ms, sequenceid=37, compaction requested=true 2023-03-06 11:54:27,834 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6bbeca1f31f3e780fe3cccddcf90df08: 2023-03-06 11:54:27,834 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1678103659482.6bbeca1f31f3e780fe3cccddcf90df08. 2023-03-06 11:54:27,834 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-06 11:54:27,834 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-06 11:54:27,834 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:27,834 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-06 11:54:27,834 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-06 11:54:27,836 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:27,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:27,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:27,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:27,836 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:27,837 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,837 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:54:27,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:27,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:27,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:27,839 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-06 11:54:27,839 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1075b3cb[Count = 0] remaining members to acquire global barrier 2023-03-06 11:54:27,839 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-06 11:54:27,839 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,840 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,840 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-06 11:54:27,840 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-06 11:54:27,840 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:27,840 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:54:27,840 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:54:27,843 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:27,843 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-06 11:54:27,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:27,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:27,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:27,843 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:27,844 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-06 11:54:27,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:27,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:27,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:27,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:27,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:27,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:54:27,847 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-06 11:54:27,847 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-06 11:54:27,848 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:54:27,848 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:54:27,848 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,848 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:54:27,850 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,850 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:27,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:27,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,850 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:27,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:27,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:27,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:27,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,851 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:27,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:27,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,853 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:27,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:27,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:27,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:27,856 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:27,856 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:27,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:27,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:27,856 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-06 11:54:27,856 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:54:27,856 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,856 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,856 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:27,856 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,856 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,856 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,856 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:27,856 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:27,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:27,857 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-06 11:54:27,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:27,857 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-06 11:54:27,857 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:54:27,958 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:54:27,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:54:27,965 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:54:27,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-06 11:54:27,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,967 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-06 11:54:27,967 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:27,968 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-06 11:54:27,968 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-06 11:54:27,969 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,969 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,971 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:27,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:27,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:27,971 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:27,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,971 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:27,972 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:54:27,972 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:54:27,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,972 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,977 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-06 11:54:27,977 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:27,977 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-06 11:54:27,978 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:27,979 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-06 11:54:27,980 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-06 11:54:27,980 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:54:27,980 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1678103659482.6bbeca1f31f3e780fe3cccddcf90df08. 2023-03-06 11:54:27,980 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1678103659482.6bbeca1f31f3e780fe3cccddcf90df08. started... 2023-03-06 11:54:27,980 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6bbeca1f31f3e780fe3cccddcf90df08 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-06 11:54:28,402 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120bd160d911299449cb4c118091c2c1d41 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120bd160d911299449cb4c118091c2c1d41 2023-03-06 11:54:28,411 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/.tmp/family1/547fd8c84a2d4a4b83250485a4a41788 2023-03-06 11:54:28,417 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/.tmp/family1/547fd8c84a2d4a4b83250485a4a41788 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/547fd8c84a2d4a4b83250485a4a41788 2023-03-06 11:54:28,423 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/547fd8c84a2d4a4b83250485a4a41788, entries=1, sequenceid=41, filesize=4.9 K 2023-03-06 11:54:28,424 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6bbeca1f31f3e780fe3cccddcf90df08 in 444ms, sequenceid=41, compaction requested=true 2023-03-06 11:54:28,424 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6bbeca1f31f3e780fe3cccddcf90df08: 2023-03-06 11:54:28,424 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1678103659482.6bbeca1f31f3e780fe3cccddcf90df08. 2023-03-06 11:54:28,424 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-06 11:54:28,425 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-06 11:54:28,425 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:28,425 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-06 11:54:28,425 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-06 11:54:28,428 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:28,428 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:28,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:28,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:28,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:28,429 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:28,429 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:54:28,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:28,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:28,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:28,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:28,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:28,430 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-06 11:54:28,430 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@34aaa863[Count = 0] remaining members to acquire global barrier 2023-03-06 11:54:28,430 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-06 11:54:28,430 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:28,432 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:28,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:28,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:28,432 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-06 11:54:28,432 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-06 11:54:28,432 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:54:28,432 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:28,432 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:54:28,433 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:28,433 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-06 11:54:28,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:28,434 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:28,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:28,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:28,434 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-06 11:54:28,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:28,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:28,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:28,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:28,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:28,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:28,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:28,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:54:28,437 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-06 11:54:28,437 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-06 11:54:28,437 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:54:28,437 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:54:28,437 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:28,437 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:54:28,439 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:28,439 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:28,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:28,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:28,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:28,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:28,439 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:28,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:28,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:28,440 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:28,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:28,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:28,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:28,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:28,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:28,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:28,441 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:28,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:28,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:28,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:28,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:28,445 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:28,445 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:28,445 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:28,445 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:28,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:28,445 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-06 11:54:28,445 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-06 11:54:28,445 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:54:28,445 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:28,445 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:28,445 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:28,445 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:28,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:28,447 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:28,447 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-06 11:54:28,447 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:28,447 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:54:28,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:28,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:28,547 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:54:28,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:54:28,550 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=36301] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithMonthlyPolicy 2023-03-06 11:54:28,552 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] procedure2.ProcedureExecutor(1029): Stored pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-06 11:54:28,553 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-06 11:54:28,555 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=22, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678104268555 2023-03-06 11:54:28,556 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-06 11:54:28,557 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-06 11:54:28,559 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithMonthlyPolicy' and column 'family1' 2023-03-06 11:54:28,559 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-06 11:54:28,559 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] zookeeper.ReadOnlyZKClient(139): Connect 0x04a113f0 to 127.0.0.1:62659 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-06 11:54:28,564 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@20b8def0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-06 11:54:28,565 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-06 11:54:29,405 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010399b15ce4c14246a588ba68ef8c0cc503 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010399b15ce4c14246a588ba68ef8c0cc503 2023-03-06 11:54:29,407 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-06 11:54:29,420 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-06 11:54:29,421 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:46070, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-06 11:54:29,428 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-06 11:54:29,429 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:48484, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-06 11:54:29,439 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/de10aaa400ec4a4e97fe153e5c7d3a61 first=Optional[r5] last=Optional[r6] 2023-03-06 11:54:29,440 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1678103659482.6bbeca1f31f3e780fe3cccddcf90df08., hostname=jenkins-hbase5.apache.org,42547,1678103642479, seqNum=2 for row with hfile group [{family1,hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/de10aaa400ec4a4e97fe153e5c7d3a61}] 2023-03-06 11:54:29,444 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(763): Validating hfile at hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/de10aaa400ec4a4e97fe153e5c7d3a61 for inclusion in 6bbeca1f31f3e780fe3cccddcf90df08/family1 2023-03-06 11:54:29,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-03-06 11:54:29,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(777): Region bounds: first= last= 2023-03-06 11:54:29,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegion(2446): Flush status journal for 6bbeca1f31f3e780fe3cccddcf90df08: 2023-03-06 11:54:29,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/de10aaa400ec4a4e97fe153e5c7d3a61 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionWithMonthlyPolicy__noc4rueg7nprah8os5mtlqrs5c9us39bn6c9r0res4enaj5u6uo397oif0ujbu6k/family1/de10aaa400ec4a4e97fe153e5c7d3a61 2023-03-06 11:54:29,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionWithMonthlyPolicy__noc4rueg7nprah8os5mtlqrs5c9us39bn6c9r0res4enaj5u6uo397oif0ujbu6k/family1/de10aaa400ec4a4e97fe153e5c7d3a61 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/1efa5b546233461497fe0ac18f6874b8_SeqId_44_ 2023-03-06 11:54:29,452 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(849): Loaded HFile hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionWithMonthlyPolicy__noc4rueg7nprah8os5mtlqrs5c9us39bn6c9r0res4enaj5u6uo397oif0ujbu6k/family1/de10aaa400ec4a4e97fe153e5c7d3a61 into 6bbeca1f31f3e780fe3cccddcf90df08/family1 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/1efa5b546233461497fe0ac18f6874b8_SeqId_44_ - updating store file list. 2023-03-06 11:54:29,456 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(882): Loaded HFile hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/1efa5b546233461497fe0ac18f6874b8_SeqId_44_ into 6bbeca1f31f3e780fe3cccddcf90df08/family1 2023-03-06 11:54:29,456 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(855): Successfully loaded hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionWithMonthlyPolicy__noc4rueg7nprah8os5mtlqrs5c9us39bn6c9r0res4enaj5u6uo397oif0ujbu6k/family1/de10aaa400ec4a4e97fe153e5c7d3a61 into 6bbeca1f31f3e780fe3cccddcf90df08/family1 (new location: hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/1efa5b546233461497fe0ac18f6874b8_SeqId_44_) 2023-03-06 11:54:29,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionWithMonthlyPolicy__noc4rueg7nprah8os5mtlqrs5c9us39bn6c9r0res4enaj5u6uo397oif0ujbu6k/family1/de10aaa400ec4a4e97fe153e5c7d3a61 2023-03-06 11:54:29,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-06 11:54:29,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-06 11:54:29,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(1912): 6bbeca1f31f3e780fe3cccddcf90df08/family1 is initiating minor compaction 2023-03-06 11:54:29,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@390c5e5d; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-06 11:54:29,460 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 6bbeca1f31f3e780fe3cccddcf90df08/family1 in testMajorCompactionWithMonthlyPolicy,,1678103659482.6bbeca1f31f3e780fe3cccddcf90df08. 2023-03-06 11:54:29,460 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/5b7a1617dde44615bf4c48fa0caea55a, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/c7db2c559607457cbb6a3e9636f343d2, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/e4a63627cba949bcbc7b7442cd0f1fd3, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/39ec484196aa40e4bc7188c644f684be, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/ecc28d2466aa4c318b55bf279a9787f8, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/424090b0b8ac4781a126134448f0c823, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/3a5fa02b73bc4719a1bcbbc46e9c2652, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/feca09892afa4743b73c71568c5fbd85, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/547fd8c84a2d4a4b83250485a4a41788, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/1efa5b546233461497fe0ac18f6874b8_SeqId_44_] into tmpdir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/.tmp, totalSize=49.7 K 2023-03-06 11:54:29,461 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting 5b7a1617dde44615bf4c48fa0caea55a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-06 11:54:29,461 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting c7db2c559607457cbb6a3e9636f343d2, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-06 11:54:29,461 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting e4a63627cba949bcbc7b7442cd0f1fd3, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-06 11:54:29,461 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting 39ec484196aa40e4bc7188c644f684be, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-06 11:54:29,461 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting ecc28d2466aa4c318b55bf279a9787f8, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-06 11:54:29,461 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting 424090b0b8ac4781a126134448f0c823, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-06 11:54:29,461 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting 3a5fa02b73bc4719a1bcbbc46e9c2652, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-06 11:54:29,461 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting feca09892afa4743b73c71568c5fbd85, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-06 11:54:29,461 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting 547fd8c84a2d4a4b83250485a4a41788, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-06 11:54:29,461 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting 1efa5b546233461497fe0ac18f6874b8_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-06 11:54:29,462 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-06 11:54:29,463 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:54:29,465 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101ac6c3440f7c14d5cb7b5575967aaaa8e to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101ac6c3440f7c14d5cb7b5575967aaaa8e 2023-03-06 11:54:29,466 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010388aff3f87dfa4622b583c707910b1830 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010388aff3f87dfa4622b583c707910b1830 2023-03-06 11:54:29,466 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-03-06 11:54:29,467 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-03-06 11:54:29,467 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-06 11:54:29,467 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-06 11:54:29,502 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] throttle.PressureAwareThroughputController(145): 6bbeca1f31f3e780fe3cccddcf90df08#family1#compaction#22 average throughput is 0.27 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-06 11:54:30,324 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231ac556f35dd0c4d12b95eebb675b13564 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231ac556f35dd0c4d12b95eebb675b13564 2023-03-06 11:54:30,325 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-06 11:54:30,326 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/.tmp/family1/9b9acc577d9a4ee19a7085de605a2e01 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/9b9acc577d9a4ee19a7085de605a2e01 2023-03-06 11:54:30,332 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 6bbeca1f31f3e780fe3cccddcf90df08/family1 of 6bbeca1f31f3e780fe3cccddcf90df08 into 9b9acc577d9a4ee19a7085de605a2e01(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-06 11:54:30,332 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 6bbeca1f31f3e780fe3cccddcf90df08: 2023-03-06 11:54:30,332 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1678103659482.6bbeca1f31f3e780fe3cccddcf90df08., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1678103669460; duration=0sec 2023-03-06 11:54:30,333 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-06 11:54:30,351 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/d6d647654ede4ed9917c34d2495b654d first=Optional[r1] last=Optional[r4] 2023-03-06 11:54:30,351 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1678103659482.6bbeca1f31f3e780fe3cccddcf90df08., hostname=jenkins-hbase5.apache.org,42547,1678103642479, seqNum=2 for row with hfile group [{family1,hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/d6d647654ede4ed9917c34d2495b654d}] 2023-03-06 11:54:30,353 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(763): Validating hfile at hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/d6d647654ede4ed9917c34d2495b654d for inclusion in 6bbeca1f31f3e780fe3cccddcf90df08/family1 2023-03-06 11:54:30,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-03-06 11:54:30,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(777): Region bounds: first= last= 2023-03-06 11:54:30,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegion(2446): Flush status journal for 6bbeca1f31f3e780fe3cccddcf90df08: 2023-03-06 11:54:30,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/d6d647654ede4ed9917c34d2495b654d to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionWithMonthlyPolicy__cvp6n5n3kte2msc6iisnl6c0csiuvui775q3a4jeqfk1acjnocod889b4rpo8gc0/family1/d6d647654ede4ed9917c34d2495b654d 2023-03-06 11:54:30,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionWithMonthlyPolicy__cvp6n5n3kte2msc6iisnl6c0csiuvui775q3a4jeqfk1acjnocod889b4rpo8gc0/family1/d6d647654ede4ed9917c34d2495b654d as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/bfb3606c471c495ba935669644241a5f_SeqId_47_ 2023-03-06 11:54:30,362 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(849): Loaded HFile hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionWithMonthlyPolicy__cvp6n5n3kte2msc6iisnl6c0csiuvui775q3a4jeqfk1acjnocod889b4rpo8gc0/family1/d6d647654ede4ed9917c34d2495b654d into 6bbeca1f31f3e780fe3cccddcf90df08/family1 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/bfb3606c471c495ba935669644241a5f_SeqId_47_ - updating store file list. 2023-03-06 11:54:30,366 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(882): Loaded HFile hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/bfb3606c471c495ba935669644241a5f_SeqId_47_ into 6bbeca1f31f3e780fe3cccddcf90df08/family1 2023-03-06 11:54:30,366 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(855): Successfully loaded hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionWithMonthlyPolicy__cvp6n5n3kte2msc6iisnl6c0csiuvui775q3a4jeqfk1acjnocod889b4rpo8gc0/family1/d6d647654ede4ed9917c34d2495b654d into 6bbeca1f31f3e780fe3cccddcf90df08/family1 (new location: hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/bfb3606c471c495ba935669644241a5f_SeqId_47_) 2023-03-06 11:54:30,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionWithMonthlyPolicy__cvp6n5n3kte2msc6iisnl6c0csiuvui775q3a4jeqfk1acjnocod889b4rpo8gc0/family1/d6d647654ede4ed9917c34d2495b654d 2023-03-06 11:54:30,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-06 11:54:30,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-06 11:54:30,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(1912): 6bbeca1f31f3e780fe3cccddcf90df08/family1 is initiating minor compaction (all files) 2023-03-06 11:54:30,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@27f9f81e; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-06 11:54:30,368 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 6bbeca1f31f3e780fe3cccddcf90df08/family1 in testMajorCompactionWithMonthlyPolicy,,1678103659482.6bbeca1f31f3e780fe3cccddcf90df08. 2023-03-06 11:54:30,368 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/d43ad9b161dd41e0a9d5b0e48c2ed19c, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/9b9acc577d9a4ee19a7085de605a2e01, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/bfb3606c471c495ba935669644241a5f_SeqId_47_] into tmpdir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/.tmp, totalSize=178.1 K 2023-03-06 11:54:30,369 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting d43ad9b161dd41e0a9d5b0e48c2ed19c, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878806372 2023-03-06 11:54:30,370 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting 9b9acc577d9a4ee19a7085de605a2e01, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621206372 2023-03-06 11:54:30,370 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting bfb3606c471c495ba935669644241a5f_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965206372 2023-03-06 11:54:30,370 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-06 11:54:30,371 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:54:30,373 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201c20bcc62076c4a98a6dc9a7212ddbe11 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201c20bcc62076c4a98a6dc9a7212ddbe11 2023-03-06 11:54:30,375 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512054d33ef8cbe0843dba61db2ce5409e739 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512054d33ef8cbe0843dba61db2ce5409e739 2023-03-06 11:54:30,376 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015122861c3823d282b4ebbbbba4de16409a256 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015122861c3823d282b4ebbbbba4de16409a256 2023-03-06 11:54:30,378 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231ce13d5afd5ff4aa2ae1fea6ecee8da83 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231ce13d5afd5ff4aa2ae1fea6ecee8da83 2023-03-06 11:54:30,378 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-03-06 11:54:30,378 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-03-06 11:54:30,378 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-06 11:54:30,378 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-06 11:54:30,392 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] throttle.PressureAwareThroughputController(145): 6bbeca1f31f3e780fe3cccddcf90df08#family1#compaction#23 average throughput is 12.97 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-06 11:54:30,432 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/5b7a1617dde44615bf4c48fa0caea55a, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/c7db2c559607457cbb6a3e9636f343d2, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/e4a63627cba949bcbc7b7442cd0f1fd3, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/39ec484196aa40e4bc7188c644f684be, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/ecc28d2466aa4c318b55bf279a9787f8, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/424090b0b8ac4781a126134448f0c823, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/3a5fa02b73bc4719a1bcbbc46e9c2652, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/feca09892afa4743b73c71568c5fbd85, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/547fd8c84a2d4a4b83250485a4a41788, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/1efa5b546233461497fe0ac18f6874b8_SeqId_44_] to archive 2023-03-06 11:54:30,434 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:54:30,436 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/5b7a1617dde44615bf4c48fa0caea55a to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/5b7a1617dde44615bf4c48fa0caea55a 2023-03-06 11:54:30,438 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/c7db2c559607457cbb6a3e9636f343d2 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/c7db2c559607457cbb6a3e9636f343d2 2023-03-06 11:54:30,440 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/e4a63627cba949bcbc7b7442cd0f1fd3 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/e4a63627cba949bcbc7b7442cd0f1fd3 2023-03-06 11:54:30,442 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/39ec484196aa40e4bc7188c644f684be to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/39ec484196aa40e4bc7188c644f684be 2023-03-06 11:54:30,443 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/ecc28d2466aa4c318b55bf279a9787f8 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/ecc28d2466aa4c318b55bf279a9787f8 2023-03-06 11:54:30,445 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/424090b0b8ac4781a126134448f0c823 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/424090b0b8ac4781a126134448f0c823 2023-03-06 11:54:30,448 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/3a5fa02b73bc4719a1bcbbc46e9c2652 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/3a5fa02b73bc4719a1bcbbc46e9c2652 2023-03-06 11:54:30,451 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/feca09892afa4743b73c71568c5fbd85 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/feca09892afa4743b73c71568c5fbd85 2023-03-06 11:54:30,453 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/547fd8c84a2d4a4b83250485a4a41788 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/547fd8c84a2d4a4b83250485a4a41788 2023-03-06 11:54:30,454 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/1efa5b546233461497fe0ac18f6874b8_SeqId_44_ to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/1efa5b546233461497fe0ac18f6874b8_SeqId_44_ 2023-03-06 11:54:30,462 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130796febe7d36347fd9366ab27fba031ae to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130796febe7d36347fd9366ab27fba031ae 2023-03-06 11:54:30,463 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-06 11:54:30,495 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/74594640fce64282a4a67840def40591 first=Optional[r00] last=Optional[r8] 2023-03-06 11:54:30,496 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1678103659482.6bbeca1f31f3e780fe3cccddcf90df08., hostname=jenkins-hbase5.apache.org,42547,1678103642479, seqNum=2 for row with hfile group [{family1,hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/74594640fce64282a4a67840def40591}] 2023-03-06 11:54:30,498 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(763): Validating hfile at hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/74594640fce64282a4a67840def40591 for inclusion in 6bbeca1f31f3e780fe3cccddcf90df08/family1 2023-03-06 11:54:30,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-03-06 11:54:30,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(777): Region bounds: first= last= 2023-03-06 11:54:30,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegion(2446): Flush status journal for 6bbeca1f31f3e780fe3cccddcf90df08: 2023-03-06 11:54:30,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/74594640fce64282a4a67840def40591 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionWithMonthlyPolicy__em6lvrqg2h6pdhn8r009es8gbna1v982glodamlgvfp6crc6efinj252cj6t73f9/family1/74594640fce64282a4a67840def40591 2023-03-06 11:54:30,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionWithMonthlyPolicy__em6lvrqg2h6pdhn8r009es8gbna1v982glodamlgvfp6crc6efinj252cj6t73f9/family1/74594640fce64282a4a67840def40591 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/a38b1515b7ad4dca899540004b085162_SeqId_49_ 2023-03-06 11:54:30,506 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(849): Loaded HFile hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionWithMonthlyPolicy__em6lvrqg2h6pdhn8r009es8gbna1v982glodamlgvfp6crc6efinj252cj6t73f9/family1/74594640fce64282a4a67840def40591 into 6bbeca1f31f3e780fe3cccddcf90df08/family1 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/a38b1515b7ad4dca899540004b085162_SeqId_49_ - updating store file list. 2023-03-06 11:54:30,511 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(882): Loaded HFile hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/a38b1515b7ad4dca899540004b085162_SeqId_49_ into 6bbeca1f31f3e780fe3cccddcf90df08/family1 2023-03-06 11:54:30,511 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(855): Successfully loaded hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionWithMonthlyPolicy__em6lvrqg2h6pdhn8r009es8gbna1v982glodamlgvfp6crc6efinj252cj6t73f9/family1/74594640fce64282a4a67840def40591 into 6bbeca1f31f3e780fe3cccddcf90df08/family1 (new location: hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/a38b1515b7ad4dca899540004b085162_SeqId_49_) 2023-03-06 11:54:30,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionWithMonthlyPolicy__em6lvrqg2h6pdhn8r009es8gbna1v982glodamlgvfp6crc6efinj252cj6t73f9/family1/74594640fce64282a4a67840def40591 2023-03-06 11:54:30,514 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-06 11:54:30,515 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:54:30,516 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120bd160d911299449cb4c118091c2c1d41 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120bd160d911299449cb4c118091c2c1d41 2023-03-06 11:54:30,517 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015112863c46c09890f49e48ea39e329b7bf06a to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015112863c46c09890f49e48ea39e329b7bf06a 2023-03-06 11:54:30,519 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130d90cfc40a57e440fb9db39b131f90c5f to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130d90cfc40a57e440fb9db39b131f90c5f 2023-03-06 11:54:30,519 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-03-06 11:54:30,519 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-03-06 11:54:30,519 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-06 11:54:30,519 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-06 11:54:30,519 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-06 11:54:30,519 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-06 11:54:30,519 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-06 11:54:30,520 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=22, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-06 11:54:30,522 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=22, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 1.9700 sec 2023-03-06 11:54:30,625 INFO [Listener at localhost/46717] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=264 (was 249) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-385596688_15 at /127.0.0.1:35466 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62659@0x04a113f0-SendThread(127.0.0.1:62659) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-385596688_15 at /127.0.0.1:35458 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-385596688_15 at /127.0.0.1:35514 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-385596688_15 at /127.0.0.1:35534 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ResponseProcessor for block BP-1623946267-172.31.10.131-1678103637894:blk_1073741898_1074 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:118) java.io.FilterInputStream.read(FilterInputStream.java:83) java.io.FilterInputStream.read(FilterInputStream.java:83) org.apache.hadoop.hdfs.protocolPB.PBHelperClient.vintPrefixed(PBHelperClient.java:454) org.apache.hadoop.hdfs.protocol.datatransfer.PipelineAck.readFields(PipelineAck.java:213) org.apache.hadoop.hdfs.DataStreamer$ResponseProcessor.run(DataStreamer.java:1080) Potentially hanging thread: hconnection-0x54e38dec-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x54e38dec-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x54e38dec-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-385596688_15 at /127.0.0.1:35470 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataStreamer for file /user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/.tmp/family1/4ecc1f9f76a546e1bba893a21524f18e block BP-1623946267-172.31.10.131-1678103637894:blk_1073741898_1074 java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: DataStreamer for file /user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123147f1090d031c44e28e6142d315d40c44 java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: hconnection-0x6a04a222-shared-pool-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-385596688_15 at /127.0.0.1:35446 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0ddf990b-bc92-2c37-86d7-812d88f764cd/cluster_aae53e47-46ad-d770-1d84-dd40728b0050/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x54e38dec-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-385596688_15 at /127.0.0.1:35268 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-385596688_15 at /127.0.0.1:35486 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-385596688_15 at /127.0.0.1:35366 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6a04a222-shared-pool-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-385596688_15 at /127.0.0.1:35422 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-385596688_15 at /127.0.0.1:35608 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-385596688_15 at /127.0.0.1:35298 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-385596688_15 at /127.0.0.1:35524 [Waiting for operation #14] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-385596688_15 at /127.0.0.1:35390 [Waiting for operation #17] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x54e38dec-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: PacketResponder: BP-1623946267-172.31.10.131-1678103637894:blk_1073741898_1074, type=LAST_IN_PIPELINE java.lang.Object.wait(Native Method) java.lang.Object.wait(Object.java:502) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.waitForAckHead(BlockReceiver.java:1327) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.run(BlockReceiver.java:1399) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0ddf990b-bc92-2c37-86d7-812d88f764cd/cluster_aae53e47-46ad-d770-1d84-dd40728b0050/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-385596688_15 at /127.0.0.1:35516 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1949813811_15 at /127.0.0.1:35492 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-385596688_15 at /127.0.0.1:35434 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1949813811_15 at /127.0.0.1:35326 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-385596688_15 at /127.0.0.1:35380 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x54e38dec-shared-pool-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62659@0x04a113f0-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1949813811_15 at /127.0.0.1:35562 [Receiving block BP-1623946267-172.31.10.131-1678103637894:blk_1073741898_1074] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read1(BufferedInputStream.java:286) java.io.BufferedInputStream.read(BufferedInputStream.java:345) java.io.DataInputStream.read(DataInputStream.java:149) org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x54e38dec-shared-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-385596688_15 at /127.0.0.1:35506 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62659@0x04a113f0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/1675418083.run(Unknown Source) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=632 (was 593) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=304 (was 304), ProcessCount=160 (was 160), AvailableMemoryMB=10517 (was 10023) - AvailableMemoryMB LEAK? - 2023-03-06 11:54:30,636 INFO [Listener at localhost/46717] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=264, OpenFileDescriptor=632, MaxFileDescriptor=60000, SystemLoadAverage=304, ProcessCount=160, AvailableMemoryMB=10516 2023-03-06 11:54:30,639 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.HMaster$4(2112): Client=jenkins//172.31.10.131 create 'testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-06 11:54:30,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure2.ProcedureExecutor(1029): Stored pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:30,642 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-03-06 11:54:30,642 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(697): Client=jenkins//172.31.10.131 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithWeeklyPolicy" procId is: 23 2023-03-06 11:54:30,643 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-06 11:54:30,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-03-06 11:54:30,645 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449 2023-03-06 11:54:30,645 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449 empty. 2023-03-06 11:54:30,646 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449 2023-03-06 11:54:30,646 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithWeeklyPolicy regions 2023-03-06 11:54:30,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-03-06 11:54:30,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-03-06 11:54:31,056 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-03-06 11:54:31,057 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => fcd435df5abbf6c1041ee699a8544449, NAME => 'testMinorCompactionWithWeeklyPolicy,,1678103670639.fcd435df5abbf6c1041ee699a8544449.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp 2023-03-06 11:54:31,245 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/.tmp/family1/4ecc1f9f76a546e1bba893a21524f18e as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/4ecc1f9f76a546e1bba893a21524f18e 2023-03-06 11:54:31,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-03-06 11:54:31,251 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 6bbeca1f31f3e780fe3cccddcf90df08/family1 of 6bbeca1f31f3e780fe3cccddcf90df08 into 4ecc1f9f76a546e1bba893a21524f18e(size=167.4 K), total size for store is 333.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-06 11:54:31,252 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 6bbeca1f31f3e780fe3cccddcf90df08: 2023-03-06 11:54:31,252 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1678103659482.6bbeca1f31f3e780fe3cccddcf90df08., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1678103670368; duration=0sec 2023-03-06 11:54:31,252 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-06 11:54:31,305 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/d43ad9b161dd41e0a9d5b0e48c2ed19c, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/9b9acc577d9a4ee19a7085de605a2e01, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/bfb3606c471c495ba935669644241a5f_SeqId_47_] to archive 2023-03-06 11:54:31,307 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:54:31,308 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/d43ad9b161dd41e0a9d5b0e48c2ed19c to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/d43ad9b161dd41e0a9d5b0e48c2ed19c 2023-03-06 11:54:31,310 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/9b9acc577d9a4ee19a7085de605a2e01 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/9b9acc577d9a4ee19a7085de605a2e01 2023-03-06 11:54:31,311 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/bfb3606c471c495ba935669644241a5f_SeqId_47_ to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/family1/bfb3606c471c495ba935669644241a5f_SeqId_47_ 2023-03-06 11:54:31,463 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1678103670639.fcd435df5abbf6c1041ee699a8544449.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-06 11:54:31,464 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing fcd435df5abbf6c1041ee699a8544449, disabling compactions & flushes 2023-03-06 11:54:31,464 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1678103670639.fcd435df5abbf6c1041ee699a8544449. 2023-03-06 11:54:31,464 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1678103670639.fcd435df5abbf6c1041ee699a8544449. 2023-03-06 11:54:31,464 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1678103670639.fcd435df5abbf6c1041ee699a8544449. after waiting 0 ms 2023-03-06 11:54:31,464 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1678103670639.fcd435df5abbf6c1041ee699a8544449. 2023-03-06 11:54:31,464 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1678103670639.fcd435df5abbf6c1041ee699a8544449. 2023-03-06 11:54:31,464 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for fcd435df5abbf6c1041ee699a8544449: 2023-03-06 11:54:31,466 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-03-06 11:54:31,467 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithWeeklyPolicy,,1678103670639.fcd435df5abbf6c1041ee699a8544449.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1678103671467"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678103671467"}]},"ts":"1678103671467"} 2023-03-06 11:54:31,469 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-06 11:54:31,470 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-06 11:54:31,470 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678103671470"}]},"ts":"1678103671470"} 2023-03-06 11:54:31,471 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-03-06 11:54:31,480 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=fcd435df5abbf6c1041ee699a8544449, ASSIGN}] 2023-03-06 11:54:31,481 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=fcd435df5abbf6c1041ee699a8544449, ASSIGN 2023-03-06 11:54:31,482 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=fcd435df5abbf6c1041ee699a8544449, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,42547,1678103642479; forceNewPlan=false, retain=false 2023-03-06 11:54:31,633 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=fcd435df5abbf6c1041ee699a8544449, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:31,634 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithWeeklyPolicy,,1678103670639.fcd435df5abbf6c1041ee699a8544449.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1678103671633"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678103671633"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678103671633"}]},"ts":"1678103671633"} 2023-03-06 11:54:31,635 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure fcd435df5abbf6c1041ee699a8544449, server=jenkins-hbase5.apache.org,42547,1678103642479}] 2023-03-06 11:54:31,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-03-06 11:54:31,791 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(128): Open testMinorCompactionWithWeeklyPolicy,,1678103670639.fcd435df5abbf6c1041ee699a8544449. 2023-03-06 11:54:31,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fcd435df5abbf6c1041ee699a8544449, NAME => 'testMinorCompactionWithWeeklyPolicy,,1678103670639.fcd435df5abbf6c1041ee699a8544449.', STARTKEY => '', ENDKEY => ''} 2023-03-06 11:54:31,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithWeeklyPolicy fcd435df5abbf6c1041ee699a8544449 2023-03-06 11:54:31,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1678103670639.fcd435df5abbf6c1041ee699a8544449.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-06 11:54:31,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for fcd435df5abbf6c1041ee699a8544449 2023-03-06 11:54:31,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for fcd435df5abbf6c1041ee699a8544449 2023-03-06 11:54:31,793 INFO [StoreOpener-fcd435df5abbf6c1041ee699a8544449-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region fcd435df5abbf6c1041ee699a8544449 2023-03-06 11:54:31,794 DEBUG [StoreOpener-fcd435df5abbf6c1041ee699a8544449-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1 2023-03-06 11:54:31,794 DEBUG [StoreOpener-fcd435df5abbf6c1041ee699a8544449-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1 2023-03-06 11:54:31,794 INFO [StoreOpener-fcd435df5abbf6c1041ee699a8544449-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fcd435df5abbf6c1041ee699a8544449 columnFamilyName family1 2023-03-06 11:54:31,796 INFO [StoreOpener-fcd435df5abbf6c1041ee699a8544449-1] regionserver.HStore(310): Store=fcd435df5abbf6c1041ee699a8544449/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-06 11:54:31,796 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449 2023-03-06 11:54:31,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449 2023-03-06 11:54:31,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for fcd435df5abbf6c1041ee699a8544449 2023-03-06 11:54:31,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-06 11:54:31,802 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened fcd435df5abbf6c1041ee699a8544449; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66373188, jitterRate=-0.010962426662445068}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-06 11:54:31,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for fcd435df5abbf6c1041ee699a8544449: 2023-03-06 11:54:31,803 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMinorCompactionWithWeeklyPolicy,,1678103670639.fcd435df5abbf6c1041ee699a8544449., pid=25, masterSystemTime=1678103671787 2023-03-06 11:54:31,805 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMinorCompactionWithWeeklyPolicy,,1678103670639.fcd435df5abbf6c1041ee699a8544449. 2023-03-06 11:54:31,805 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(156): Opened testMinorCompactionWithWeeklyPolicy,,1678103670639.fcd435df5abbf6c1041ee699a8544449. 2023-03-06 11:54:31,805 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=fcd435df5abbf6c1041ee699a8544449, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:31,806 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithWeeklyPolicy,,1678103670639.fcd435df5abbf6c1041ee699a8544449.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1678103671805"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678103671805"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678103671805"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678103671805"}]},"ts":"1678103671805"} 2023-03-06 11:54:31,809 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=24 2023-03-06 11:54:31,809 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure fcd435df5abbf6c1041ee699a8544449, server=jenkins-hbase5.apache.org,42547,1678103642479 in 172 msec 2023-03-06 11:54:31,811 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-03-06 11:54:31,811 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=fcd435df5abbf6c1041ee699a8544449, ASSIGN in 329 msec 2023-03-06 11:54:31,812 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-06 11:54:31,812 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678103671812"}]},"ts":"1678103671812"} 2023-03-06 11:54:31,813 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-03-06 11:54:31,815 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-03-06 11:54:31,816 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=23, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy in 1.1760 sec 2023-03-06 11:54:32,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-03-06 11:54:32,749 INFO [Listener at localhost/46717] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithWeeklyPolicy, procId: 23 completed 2023-03-06 11:54:32,773 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:54:32,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:32,775 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-06 11:54:32,775 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:32,775 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-06 11:54:32,775 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-06 11:54:32,776 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:32,776 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:32,777 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:32,777 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:32,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:32,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:32,777 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:32,777 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:54:32,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:32,778 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:32,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:54:32,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:32,778 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:32,778 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:32,778 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-06 11:54:32,778 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:32,778 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-06 11:54:32,779 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-06 11:54:32,779 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:54:32,779 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1678103670639.fcd435df5abbf6c1041ee699a8544449. 2023-03-06 11:54:32,779 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1678103670639.fcd435df5abbf6c1041ee699a8544449. started... 2023-03-06 11:54:32,779 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fcd435df5abbf6c1041ee699a8544449 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-06 11:54:33,198 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130ef4ab0250737467390c3ee990639fcdc to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151130ef4ab0250737467390c3ee990639fcdc 2023-03-06 11:54:33,602 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/.tmp/family1/2278ddf80aac4abb805ef643171cb088 2023-03-06 11:54:33,627 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-06 11:54:33,627 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x04a113f0 to 127.0.0.1:62659 2023-03-06 11:54:33,627 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-06 11:54:33,628 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-06 11:54:33,629 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6ea72963 to 127.0.0.1:62659 2023-03-06 11:54:33,629 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-06 11:54:33,629 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-06 11:54:33,629 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0682fd75 to 127.0.0.1:62659 2023-03-06 11:54:33,629 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-06 11:54:33,629 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/.tmp/family1/2278ddf80aac4abb805ef643171cb088 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/2278ddf80aac4abb805ef643171cb088 2023-03-06 11:54:33,635 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/2278ddf80aac4abb805ef643171cb088, entries=1000, sequenceid=5, filesize=165.1 K 2023-03-06 11:54:33,636 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for fcd435df5abbf6c1041ee699a8544449 in 857ms, sequenceid=5, compaction requested=false 2023-03-06 11:54:33,637 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithWeeklyPolicy' 2023-03-06 11:54:33,637 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fcd435df5abbf6c1041ee699a8544449: 2023-03-06 11:54:33,637 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1678103670639.fcd435df5abbf6c1041ee699a8544449. 2023-03-06 11:54:33,637 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-06 11:54:33,637 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-06 11:54:33,637 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:33,637 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-06 11:54:33,637 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-06 11:54:33,639 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:33,639 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:33,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:33,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:33,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:33,640 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:33,640 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:54:33,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:33,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:33,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:33,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:33,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:33,641 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-06 11:54:33,641 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@34db10a5[Count = 0] remaining members to acquire global barrier 2023-03-06 11:54:33,641 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-06 11:54:33,641 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:33,642 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:33,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:33,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:33,643 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-06 11:54:33,643 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:33,643 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:54:33,643 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-06 11:54:33,643 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:54:33,644 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-06 11:54:33,644 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:33,644 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:33,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:33,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:33,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:33,644 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-06 11:54:33,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:33,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:33,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:33,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:33,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:33,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:33,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:33,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:54:33,647 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-06 11:54:33,647 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-06 11:54:33,647 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:54:33,647 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:54:33,647 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:33,647 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:54:33,650 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:33,650 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:33,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:33,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:33,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:33,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:33,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:33,650 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:33,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:33,651 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:33,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:33,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:33,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:33,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:33,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:33,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:33,652 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:33,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:33,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:33,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:33,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:33,654 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:33,654 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:33,654 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:33,654 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:33,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:33,654 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-06 11:54:33,655 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:54:33,654 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:33,654 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:33,655 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:33,655 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:33,655 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-06 11:54:33,654 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:33,655 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-06 11:54:33,655 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:33,655 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:54:33,655 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:33,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:33,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:33,755 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:54:33,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:54:33,761 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:54:33,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-06 11:54:33,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:33,763 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-06 11:54:33,763 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:33,763 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-06 11:54:33,763 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-06 11:54:33,763 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:33,763 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:33,764 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:33,764 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:33,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:33,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:33,765 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:33,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:33,765 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:54:33,765 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:33,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:54:33,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:33,766 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:33,766 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-06 11:54:33,766 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:33,766 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-06 11:54:33,766 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:33,766 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-06 11:54:33,766 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-06 11:54:33,766 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:54:33,766 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1678103670639.fcd435df5abbf6c1041ee699a8544449. 2023-03-06 11:54:33,766 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1678103670639.fcd435df5abbf6c1041ee699a8544449. started... 2023-03-06 11:54:33,766 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fcd435df5abbf6c1041ee699a8544449 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-06 11:54:34,179 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128e2ef48704d9745599fda41be00f072ad to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151128e2ef48704d9745599fda41be00f072ad 2023-03-06 11:54:34,585 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/.tmp/family1/1f054c6d976a40188f4365a7d3f6a21a 2023-03-06 11:54:34,591 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/.tmp/family1/1f054c6d976a40188f4365a7d3f6a21a as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/1f054c6d976a40188f4365a7d3f6a21a 2023-03-06 11:54:34,595 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/1f054c6d976a40188f4365a7d3f6a21a, entries=1, sequenceid=9, filesize=5.0 K 2023-03-06 11:54:34,596 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for fcd435df5abbf6c1041ee699a8544449 in 830ms, sequenceid=9, compaction requested=false 2023-03-06 11:54:34,596 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fcd435df5abbf6c1041ee699a8544449: 2023-03-06 11:54:34,596 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1678103670639.fcd435df5abbf6c1041ee699a8544449. 2023-03-06 11:54:34,596 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-06 11:54:34,596 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-06 11:54:34,596 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:34,596 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-06 11:54:34,596 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-06 11:54:34,598 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:34,598 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:34,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:34,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:34,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:34,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:34,598 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:34,598 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:54:34,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:34,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:34,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:34,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:34,599 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-06 11:54:34,599 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4553fb3b[Count = 0] remaining members to acquire global barrier 2023-03-06 11:54:34,599 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-06 11:54:34,600 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:34,602 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:34,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:34,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:34,602 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-06 11:54:34,602 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-06 11:54:34,602 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:34,602 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:54:34,602 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:54:34,603 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:34,603 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-06 11:54:34,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:34,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:34,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:34,604 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:34,604 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-06 11:54:34,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:34,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:34,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:34,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:34,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:34,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:34,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:34,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:54:34,606 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-06 11:54:34,606 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-06 11:54:34,606 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:54:34,606 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:54:34,606 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:34,606 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:54:34,607 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:34,607 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:34,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:34,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:34,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:34,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:34,608 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:34,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:34,608 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:34,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:34,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:34,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:34,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:34,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:34,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:34,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:34,609 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:34,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:34,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:34,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:34,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:34,612 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:34,612 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:34,612 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:34,613 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:34,613 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-06 11:54:34,613 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:54:34,613 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:34,613 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:34,613 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:34,613 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:34,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:34,613 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:34,613 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-06 11:54:34,613 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-06 11:54:34,613 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:54:34,613 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:34,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:34,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:34,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:34,713 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:54:34,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:54:34,718 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:54:34,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-06 11:54:34,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:34,720 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-06 11:54:34,720 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:34,720 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-06 11:54:34,720 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-06 11:54:34,721 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:34,721 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:34,723 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:34,723 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:34,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:34,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:34,724 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:34,724 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:54:34,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:34,724 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:34,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:54:34,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:34,724 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:34,724 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-06 11:54:34,725 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:34,725 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-06 11:54:34,725 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:34,725 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-06 11:54:34,725 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-06 11:54:34,725 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:54:34,725 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1678103670639.fcd435df5abbf6c1041ee699a8544449. 2023-03-06 11:54:34,725 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1678103670639.fcd435df5abbf6c1041ee699a8544449. started... 2023-03-06 11:54:34,725 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fcd435df5abbf6c1041ee699a8544449 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-06 11:54:35,141 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512013196940588ac4be780b44626033fd62c to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512013196940588ac4be780b44626033fd62c 2023-03-06 11:54:35,547 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/.tmp/family1/4be212a0f5ac4ebdaad366e93a9ed853 2023-03-06 11:54:35,552 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/.tmp/family1/4be212a0f5ac4ebdaad366e93a9ed853 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/4be212a0f5ac4ebdaad366e93a9ed853 2023-03-06 11:54:35,556 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/4be212a0f5ac4ebdaad366e93a9ed853, entries=1, sequenceid=13, filesize=4.9 K 2023-03-06 11:54:35,557 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fcd435df5abbf6c1041ee699a8544449 in 832ms, sequenceid=13, compaction requested=true 2023-03-06 11:54:35,557 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fcd435df5abbf6c1041ee699a8544449: 2023-03-06 11:54:35,558 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1678103670639.fcd435df5abbf6c1041ee699a8544449. 2023-03-06 11:54:35,558 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-06 11:54:35,558 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-06 11:54:35,558 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:35,558 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-06 11:54:35,558 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-06 11:54:35,559 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:35,559 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:35,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:35,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:35,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:35,560 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:35,560 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:54:35,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:35,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:35,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:35,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:35,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:35,561 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-06 11:54:35,561 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7885f3b1[Count = 0] remaining members to acquire global barrier 2023-03-06 11:54:35,561 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-06 11:54:35,561 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:35,562 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:35,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:35,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:35,562 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:35,562 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-06 11:54:35,562 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-06 11:54:35,562 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:54:35,563 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:54:35,564 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:35,564 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-06 11:54:35,564 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:35,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:35,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:35,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:35,564 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-06 11:54:35,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:35,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:35,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:35,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:35,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:35,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:35,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:35,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:54:35,566 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-06 11:54:35,566 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-06 11:54:35,566 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:54:35,566 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:54:35,566 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:35,566 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:54:35,572 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:35,572 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:35,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:35,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:35,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:35,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:35,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:35,572 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:35,572 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:35,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:35,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:35,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:35,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:35,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:35,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:35,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:35,574 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:35,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:35,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:35,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:35,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:35,576 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:35,576 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:35,576 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:35,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:35,576 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-06 11:54:35,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:35,576 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-06 11:54:35,576 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:54:35,576 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:35,576 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:35,576 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:35,576 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:35,576 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:35,576 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:35,576 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:35,576 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-06 11:54:35,577 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:35,577 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:54:35,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:35,677 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:54:35,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:54:35,682 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:54:35,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-06 11:54:35,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:35,683 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-06 11:54:35,684 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:35,684 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-06 11:54:35,684 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-06 11:54:35,684 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:35,684 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:35,685 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:35,685 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:35,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:35,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:35,685 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:35,686 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:54:35,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:35,686 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:35,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:54:35,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:35,686 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:35,687 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-06 11:54:35,687 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:35,687 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-06 11:54:35,687 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:35,687 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-06 11:54:35,687 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-06 11:54:35,687 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:54:35,687 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1678103670639.fcd435df5abbf6c1041ee699a8544449. 2023-03-06 11:54:35,687 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1678103670639.fcd435df5abbf6c1041ee699a8544449. started... 2023-03-06 11:54:35,687 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fcd435df5abbf6c1041ee699a8544449 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-06 11:54:36,100 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205323706043152451cae086aba99663b44 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205323706043152451cae086aba99663b44 2023-03-06 11:54:36,506 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/.tmp/family1/9f509cfa30834614a2156e8705e327e3 2023-03-06 11:54:36,511 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/.tmp/family1/9f509cfa30834614a2156e8705e327e3 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/9f509cfa30834614a2156e8705e327e3 2023-03-06 11:54:36,515 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/9f509cfa30834614a2156e8705e327e3, entries=1, sequenceid=17, filesize=4.9 K 2023-03-06 11:54:36,516 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fcd435df5abbf6c1041ee699a8544449 in 829ms, sequenceid=17, compaction requested=true 2023-03-06 11:54:36,516 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fcd435df5abbf6c1041ee699a8544449: 2023-03-06 11:54:36,516 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1678103670639.fcd435df5abbf6c1041ee699a8544449. 2023-03-06 11:54:36,516 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-06 11:54:36,516 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-06 11:54:36,516 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:36,517 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-06 11:54:36,517 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-06 11:54:36,518 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:36,518 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:36,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:36,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:36,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:36,518 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:36,518 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:54:36,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:36,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:36,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:36,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:36,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:36,520 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-06 11:54:36,520 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@198da572[Count = 0] remaining members to acquire global barrier 2023-03-06 11:54:36,520 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-06 11:54:36,520 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:36,522 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:36,522 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:36,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:36,522 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-06 11:54:36,522 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-06 11:54:36,522 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:54:36,522 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:36,522 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:54:36,523 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-06 11:54:36,523 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:36,523 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:36,524 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-06 11:54:36,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:36,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:36,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:36,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:36,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:36,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:36,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:36,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:36,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:36,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:36,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:54:36,526 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-06 11:54:36,526 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-06 11:54:36,526 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:54:36,526 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:54:36,526 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:36,526 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:54:36,527 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:36,527 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:36,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:36,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:36,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:36,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:36,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:36,527 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:36,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:36,528 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:36,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:36,528 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:36,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:36,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:36,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:36,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:36,529 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:36,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:36,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:36,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:36,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:36,531 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:36,531 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:36,531 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:36,531 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:36,531 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:36,531 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-06 11:54:36,531 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:54:36,531 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:36,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:36,531 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:36,531 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:36,531 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:36,531 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:36,532 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-06 11:54:36,532 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:54:36,532 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:36,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:36,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:36,632 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:54:36,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:54:36,637 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:54:36,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-06 11:54:36,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:36,638 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-06 11:54:36,639 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:36,639 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-06 11:54:36,639 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-06 11:54:36,639 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:36,639 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:36,642 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:36,642 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:36,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:36,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:36,642 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:36,642 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:54:36,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:36,643 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:36,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:54:36,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:36,643 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:36,643 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-06 11:54:36,643 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:36,643 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-06 11:54:36,643 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:36,643 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-06 11:54:36,644 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-06 11:54:36,644 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:54:36,644 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1678103670639.fcd435df5abbf6c1041ee699a8544449. 2023-03-06 11:54:36,644 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1678103670639.fcd435df5abbf6c1041ee699a8544449. started... 2023-03-06 11:54:36,644 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fcd435df5abbf6c1041ee699a8544449 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-06 11:54:37,056 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228724d9eea2be9422088933b85f7f7e655 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228724d9eea2be9422088933b85f7f7e655 2023-03-06 11:54:37,315 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-06 11:54:37,462 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/.tmp/family1/dd1e50901e7f4fc09e4834b0dc03a284 2023-03-06 11:54:37,467 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/.tmp/family1/dd1e50901e7f4fc09e4834b0dc03a284 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/dd1e50901e7f4fc09e4834b0dc03a284 2023-03-06 11:54:37,472 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/dd1e50901e7f4fc09e4834b0dc03a284, entries=1, sequenceid=21, filesize=4.9 K 2023-03-06 11:54:37,473 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fcd435df5abbf6c1041ee699a8544449 in 829ms, sequenceid=21, compaction requested=true 2023-03-06 11:54:37,473 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fcd435df5abbf6c1041ee699a8544449: 2023-03-06 11:54:37,473 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1678103670639.fcd435df5abbf6c1041ee699a8544449. 2023-03-06 11:54:37,473 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-06 11:54:37,473 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-06 11:54:37,473 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:37,473 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-06 11:54:37,473 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-06 11:54:37,474 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:37,474 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:37,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:37,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:37,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:37,475 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:37,475 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:54:37,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:37,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:37,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:37,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:37,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:37,476 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-06 11:54:37,476 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@753fd0de[Count = 0] remaining members to acquire global barrier 2023-03-06 11:54:37,476 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-06 11:54:37,476 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:37,478 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:37,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:37,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:37,478 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-06 11:54:37,478 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-06 11:54:37,478 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:37,478 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:54:37,478 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:54:37,479 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:37,479 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-06 11:54:37,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:37,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:37,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:37,479 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:37,479 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-06 11:54:37,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:37,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:37,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:37,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:37,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:37,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:37,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:37,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:54:37,481 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-06 11:54:37,481 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-06 11:54:37,481 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:54:37,481 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:54:37,481 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:37,481 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:54:37,484 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:37,484 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:37,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:37,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:37,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:37,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:37,484 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:37,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:37,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:37,484 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:37,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:37,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:37,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:37,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:37,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:37,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:37,485 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:37,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:37,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:37,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:37,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:37,487 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:37,487 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:37,487 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:37,487 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:37,487 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-06 11:54:37,487 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:54:37,487 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:37,487 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:37,487 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:37,487 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:37,487 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:37,487 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:37,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:37,488 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-06 11:54:37,487 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-06 11:54:37,488 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:54:37,487 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:37,488 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:37,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:37,588 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:54:37,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:54:37,593 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:54:37,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-06 11:54:37,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:37,594 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-06 11:54:37,595 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:37,595 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-06 11:54:37,595 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-06 11:54:37,595 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:37,595 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:37,596 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:37,596 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:37,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:37,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:37,597 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:37,597 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:54:37,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:37,597 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:37,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:54:37,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:37,597 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:37,597 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-06 11:54:37,598 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:37,598 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-06 11:54:37,598 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:37,598 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-06 11:54:37,598 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-06 11:54:37,598 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:54:37,598 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1678103670639.fcd435df5abbf6c1041ee699a8544449. 2023-03-06 11:54:37,598 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1678103670639.fcd435df5abbf6c1041ee699a8544449. started... 2023-03-06 11:54:37,598 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fcd435df5abbf6c1041ee699a8544449 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-06 11:54:38,011 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123101d4ef2487114a6d9c525cce4d36077c to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015123101d4ef2487114a6d9c525cce4d36077c 2023-03-06 11:54:38,417 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/.tmp/family1/a68ec1b794ea406cac581d2e7a83ccc6 2023-03-06 11:54:38,422 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/.tmp/family1/a68ec1b794ea406cac581d2e7a83ccc6 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/a68ec1b794ea406cac581d2e7a83ccc6 2023-03-06 11:54:38,426 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/a68ec1b794ea406cac581d2e7a83ccc6, entries=1, sequenceid=25, filesize=4.9 K 2023-03-06 11:54:38,427 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fcd435df5abbf6c1041ee699a8544449 in 829ms, sequenceid=25, compaction requested=true 2023-03-06 11:54:38,428 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fcd435df5abbf6c1041ee699a8544449: 2023-03-06 11:54:38,428 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1678103670639.fcd435df5abbf6c1041ee699a8544449. 2023-03-06 11:54:38,428 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-06 11:54:38,428 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-06 11:54:38,428 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:38,428 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-06 11:54:38,428 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-06 11:54:38,429 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:38,429 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:38,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:38,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:38,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:38,430 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:38,430 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:54:38,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:38,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:38,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:38,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:38,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:38,431 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-06 11:54:38,431 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2f6f7761[Count = 0] remaining members to acquire global barrier 2023-03-06 11:54:38,431 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-06 11:54:38,431 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:38,434 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:38,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:38,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:38,434 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-06 11:54:38,434 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-06 11:54:38,434 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:54:38,434 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:38,434 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:54:38,439 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-06 11:54:38,439 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:38,439 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:38,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:38,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:38,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:38,439 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-06 11:54:38,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:38,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:38,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:38,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:38,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:38,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:38,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:38,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:54:38,441 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-06 11:54:38,441 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-06 11:54:38,441 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:54:38,441 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:54:38,441 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:38,441 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:54:38,443 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:38,443 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:38,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:38,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:38,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:38,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:38,443 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:38,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:38,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:38,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:38,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:38,443 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:38,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:38,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:38,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:38,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:38,444 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:38,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:38,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:38,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:38,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:38,448 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:38,448 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:38,448 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:38,448 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:38,448 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-06 11:54:38,448 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:54:38,448 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:38,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:38,448 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:38,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:38,449 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:38,449 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:38,449 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:38,449 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:38,449 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-06 11:54:38,449 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:54:38,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:38,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:38,549 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:54:38,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:54:38,554 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:54:38,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-06 11:54:38,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:38,556 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-06 11:54:38,556 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:38,556 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-06 11:54:38,556 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-06 11:54:38,557 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:38,557 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:38,558 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:38,558 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:38,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:38,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:38,558 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:38,558 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:54:38,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:38,559 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:38,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:54:38,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:38,559 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:38,559 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-06 11:54:38,559 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:38,560 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-06 11:54:38,560 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:38,560 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-06 11:54:38,560 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-06 11:54:38,560 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:54:38,560 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1678103670639.fcd435df5abbf6c1041ee699a8544449. 2023-03-06 11:54:38,560 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1678103670639.fcd435df5abbf6c1041ee699a8544449. started... 2023-03-06 11:54:38,560 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fcd435df5abbf6c1041ee699a8544449 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-06 11:54:38,973 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601017a41d6120dfd422f8b375d012618630f to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601017a41d6120dfd422f8b375d012618630f 2023-03-06 11:54:39,379 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/.tmp/family1/fbd6eb8548dd414daf8f4021672c9f60 2023-03-06 11:54:39,383 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/.tmp/family1/fbd6eb8548dd414daf8f4021672c9f60 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/fbd6eb8548dd414daf8f4021672c9f60 2023-03-06 11:54:39,387 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/fbd6eb8548dd414daf8f4021672c9f60, entries=1, sequenceid=29, filesize=4.9 K 2023-03-06 11:54:39,388 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fcd435df5abbf6c1041ee699a8544449 in 828ms, sequenceid=29, compaction requested=true 2023-03-06 11:54:39,388 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fcd435df5abbf6c1041ee699a8544449: 2023-03-06 11:54:39,388 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1678103670639.fcd435df5abbf6c1041ee699a8544449. 2023-03-06 11:54:39,388 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-06 11:54:39,388 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-06 11:54:39,388 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:39,389 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-06 11:54:39,389 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-06 11:54:39,390 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:39,390 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:39,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:39,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:39,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:39,390 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:39,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:39,390 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:54:39,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:39,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:39,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:39,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:39,392 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-06 11:54:39,392 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@78200146[Count = 0] remaining members to acquire global barrier 2023-03-06 11:54:39,392 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-06 11:54:39,392 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:39,393 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:39,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:39,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:39,393 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-06 11:54:39,393 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-06 11:54:39,393 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:54:39,393 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:39,393 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:54:39,395 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-06 11:54:39,395 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:39,395 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:39,395 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-06 11:54:39,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:39,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:39,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:39,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:39,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:39,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:39,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:39,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:39,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:39,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:39,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:54:39,398 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-06 11:54:39,398 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-06 11:54:39,398 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:54:39,398 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:54:39,398 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:39,398 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:54:39,399 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:39,399 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:39,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:39,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:39,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:39,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:39,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:39,399 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:39,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:39,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:39,399 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:39,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:39,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:39,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:39,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:39,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:39,400 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:39,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:39,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:39,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:39,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:39,402 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:39,402 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:39,402 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:39,403 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:39,403 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-06 11:54:39,403 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:54:39,403 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:39,403 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:39,403 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:39,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:39,403 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:39,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:39,403 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-06 11:54:39,403 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:54:39,403 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:39,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:39,403 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:39,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:39,503 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:54:39,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:54:39,508 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:54:39,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-06 11:54:39,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:39,510 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-06 11:54:39,510 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:39,510 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-06 11:54:39,510 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-06 11:54:39,511 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:39,511 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:39,512 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:39,512 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:39,512 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:39,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:39,512 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:39,512 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:54:39,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:39,513 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:39,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:54:39,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:39,513 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:39,513 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-06 11:54:39,513 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:39,513 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-06 11:54:39,513 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:39,513 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-06 11:54:39,513 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-06 11:54:39,514 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:54:39,514 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1678103670639.fcd435df5abbf6c1041ee699a8544449. 2023-03-06 11:54:39,514 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1678103670639.fcd435df5abbf6c1041ee699a8544449. started... 2023-03-06 11:54:39,514 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fcd435df5abbf6c1041ee699a8544449 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-06 11:54:39,926 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601039dab0341a8c14f84b230836f8667ce5d to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601039dab0341a8c14f84b230836f8667ce5d 2023-03-06 11:54:40,331 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/.tmp/family1/c3b1d5bc957349a9a20bbba741ff68e0 2023-03-06 11:54:40,336 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/.tmp/family1/c3b1d5bc957349a9a20bbba741ff68e0 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/c3b1d5bc957349a9a20bbba741ff68e0 2023-03-06 11:54:40,340 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/c3b1d5bc957349a9a20bbba741ff68e0, entries=1, sequenceid=33, filesize=4.9 K 2023-03-06 11:54:40,341 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fcd435df5abbf6c1041ee699a8544449 in 827ms, sequenceid=33, compaction requested=true 2023-03-06 11:54:40,341 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fcd435df5abbf6c1041ee699a8544449: 2023-03-06 11:54:40,341 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1678103670639.fcd435df5abbf6c1041ee699a8544449. 2023-03-06 11:54:40,341 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-06 11:54:40,341 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-06 11:54:40,341 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:40,341 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-06 11:54:40,341 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-06 11:54:40,343 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:40,343 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:40,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:40,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:40,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:40,344 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:40,344 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:54:40,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:40,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:40,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:40,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:40,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:40,345 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-06 11:54:40,345 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@c728d05[Count = 0] remaining members to acquire global barrier 2023-03-06 11:54:40,345 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-06 11:54:40,345 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:40,346 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:40,346 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:40,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:40,346 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-06 11:54:40,346 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-06 11:54:40,346 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:54:40,346 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:40,346 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:54:40,347 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-06 11:54:40,348 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:40,348 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:40,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:40,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:40,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:40,348 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-06 11:54:40,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:40,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:40,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:40,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:40,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:40,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:40,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:40,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:54:40,350 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-06 11:54:40,350 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-06 11:54:40,350 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:54:40,350 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:54:40,350 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:40,350 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:54:40,352 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:40,352 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:40,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:40,352 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:40,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:40,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:40,352 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:40,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:40,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:40,352 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:40,352 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:40,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:40,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:40,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:40,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:40,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:40,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:40,353 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:40,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:40,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:40,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:40,357 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:40,357 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:40,357 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:40,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:40,357 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-06 11:54:40,357 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:54:40,357 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:40,357 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:40,357 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:40,357 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:40,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:40,357 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:40,357 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:40,357 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-06 11:54:40,357 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:54:40,357 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:40,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:40,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:40,457 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:54:40,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:54:40,463 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:54:40,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-06 11:54:40,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:40,464 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-06 11:54:40,464 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:40,464 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-06 11:54:40,464 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-06 11:54:40,465 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:40,465 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:40,466 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:40,466 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:40,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:40,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:40,466 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:40,466 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:54:40,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:40,467 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:40,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:54:40,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:40,467 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:40,467 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-06 11:54:40,467 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:40,467 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-06 11:54:40,467 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:40,467 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-06 11:54:40,467 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-06 11:54:40,468 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:54:40,468 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1678103670639.fcd435df5abbf6c1041ee699a8544449. 2023-03-06 11:54:40,468 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1678103670639.fcd435df5abbf6c1041ee699a8544449. started... 2023-03-06 11:54:40,468 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fcd435df5abbf6c1041ee699a8544449 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-06 11:54:40,880 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090727a871f8eb944531b476793c5de6c81e to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015090727a871f8eb944531b476793c5de6c81e 2023-03-06 11:54:41,286 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/.tmp/family1/d2da8b0bad7745bf8a1c16eede70636e 2023-03-06 11:54:41,292 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/.tmp/family1/d2da8b0bad7745bf8a1c16eede70636e as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/d2da8b0bad7745bf8a1c16eede70636e 2023-03-06 11:54:41,297 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/d2da8b0bad7745bf8a1c16eede70636e, entries=1, sequenceid=37, filesize=4.9 K 2023-03-06 11:54:41,298 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fcd435df5abbf6c1041ee699a8544449 in 830ms, sequenceid=37, compaction requested=true 2023-03-06 11:54:41,298 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fcd435df5abbf6c1041ee699a8544449: 2023-03-06 11:54:41,298 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1678103670639.fcd435df5abbf6c1041ee699a8544449. 2023-03-06 11:54:41,298 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-06 11:54:41,298 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-06 11:54:41,298 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:41,298 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-06 11:54:41,298 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-06 11:54:41,301 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:41,301 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:41,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:41,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:41,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:41,302 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:41,302 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:54:41,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:41,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:41,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:41,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:41,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:41,303 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-06 11:54:41,303 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7401575[Count = 0] remaining members to acquire global barrier 2023-03-06 11:54:41,303 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-06 11:54:41,303 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:41,307 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:41,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:41,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:41,307 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-06 11:54:41,307 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-06 11:54:41,307 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:54:41,307 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:41,307 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:54:41,308 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-06 11:54:41,308 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:41,308 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:41,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:41,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:41,308 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-06 11:54:41,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:41,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:41,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:41,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:41,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:41,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:41,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:41,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:41,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:54:41,311 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-06 11:54:41,311 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-06 11:54:41,311 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:54:41,311 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:54:41,311 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:41,311 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:54:41,314 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:41,314 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:41,315 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:41,315 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:41,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:41,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:41,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:41,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:41,315 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:41,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:41,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:41,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:41,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:41,316 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:41,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:41,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:41,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:41,317 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:41,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:41,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:41,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:41,319 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:41,319 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:41,319 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:41,319 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:41,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:41,319 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:41,319 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-06 11:54:41,320 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:54:41,319 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:41,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:41,320 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:41,320 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:41,320 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:41,320 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:41,320 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-06 11:54:41,320 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:54:41,320 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:41,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:41,420 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:54:41,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:54:41,426 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:54:41,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-06 11:54:41,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:41,427 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-06 11:54:41,427 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:41,427 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-06 11:54:41,427 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-06 11:54:41,428 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:41,428 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:41,429 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:41,429 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:41,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:41,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:41,429 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:41,429 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:54:41,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:41,430 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:41,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:54:41,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:41,430 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:41,430 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-06 11:54:41,430 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:41,431 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-06 11:54:41,431 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:41,431 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-06 11:54:41,431 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-06 11:54:41,431 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:54:41,431 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1678103670639.fcd435df5abbf6c1041ee699a8544449. 2023-03-06 11:54:41,431 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1678103670639.fcd435df5abbf6c1041ee699a8544449. started... 2023-03-06 11:54:41,431 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fcd435df5abbf6c1041ee699a8544449 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-06 11:54:41,848 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511204f148a9986684fc3b605e701aec0231e to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201511204f148a9986684fc3b605e701aec0231e 2023-03-06 11:54:41,854 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/.tmp/family1/e3712f82d8214efca7643bc52a3ad385 2023-03-06 11:54:41,860 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/.tmp/family1/e3712f82d8214efca7643bc52a3ad385 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/e3712f82d8214efca7643bc52a3ad385 2023-03-06 11:54:41,865 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/e3712f82d8214efca7643bc52a3ad385, entries=1, sequenceid=41, filesize=4.9 K 2023-03-06 11:54:41,866 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fcd435df5abbf6c1041ee699a8544449 in 435ms, sequenceid=41, compaction requested=true 2023-03-06 11:54:41,866 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fcd435df5abbf6c1041ee699a8544449: 2023-03-06 11:54:41,866 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1678103670639.fcd435df5abbf6c1041ee699a8544449. 2023-03-06 11:54:41,866 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-06 11:54:41,866 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-06 11:54:41,866 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:41,866 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-06 11:54:41,866 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-06 11:54:41,868 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:41,868 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:41,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:41,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:41,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:41,868 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:41,868 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:54:41,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:41,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:41,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:41,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:41,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:41,870 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-06 11:54:41,870 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5340ae83[Count = 0] remaining members to acquire global barrier 2023-03-06 11:54:41,870 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-06 11:54:41,870 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:41,872 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:41,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:41,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:41,872 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-06 11:54:41,872 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-06 11:54:41,872 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:54:41,872 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:41,872 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:54:41,874 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:41,874 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-06 11:54:41,874 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:41,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:41,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:41,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:41,874 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-06 11:54:41,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:41,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:41,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:41,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:41,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:41,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:41,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:41,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:54:41,877 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-06 11:54:41,877 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-06 11:54:41,877 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:54:41,877 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:54:41,877 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:41,877 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:54:41,879 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:41,879 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:41,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:41,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:41,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:41,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:41,879 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:41,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:41,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:41,879 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:41,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:41,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:41,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:41,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:41,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:41,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:41,881 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:41,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:41,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:41,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:41,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:41,883 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:41,883 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:41,883 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:41,883 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:41,883 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:41,883 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-06 11:54:41,883 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:54:41,883 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:41,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:41,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:41,883 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:41,884 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-06 11:54:41,884 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:41,884 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-06 11:54:41,884 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:54:41,884 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:41,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:41,884 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:41,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:41,984 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:54:41,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:54:41,987 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=36301] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMinorCompactionWithWeeklyPolicy 2023-03-06 11:54:41,989 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-06 11:54:41,990 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-06 11:54:41,990 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=26, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678104281990 2023-03-06 11:54:41,990 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-06 11:54:41,993 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-06 11:54:41,994 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 0 del files, 9 selected files, and 0 irrelevant files table 'testMinorCompactionWithWeeklyPolicy' and column 'family1' 2023-03-06 11:54:41,995 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-06 11:54:41,995 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] zookeeper.ReadOnlyZKClient(139): Connect 0x43c86c74 to 127.0.0.1:62659 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-06 11:54:42,000 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@b0c150c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-06 11:54:42,000 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-06 11:54:42,855 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103ca857f1a3838402fb2ca17a65d1f95c2 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103ca857f1a3838402fb2ca17a65d1f95c2 2023-03-06 11:54:42,856 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-06 11:54:42,870 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-06 11:54:42,871 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:38544, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-06 11:54:42,878 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-06 11:54:42,880 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:58456, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-06 11:54:42,890 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/0afcffdf84284a7fbcc57751b7b567c9 first=Optional[r3] last=Optional[r6] 2023-03-06 11:54:42,891 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1678103670639.fcd435df5abbf6c1041ee699a8544449., hostname=jenkins-hbase5.apache.org,42547,1678103642479, seqNum=2 for row with hfile group [{family1,hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/0afcffdf84284a7fbcc57751b7b567c9}] 2023-03-06 11:54:42,895 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(763): Validating hfile at hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/0afcffdf84284a7fbcc57751b7b567c9 for inclusion in fcd435df5abbf6c1041ee699a8544449/family1 2023-03-06 11:54:42,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-03-06 11:54:42,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(777): Region bounds: first= last= 2023-03-06 11:54:42,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegion(2446): Flush status journal for fcd435df5abbf6c1041ee699a8544449: 2023-03-06 11:54:42,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/0afcffdf84284a7fbcc57751b7b567c9 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMinorCompactionWithWeeklyPolicy__9ftnq4imncl4udred62uf6ug7rl433kclftt2edfrsrgcnmv4pug72qfp8geopju/family1/0afcffdf84284a7fbcc57751b7b567c9 2023-03-06 11:54:42,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMinorCompactionWithWeeklyPolicy__9ftnq4imncl4udred62uf6ug7rl433kclftt2edfrsrgcnmv4pug72qfp8geopju/family1/0afcffdf84284a7fbcc57751b7b567c9 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/7c81aad732be4bd0ae58b453f879f403_SeqId_44_ 2023-03-06 11:54:42,902 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(849): Loaded HFile hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMinorCompactionWithWeeklyPolicy__9ftnq4imncl4udred62uf6ug7rl433kclftt2edfrsrgcnmv4pug72qfp8geopju/family1/0afcffdf84284a7fbcc57751b7b567c9 into fcd435df5abbf6c1041ee699a8544449/family1 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/7c81aad732be4bd0ae58b453f879f403_SeqId_44_ - updating store file list. 2023-03-06 11:54:42,906 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(882): Loaded HFile hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/7c81aad732be4bd0ae58b453f879f403_SeqId_44_ into fcd435df5abbf6c1041ee699a8544449/family1 2023-03-06 11:54:42,906 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(855): Successfully loaded hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMinorCompactionWithWeeklyPolicy__9ftnq4imncl4udred62uf6ug7rl433kclftt2edfrsrgcnmv4pug72qfp8geopju/family1/0afcffdf84284a7fbcc57751b7b567c9 into fcd435df5abbf6c1041ee699a8544449/family1 (new location: hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/7c81aad732be4bd0ae58b453f879f403_SeqId_44_) 2023-03-06 11:54:42,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMinorCompactionWithWeeklyPolicy__9ftnq4imncl4udred62uf6ug7rl433kclftt2edfrsrgcnmv4pug72qfp8geopju/family1/0afcffdf84284a7fbcc57751b7b567c9 2023-03-06 11:54:42,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-06 11:54:42,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-06 11:54:42,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(1912): fcd435df5abbf6c1041ee699a8544449/family1 is initiating minor compaction 2023-03-06 11:54:42,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@31f67516; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-06 11:54:42,911 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of fcd435df5abbf6c1041ee699a8544449/family1 in testMinorCompactionWithWeeklyPolicy,,1678103670639.fcd435df5abbf6c1041ee699a8544449. 2023-03-06 11:54:42,911 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/1f054c6d976a40188f4365a7d3f6a21a, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/4be212a0f5ac4ebdaad366e93a9ed853, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/9f509cfa30834614a2156e8705e327e3, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/dd1e50901e7f4fc09e4834b0dc03a284, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/a68ec1b794ea406cac581d2e7a83ccc6, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/fbd6eb8548dd414daf8f4021672c9f60, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/c3b1d5bc957349a9a20bbba741ff68e0, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/d2da8b0bad7745bf8a1c16eede70636e, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/e3712f82d8214efca7643bc52a3ad385, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/7c81aad732be4bd0ae58b453f879f403_SeqId_44_] into tmpdir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/.tmp, totalSize=50.0 K 2023-03-06 11:54:42,911 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting 1f054c6d976a40188f4365a7d3f6a21a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-06 11:54:42,912 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting 4be212a0f5ac4ebdaad366e93a9ed853, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-06 11:54:42,912 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting 9f509cfa30834614a2156e8705e327e3, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-06 11:54:42,912 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting dd1e50901e7f4fc09e4834b0dc03a284, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-06 11:54:42,912 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting a68ec1b794ea406cac581d2e7a83ccc6, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-06 11:54:42,912 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting fbd6eb8548dd414daf8f4021672c9f60, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-06 11:54:42,912 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting c3b1d5bc957349a9a20bbba741ff68e0, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-06 11:54:42,912 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting d2da8b0bad7745bf8a1c16eede70636e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-06 11:54:42,912 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting e3712f82d8214efca7643bc52a3ad385, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-06 11:54:42,912 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting 7c81aad732be4bd0ae58b453f879f403_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-06 11:54:42,914 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-06 11:54:42,915 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:54:42,916 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228724d9eea2be9422088933b85f7f7e655 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228724d9eea2be9422088933b85f7f7e655 2023-03-06 11:54:42,917 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015123101d4ef2487114a6d9c525cce4d36077c to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015123101d4ef2487114a6d9c525cce4d36077c 2023-03-06 11:54:42,919 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601017a41d6120dfd422f8b375d012618630f to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601017a41d6120dfd422f8b375d012618630f 2023-03-06 11:54:42,920 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601039dab0341a8c14f84b230836f8667ce5d to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601039dab0341a8c14f84b230836f8667ce5d 2023-03-06 11:54:42,921 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-03-06 11:54:42,921 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-03-06 11:54:42,921 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-06 11:54:42,921 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-06 11:54:42,921 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-06 11:54:42,921 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-06 11:54:42,921 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-06 11:54:42,921 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-06 11:54:42,921 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-06 11:54:42,922 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-06 11:54:42,954 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] throttle.PressureAwareThroughputController(145): fcd435df5abbf6c1041ee699a8544449#family1#compaction#34 average throughput is 0.23 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-06 11:54:43,389 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205636317d71f5445c8bcd7880f748be7f6 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205636317d71f5445c8bcd7880f748be7f6 2023-03-06 11:54:43,390 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-06 11:54:43,395 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/.tmp/family1/742555b0f48743979c58b64d63b5e791 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/742555b0f48743979c58b64d63b5e791 2023-03-06 11:54:43,406 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in fcd435df5abbf6c1041ee699a8544449/family1 of fcd435df5abbf6c1041ee699a8544449 into 742555b0f48743979c58b64d63b5e791(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-06 11:54:43,406 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for fcd435df5abbf6c1041ee699a8544449: 2023-03-06 11:54:43,406 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1678103670639.fcd435df5abbf6c1041ee699a8544449., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1678103682911; duration=0sec 2023-03-06 11:54:43,406 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-06 11:54:43,423 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/1f054c6d976a40188f4365a7d3f6a21a, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/4be212a0f5ac4ebdaad366e93a9ed853, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/9f509cfa30834614a2156e8705e327e3, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/dd1e50901e7f4fc09e4834b0dc03a284, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/a68ec1b794ea406cac581d2e7a83ccc6, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/fbd6eb8548dd414daf8f4021672c9f60, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/c3b1d5bc957349a9a20bbba741ff68e0, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/d2da8b0bad7745bf8a1c16eede70636e, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/e3712f82d8214efca7643bc52a3ad385, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/7c81aad732be4bd0ae58b453f879f403_SeqId_44_] to archive 2023-03-06 11:54:43,425 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:54:43,430 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/1f054c6d976a40188f4365a7d3f6a21a to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/1f054c6d976a40188f4365a7d3f6a21a 2023-03-06 11:54:43,433 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/4be212a0f5ac4ebdaad366e93a9ed853 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/4be212a0f5ac4ebdaad366e93a9ed853 2023-03-06 11:54:43,434 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/9974a8d07fee4e03b204edf8749a2110 first=Optional[r1] last=Optional[r2] 2023-03-06 11:54:43,435 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1678103670639.fcd435df5abbf6c1041ee699a8544449., hostname=jenkins-hbase5.apache.org,42547,1678103642479, seqNum=2 for row with hfile group [{family1,hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/9974a8d07fee4e03b204edf8749a2110}] 2023-03-06 11:54:43,435 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/9f509cfa30834614a2156e8705e327e3 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/9f509cfa30834614a2156e8705e327e3 2023-03-06 11:54:43,438 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/dd1e50901e7f4fc09e4834b0dc03a284 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/dd1e50901e7f4fc09e4834b0dc03a284 2023-03-06 11:54:43,439 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(763): Validating hfile at hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/9974a8d07fee4e03b204edf8749a2110 for inclusion in fcd435df5abbf6c1041ee699a8544449/family1 2023-03-06 11:54:43,440 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/a68ec1b794ea406cac581d2e7a83ccc6 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/a68ec1b794ea406cac581d2e7a83ccc6 2023-03-06 11:54:43,441 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/fbd6eb8548dd414daf8f4021672c9f60 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/fbd6eb8548dd414daf8f4021672c9f60 2023-03-06 11:54:43,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-03-06 11:54:43,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(777): Region bounds: first= last= 2023-03-06 11:54:43,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegion(2446): Flush status journal for fcd435df5abbf6c1041ee699a8544449: 2023-03-06 11:54:43,443 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/c3b1d5bc957349a9a20bbba741ff68e0 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/c3b1d5bc957349a9a20bbba741ff68e0 2023-03-06 11:54:43,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/9974a8d07fee4e03b204edf8749a2110 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMinorCompactionWithWeeklyPolicy__63btckfbq5ohma7rg4jqki2792728dqu7dlfpd3dr5o0ap9g56o0hb7lval13pho/family1/9974a8d07fee4e03b204edf8749a2110 2023-03-06 11:54:43,445 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/d2da8b0bad7745bf8a1c16eede70636e to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/d2da8b0bad7745bf8a1c16eede70636e 2023-03-06 11:54:43,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMinorCompactionWithWeeklyPolicy__63btckfbq5ohma7rg4jqki2792728dqu7dlfpd3dr5o0ap9g56o0hb7lval13pho/family1/9974a8d07fee4e03b204edf8749a2110 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/7a516562d6d04e2b84c7e5dc90212b5d_SeqId_47_ 2023-03-06 11:54:43,451 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/e3712f82d8214efca7643bc52a3ad385 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/e3712f82d8214efca7643bc52a3ad385 2023-03-06 11:54:43,452 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(849): Loaded HFile hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMinorCompactionWithWeeklyPolicy__63btckfbq5ohma7rg4jqki2792728dqu7dlfpd3dr5o0ap9g56o0hb7lval13pho/family1/9974a8d07fee4e03b204edf8749a2110 into fcd435df5abbf6c1041ee699a8544449/family1 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/7a516562d6d04e2b84c7e5dc90212b5d_SeqId_47_ - updating store file list. 2023-03-06 11:54:43,454 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/7c81aad732be4bd0ae58b453f879f403_SeqId_44_ to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/7c81aad732be4bd0ae58b453f879f403_SeqId_44_ 2023-03-06 11:54:43,458 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(882): Loaded HFile hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/7a516562d6d04e2b84c7e5dc90212b5d_SeqId_47_ into fcd435df5abbf6c1041ee699a8544449/family1 2023-03-06 11:54:43,458 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(855): Successfully loaded hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMinorCompactionWithWeeklyPolicy__63btckfbq5ohma7rg4jqki2792728dqu7dlfpd3dr5o0ap9g56o0hb7lval13pho/family1/9974a8d07fee4e03b204edf8749a2110 into fcd435df5abbf6c1041ee699a8544449/family1 (new location: hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/7a516562d6d04e2b84c7e5dc90212b5d_SeqId_47_) 2023-03-06 11:54:43,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMinorCompactionWithWeeklyPolicy__63btckfbq5ohma7rg4jqki2792728dqu7dlfpd3dr5o0ap9g56o0hb7lval13pho/family1/9974a8d07fee4e03b204edf8749a2110 2023-03-06 11:54:43,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-06 11:54:43,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 181014 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-06 11:54:43,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(1912): fcd435df5abbf6c1041ee699a8544449/family1 is initiating minor compaction (all files) 2023-03-06 11:54:43,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7aaa4239; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-06 11:54:43,461 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of fcd435df5abbf6c1041ee699a8544449/family1 in testMinorCompactionWithWeeklyPolicy,,1678103670639.fcd435df5abbf6c1041ee699a8544449. 2023-03-06 11:54:43,461 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/2278ddf80aac4abb805ef643171cb088, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/742555b0f48743979c58b64d63b5e791, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/7a516562d6d04e2b84c7e5dc90212b5d_SeqId_47_] into tmpdir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/.tmp, totalSize=176.8 K 2023-03-06 11:54:43,461 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting 2278ddf80aac4abb805ef643171cb088, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878806372 2023-03-06 11:54:43,462 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting 742555b0f48743979c58b64d63b5e791, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621206372 2023-03-06 11:54:43,462 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting 7a516562d6d04e2b84c7e5dc90212b5d_SeqId_47_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965206372 2023-03-06 11:54:43,463 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-06 11:54:43,464 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:54:43,466 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512013196940588ac4be780b44626033fd62c to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512013196940588ac4be780b44626033fd62c 2023-03-06 11:54:43,473 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205323706043152451cae086aba99663b44 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205323706043152451cae086aba99663b44 2023-03-06 11:54:43,473 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 2 expired mob files are deleted 2023-03-06 11:54:43,473 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-03-06 11:54:43,473 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-06 11:54:43,473 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-06 11:54:43,474 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-06 11:54:43,475 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=26, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-06 11:54:43,477 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.4870 sec 2023-03-06 11:54:43,487 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] throttle.PressureAwareThroughputController(145): fcd435df5abbf6c1041ee699a8544449#family1#compaction#35 average throughput is 11.90 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-06 11:54:43,619 INFO [Listener at localhost/46717] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=249 (was 264), OpenFileDescriptor=592 (was 632), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=308 (was 304) - SystemLoadAverage LEAK? -, ProcessCount=160 (was 160), AvailableMemoryMB=10433 (was 10516) 2023-03-06 11:54:43,635 INFO [Listener at localhost/46717] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=249, OpenFileDescriptor=592, MaxFileDescriptor=60000, SystemLoadAverage=308, ProcessCount=160, AvailableMemoryMB=10432 2023-03-06 11:54:43,638 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.HMaster$4(2112): Client=jenkins//172.31.10.131 create 'testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-03-06 11:54:43,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles 2023-03-06 11:54:43,641 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_PRE_OPERATION 2023-03-06 11:54:43,641 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(697): Client=jenkins//172.31.10.131 procedure request for creating table: namespace: "default" qualifier: "testScannerOnBulkLoadRefHFiles" procId is: 27 2023-03-06 11:54:43,642 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-06 11:54:43,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-03-06 11:54:43,644 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/default/testScannerOnBulkLoadRefHFiles/481a06c29321823efe5a4e1277a22968 2023-03-06 11:54:43,645 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/default/testScannerOnBulkLoadRefHFiles/2921237176876ba2f9c28123b4f2743d 2023-03-06 11:54:43,645 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/default/testScannerOnBulkLoadRefHFiles/2716db1eb01ab77f5e97af8e87170f80 2023-03-06 11:54:43,645 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/default/testScannerOnBulkLoadRefHFiles/481a06c29321823efe5a4e1277a22968 empty. 2023-03-06 11:54:43,645 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/default/testScannerOnBulkLoadRefHFiles/2716db1eb01ab77f5e97af8e87170f80 empty. 2023-03-06 11:54:43,645 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/default/testScannerOnBulkLoadRefHFiles/2921237176876ba2f9c28123b4f2743d empty. 2023-03-06 11:54:43,646 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/default/testScannerOnBulkLoadRefHFiles/481a06c29321823efe5a4e1277a22968 2023-03-06 11:54:43,646 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/default/testScannerOnBulkLoadRefHFiles/2716db1eb01ab77f5e97af8e87170f80 2023-03-06 11:54:43,646 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/default/testScannerOnBulkLoadRefHFiles/2921237176876ba2f9c28123b4f2743d 2023-03-06 11:54:43,646 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testScannerOnBulkLoadRefHFiles regions 2023-03-06 11:54:43,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-03-06 11:54:43,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-03-06 11:54:44,064 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/default/testScannerOnBulkLoadRefHFiles/.tabledesc/.tableinfo.0000000001 2023-03-06 11:54:44,066 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(7675): creating {ENCODED => 2716db1eb01ab77f5e97af8e87170f80, NAME => 'testScannerOnBulkLoadRefHFiles,2,1678103683637.2716db1eb01ab77f5e97af8e87170f80.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp 2023-03-06 11:54:44,066 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(7675): creating {ENCODED => 2921237176876ba2f9c28123b4f2743d, NAME => 'testScannerOnBulkLoadRefHFiles,1,1678103683637.2921237176876ba2f9c28123b4f2743d.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp 2023-03-06 11:54:44,066 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(7675): creating {ENCODED => 481a06c29321823efe5a4e1277a22968, NAME => 'testScannerOnBulkLoadRefHFiles,,1678103683637.481a06c29321823efe5a4e1277a22968.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp 2023-03-06 11:54:44,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-03-06 11:54:44,346 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/.tmp/family1/34bf50b106b84ea3ab7203d594a3c087 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/34bf50b106b84ea3ab7203d594a3c087 2023-03-06 11:54:44,356 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in fcd435df5abbf6c1041ee699a8544449/family1 of fcd435df5abbf6c1041ee699a8544449 into 34bf50b106b84ea3ab7203d594a3c087(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-06 11:54:44,356 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for fcd435df5abbf6c1041ee699a8544449: 2023-03-06 11:54:44,356 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1678103670639.fcd435df5abbf6c1041ee699a8544449., storeName=family1, fileCount=3, fileSize=176.8 K (165.1 K, 6.6 K, 5.2 K), priority=2, time=1678103683460; duration=0sec 2023-03-06 11:54:44,356 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-06 11:54:44,409 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/2278ddf80aac4abb805ef643171cb088, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/742555b0f48743979c58b64d63b5e791, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/7a516562d6d04e2b84c7e5dc90212b5d_SeqId_47_] to archive 2023-03-06 11:54:44,410 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:54:44,413 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/2278ddf80aac4abb805ef643171cb088 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/2278ddf80aac4abb805ef643171cb088 2023-03-06 11:54:44,415 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/742555b0f48743979c58b64d63b5e791 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/742555b0f48743979c58b64d63b5e791 2023-03-06 11:54:44,416 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/7a516562d6d04e2b84c7e5dc90212b5d_SeqId_47_ to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/family1/7a516562d6d04e2b84c7e5dc90212b5d_SeqId_47_ 2023-03-06 11:54:44,477 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1678103683637.2716db1eb01ab77f5e97af8e87170f80.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-06 11:54:44,477 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1604): Closing 2716db1eb01ab77f5e97af8e87170f80, disabling compactions & flushes 2023-03-06 11:54:44,478 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1678103683637.2716db1eb01ab77f5e97af8e87170f80. 2023-03-06 11:54:44,478 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1678103683637.2716db1eb01ab77f5e97af8e87170f80. 2023-03-06 11:54:44,478 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1678103683637.2716db1eb01ab77f5e97af8e87170f80. after waiting 0 ms 2023-03-06 11:54:44,478 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1678103683637.2716db1eb01ab77f5e97af8e87170f80. 2023-03-06 11:54:44,478 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1678103683637.2716db1eb01ab77f5e97af8e87170f80. 2023-03-06 11:54:44,478 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1558): Region close journal for 2716db1eb01ab77f5e97af8e87170f80: 2023-03-06 11:54:44,481 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1678103683637.481a06c29321823efe5a4e1277a22968.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-06 11:54:44,481 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1604): Closing 481a06c29321823efe5a4e1277a22968, disabling compactions & flushes 2023-03-06 11:54:44,482 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1678103683637.481a06c29321823efe5a4e1277a22968. 2023-03-06 11:54:44,482 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1678103683637.481a06c29321823efe5a4e1277a22968. 2023-03-06 11:54:44,482 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1678103683637.481a06c29321823efe5a4e1277a22968. after waiting 0 ms 2023-03-06 11:54:44,482 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1678103683637.481a06c29321823efe5a4e1277a22968. 2023-03-06 11:54:44,482 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1678103683637.481a06c29321823efe5a4e1277a22968. 2023-03-06 11:54:44,482 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1558): Region close journal for 481a06c29321823efe5a4e1277a22968: 2023-03-06 11:54:44,490 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1678103683637.2921237176876ba2f9c28123b4f2743d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-06 11:54:44,490 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1604): Closing 2921237176876ba2f9c28123b4f2743d, disabling compactions & flushes 2023-03-06 11:54:44,490 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1678103683637.2921237176876ba2f9c28123b4f2743d. 2023-03-06 11:54:44,490 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1678103683637.2921237176876ba2f9c28123b4f2743d. 2023-03-06 11:54:44,490 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1678103683637.2921237176876ba2f9c28123b4f2743d. after waiting 0 ms 2023-03-06 11:54:44,490 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1678103683637.2921237176876ba2f9c28123b4f2743d. 2023-03-06 11:54:44,490 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1678103683637.2921237176876ba2f9c28123b4f2743d. 2023-03-06 11:54:44,490 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1558): Region close journal for 2921237176876ba2f9c28123b4f2743d: 2023-03-06 11:54:44,495 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ADD_TO_META 2023-03-06 11:54:44,496 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,2,1678103683637.2716db1eb01ab77f5e97af8e87170f80.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1678103684496"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678103684496"}]},"ts":"1678103684496"} 2023-03-06 11:54:44,496 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,,1678103683637.481a06c29321823efe5a4e1277a22968.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1678103684496"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678103684496"}]},"ts":"1678103684496"} 2023-03-06 11:54:44,496 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,1,1678103683637.2921237176876ba2f9c28123b4f2743d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1678103684496"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678103684496"}]},"ts":"1678103684496"} 2023-03-06 11:54:44,500 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-03-06 11:54:44,501 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-06 11:54:44,501 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678103684501"}]},"ts":"1678103684501"} 2023-03-06 11:54:44,503 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLING in hbase:meta 2023-03-06 11:54:44,506 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=481a06c29321823efe5a4e1277a22968, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=2921237176876ba2f9c28123b4f2743d, ASSIGN}, {pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=2716db1eb01ab77f5e97af8e87170f80, ASSIGN}] 2023-03-06 11:54:44,508 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=2921237176876ba2f9c28123b4f2743d, ASSIGN 2023-03-06 11:54:44,509 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=481a06c29321823efe5a4e1277a22968, ASSIGN 2023-03-06 11:54:44,509 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=2716db1eb01ab77f5e97af8e87170f80, ASSIGN 2023-03-06 11:54:44,510 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=2921237176876ba2f9c28123b4f2743d, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,42547,1678103642479; forceNewPlan=false, retain=false 2023-03-06 11:54:44,510 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=481a06c29321823efe5a4e1277a22968, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,42547,1678103642479; forceNewPlan=false, retain=false 2023-03-06 11:54:44,510 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=2716db1eb01ab77f5e97af8e87170f80, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,42547,1678103642479; forceNewPlan=false, retain=false 2023-03-06 11:54:44,662 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=2716db1eb01ab77f5e97af8e87170f80, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:44,662 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=2921237176876ba2f9c28123b4f2743d, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:44,662 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,2,1678103683637.2716db1eb01ab77f5e97af8e87170f80.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1678103684661"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678103684661"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678103684661"}]},"ts":"1678103684661"} 2023-03-06 11:54:44,662 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=481a06c29321823efe5a4e1277a22968, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:44,662 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,1,1678103683637.2921237176876ba2f9c28123b4f2743d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1678103684662"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678103684662"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678103684662"}]},"ts":"1678103684662"} 2023-03-06 11:54:44,662 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,,1678103683637.481a06c29321823efe5a4e1277a22968.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1678103684661"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678103684661"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678103684661"}]},"ts":"1678103684661"} 2023-03-06 11:54:44,664 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=30, state=RUNNABLE; OpenRegionProcedure 2716db1eb01ab77f5e97af8e87170f80, server=jenkins-hbase5.apache.org,42547,1678103642479}] 2023-03-06 11:54:44,664 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=32, ppid=29, state=RUNNABLE; OpenRegionProcedure 2921237176876ba2f9c28123b4f2743d, server=jenkins-hbase5.apache.org,42547,1678103642479}] 2023-03-06 11:54:44,665 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=33, ppid=28, state=RUNNABLE; OpenRegionProcedure 481a06c29321823efe5a4e1277a22968, server=jenkins-hbase5.apache.org,42547,1678103642479}] 2023-03-06 11:54:44,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-03-06 11:54:44,820 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,,1678103683637.481a06c29321823efe5a4e1277a22968. 2023-03-06 11:54:44,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 481a06c29321823efe5a4e1277a22968, NAME => 'testScannerOnBulkLoadRefHFiles,,1678103683637.481a06c29321823efe5a4e1277a22968.', STARTKEY => '', ENDKEY => '1'} 2023-03-06 11:54:44,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 481a06c29321823efe5a4e1277a22968 2023-03-06 11:54:44,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1678103683637.481a06c29321823efe5a4e1277a22968.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-06 11:54:44,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 481a06c29321823efe5a4e1277a22968 2023-03-06 11:54:44,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 481a06c29321823efe5a4e1277a22968 2023-03-06 11:54:44,822 INFO [StoreOpener-481a06c29321823efe5a4e1277a22968-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 481a06c29321823efe5a4e1277a22968 2023-03-06 11:54:44,823 DEBUG [StoreOpener-481a06c29321823efe5a4e1277a22968-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testScannerOnBulkLoadRefHFiles/481a06c29321823efe5a4e1277a22968/family1 2023-03-06 11:54:44,823 DEBUG [StoreOpener-481a06c29321823efe5a4e1277a22968-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testScannerOnBulkLoadRefHFiles/481a06c29321823efe5a4e1277a22968/family1 2023-03-06 11:54:44,824 INFO [StoreOpener-481a06c29321823efe5a4e1277a22968-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 481a06c29321823efe5a4e1277a22968 columnFamilyName family1 2023-03-06 11:54:44,825 INFO [StoreOpener-481a06c29321823efe5a4e1277a22968-1] regionserver.HStore(310): Store=481a06c29321823efe5a4e1277a22968/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-06 11:54:44,826 INFO [StoreOpener-481a06c29321823efe5a4e1277a22968-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 481a06c29321823efe5a4e1277a22968 2023-03-06 11:54:44,827 DEBUG [StoreOpener-481a06c29321823efe5a4e1277a22968-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testScannerOnBulkLoadRefHFiles/481a06c29321823efe5a4e1277a22968/family2 2023-03-06 11:54:44,827 DEBUG [StoreOpener-481a06c29321823efe5a4e1277a22968-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testScannerOnBulkLoadRefHFiles/481a06c29321823efe5a4e1277a22968/family2 2023-03-06 11:54:44,827 INFO [StoreOpener-481a06c29321823efe5a4e1277a22968-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 481a06c29321823efe5a4e1277a22968 columnFamilyName family2 2023-03-06 11:54:44,829 INFO [StoreOpener-481a06c29321823efe5a4e1277a22968-1] regionserver.HStore(310): Store=481a06c29321823efe5a4e1277a22968/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-06 11:54:44,830 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testScannerOnBulkLoadRefHFiles/481a06c29321823efe5a4e1277a22968 2023-03-06 11:54:44,830 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testScannerOnBulkLoadRefHFiles/481a06c29321823efe5a4e1277a22968 2023-03-06 11:54:44,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-06 11:54:44,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 481a06c29321823efe5a4e1277a22968 2023-03-06 11:54:44,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testScannerOnBulkLoadRefHFiles/481a06c29321823efe5a4e1277a22968/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-06 11:54:44,845 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 481a06c29321823efe5a4e1277a22968; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71090966, jitterRate=0.05933794379234314}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-06 11:54:44,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 481a06c29321823efe5a4e1277a22968: 2023-03-06 11:54:44,846 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,,1678103683637.481a06c29321823efe5a4e1277a22968., pid=33, masterSystemTime=1678103684816 2023-03-06 11:54:44,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,,1678103683637.481a06c29321823efe5a4e1277a22968. 2023-03-06 11:54:44,850 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,,1678103683637.481a06c29321823efe5a4e1277a22968. 2023-03-06 11:54:44,850 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,1,1678103683637.2921237176876ba2f9c28123b4f2743d. 2023-03-06 11:54:44,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2921237176876ba2f9c28123b4f2743d, NAME => 'testScannerOnBulkLoadRefHFiles,1,1678103683637.2921237176876ba2f9c28123b4f2743d.', STARTKEY => '1', ENDKEY => '2'} 2023-03-06 11:54:44,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 2921237176876ba2f9c28123b4f2743d 2023-03-06 11:54:44,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1678103683637.2921237176876ba2f9c28123b4f2743d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-06 11:54:44,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 2921237176876ba2f9c28123b4f2743d 2023-03-06 11:54:44,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 2921237176876ba2f9c28123b4f2743d 2023-03-06 11:54:44,858 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=481a06c29321823efe5a4e1277a22968, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:44,858 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,,1678103683637.481a06c29321823efe5a4e1277a22968.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1678103684858"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678103684858"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678103684858"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678103684858"}]},"ts":"1678103684858"} 2023-03-06 11:54:44,859 INFO [StoreOpener-2921237176876ba2f9c28123b4f2743d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 2921237176876ba2f9c28123b4f2743d 2023-03-06 11:54:44,865 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=33, resume processing ppid=28 2023-03-06 11:54:44,865 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=33, ppid=28, state=SUCCESS; OpenRegionProcedure 481a06c29321823efe5a4e1277a22968, server=jenkins-hbase5.apache.org,42547,1678103642479 in 198 msec 2023-03-06 11:54:44,867 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=481a06c29321823efe5a4e1277a22968, ASSIGN in 360 msec 2023-03-06 11:54:44,868 DEBUG [StoreOpener-2921237176876ba2f9c28123b4f2743d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testScannerOnBulkLoadRefHFiles/2921237176876ba2f9c28123b4f2743d/family1 2023-03-06 11:54:44,868 DEBUG [StoreOpener-2921237176876ba2f9c28123b4f2743d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testScannerOnBulkLoadRefHFiles/2921237176876ba2f9c28123b4f2743d/family1 2023-03-06 11:54:44,868 INFO [StoreOpener-2921237176876ba2f9c28123b4f2743d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2921237176876ba2f9c28123b4f2743d columnFamilyName family1 2023-03-06 11:54:44,869 INFO [StoreOpener-2921237176876ba2f9c28123b4f2743d-1] regionserver.HStore(310): Store=2921237176876ba2f9c28123b4f2743d/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-06 11:54:44,870 INFO [StoreOpener-2921237176876ba2f9c28123b4f2743d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 2921237176876ba2f9c28123b4f2743d 2023-03-06 11:54:44,872 DEBUG [StoreOpener-2921237176876ba2f9c28123b4f2743d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testScannerOnBulkLoadRefHFiles/2921237176876ba2f9c28123b4f2743d/family2 2023-03-06 11:54:44,872 DEBUG [StoreOpener-2921237176876ba2f9c28123b4f2743d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testScannerOnBulkLoadRefHFiles/2921237176876ba2f9c28123b4f2743d/family2 2023-03-06 11:54:44,873 INFO [StoreOpener-2921237176876ba2f9c28123b4f2743d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2921237176876ba2f9c28123b4f2743d columnFamilyName family2 2023-03-06 11:54:44,874 INFO [StoreOpener-2921237176876ba2f9c28123b4f2743d-1] regionserver.HStore(310): Store=2921237176876ba2f9c28123b4f2743d/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-06 11:54:44,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testScannerOnBulkLoadRefHFiles/2921237176876ba2f9c28123b4f2743d 2023-03-06 11:54:44,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testScannerOnBulkLoadRefHFiles/2921237176876ba2f9c28123b4f2743d 2023-03-06 11:54:44,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-06 11:54:44,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 2921237176876ba2f9c28123b4f2743d 2023-03-06 11:54:44,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testScannerOnBulkLoadRefHFiles/2921237176876ba2f9c28123b4f2743d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-06 11:54:44,888 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 2921237176876ba2f9c28123b4f2743d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69739464, jitterRate=0.039198994636535645}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-06 11:54:44,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 2921237176876ba2f9c28123b4f2743d: 2023-03-06 11:54:44,889 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,1,1678103683637.2921237176876ba2f9c28123b4f2743d., pid=32, masterSystemTime=1678103684816 2023-03-06 11:54:44,892 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=2921237176876ba2f9c28123b4f2743d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:44,892 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,1,1678103683637.2921237176876ba2f9c28123b4f2743d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1678103684892"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678103684892"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678103684892"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678103684892"}]},"ts":"1678103684892"} 2023-03-06 11:54:44,892 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,1,1678103683637.2921237176876ba2f9c28123b4f2743d. 2023-03-06 11:54:44,892 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,1,1678103683637.2921237176876ba2f9c28123b4f2743d. 2023-03-06 11:54:44,892 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,2,1678103683637.2716db1eb01ab77f5e97af8e87170f80. 2023-03-06 11:54:44,892 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2716db1eb01ab77f5e97af8e87170f80, NAME => 'testScannerOnBulkLoadRefHFiles,2,1678103683637.2716db1eb01ab77f5e97af8e87170f80.', STARTKEY => '2', ENDKEY => ''} 2023-03-06 11:54:44,893 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 2716db1eb01ab77f5e97af8e87170f80 2023-03-06 11:54:44,893 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1678103683637.2716db1eb01ab77f5e97af8e87170f80.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-06 11:54:44,893 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 2716db1eb01ab77f5e97af8e87170f80 2023-03-06 11:54:44,893 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 2716db1eb01ab77f5e97af8e87170f80 2023-03-06 11:54:44,897 INFO [StoreOpener-2716db1eb01ab77f5e97af8e87170f80-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 2716db1eb01ab77f5e97af8e87170f80 2023-03-06 11:54:44,899 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=32, resume processing ppid=29 2023-03-06 11:54:44,899 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=32, ppid=29, state=SUCCESS; OpenRegionProcedure 2921237176876ba2f9c28123b4f2743d, server=jenkins-hbase5.apache.org,42547,1678103642479 in 230 msec 2023-03-06 11:54:44,900 DEBUG [StoreOpener-2716db1eb01ab77f5e97af8e87170f80-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testScannerOnBulkLoadRefHFiles/2716db1eb01ab77f5e97af8e87170f80/family1 2023-03-06 11:54:44,900 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=2921237176876ba2f9c28123b4f2743d, ASSIGN in 393 msec 2023-03-06 11:54:44,900 DEBUG [StoreOpener-2716db1eb01ab77f5e97af8e87170f80-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testScannerOnBulkLoadRefHFiles/2716db1eb01ab77f5e97af8e87170f80/family1 2023-03-06 11:54:44,901 INFO [StoreOpener-2716db1eb01ab77f5e97af8e87170f80-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2716db1eb01ab77f5e97af8e87170f80 columnFamilyName family1 2023-03-06 11:54:44,902 INFO [StoreOpener-2716db1eb01ab77f5e97af8e87170f80-1] regionserver.HStore(310): Store=2716db1eb01ab77f5e97af8e87170f80/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-06 11:54:44,903 INFO [StoreOpener-2716db1eb01ab77f5e97af8e87170f80-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 2716db1eb01ab77f5e97af8e87170f80 2023-03-06 11:54:44,904 DEBUG [StoreOpener-2716db1eb01ab77f5e97af8e87170f80-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testScannerOnBulkLoadRefHFiles/2716db1eb01ab77f5e97af8e87170f80/family2 2023-03-06 11:54:44,904 DEBUG [StoreOpener-2716db1eb01ab77f5e97af8e87170f80-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testScannerOnBulkLoadRefHFiles/2716db1eb01ab77f5e97af8e87170f80/family2 2023-03-06 11:54:44,905 INFO [StoreOpener-2716db1eb01ab77f5e97af8e87170f80-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2716db1eb01ab77f5e97af8e87170f80 columnFamilyName family2 2023-03-06 11:54:44,906 INFO [StoreOpener-2716db1eb01ab77f5e97af8e87170f80-1] regionserver.HStore(310): Store=2716db1eb01ab77f5e97af8e87170f80/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-06 11:54:44,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testScannerOnBulkLoadRefHFiles/2716db1eb01ab77f5e97af8e87170f80 2023-03-06 11:54:44,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testScannerOnBulkLoadRefHFiles/2716db1eb01ab77f5e97af8e87170f80 2023-03-06 11:54:44,910 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-06 11:54:44,911 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 2716db1eb01ab77f5e97af8e87170f80 2023-03-06 11:54:44,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testScannerOnBulkLoadRefHFiles/2716db1eb01ab77f5e97af8e87170f80/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-06 11:54:44,914 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 2716db1eb01ab77f5e97af8e87170f80; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62869955, jitterRate=-0.06316466629505157}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-06 11:54:44,914 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 2716db1eb01ab77f5e97af8e87170f80: 2023-03-06 11:54:44,915 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,2,1678103683637.2716db1eb01ab77f5e97af8e87170f80., pid=31, masterSystemTime=1678103684816 2023-03-06 11:54:44,916 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,2,1678103683637.2716db1eb01ab77f5e97af8e87170f80. 2023-03-06 11:54:44,916 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,2,1678103683637.2716db1eb01ab77f5e97af8e87170f80. 2023-03-06 11:54:44,917 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=2716db1eb01ab77f5e97af8e87170f80, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:44,917 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,2,1678103683637.2716db1eb01ab77f5e97af8e87170f80.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1678103684917"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678103684917"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678103684917"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678103684917"}]},"ts":"1678103684917"} 2023-03-06 11:54:44,920 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=30 2023-03-06 11:54:44,920 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=30, state=SUCCESS; OpenRegionProcedure 2716db1eb01ab77f5e97af8e87170f80, server=jenkins-hbase5.apache.org,42547,1678103642479 in 254 msec 2023-03-06 11:54:44,923 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=27 2023-03-06 11:54:44,923 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=2716db1eb01ab77f5e97af8e87170f80, ASSIGN in 414 msec 2023-03-06 11:54:44,924 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-06 11:54:44,924 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678103684924"}]},"ts":"1678103684924"} 2023-03-06 11:54:44,925 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLED in hbase:meta 2023-03-06 11:54:44,927 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_POST_OPERATION 2023-03-06 11:54:44,929 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles in 1.2890 sec 2023-03-06 11:54:45,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-03-06 11:54:45,752 INFO [Listener at localhost/46717] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testScannerOnBulkLoadRefHFiles, procId: 27 completed 2023-03-06 11:54:45,759 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:54:45,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-03-06 11:54:45,760 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-03-06 11:54:45,760 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:45,760 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-03-06 11:54:45,760 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-03-06 11:54:45,761 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-06 11:54:45,761 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-06 11:54:45,762 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:45,762 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:45,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:45,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:45,762 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:45,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-06 11:54:45,762 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:54:45,763 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-06 11:54:45,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:54:45,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-06 11:54:45,763 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-03-06 11:54:45,763 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-03-06 11:54:45,763 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-03-06 11:54:45,764 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:45,764 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-03-06 11:54:45,764 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1678103683637.481a06c29321823efe5a4e1277a22968. 2023-03-06 11:54:45,764 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1678103683637.481a06c29321823efe5a4e1277a22968. started... 2023-03-06 11:54:45,764 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-06 11:54:45,764 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:54:45,764 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1678103683637.2921237176876ba2f9c28123b4f2743d. 2023-03-06 11:54:45,765 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 481a06c29321823efe5a4e1277a22968: 2023-03-06 11:54:45,765 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1678103683637.481a06c29321823efe5a4e1277a22968. 2023-03-06 11:54:45,764 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1678103683637.2716db1eb01ab77f5e97af8e87170f80. 2023-03-06 11:54:45,765 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-06 11:54:45,765 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1678103683637.2921237176876ba2f9c28123b4f2743d. started... 2023-03-06 11:54:45,765 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1678103683637.2716db1eb01ab77f5e97af8e87170f80. started... 2023-03-06 11:54:45,765 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 2921237176876ba2f9c28123b4f2743d: 2023-03-06 11:54:45,765 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1678103683637.2921237176876ba2f9c28123b4f2743d. 2023-03-06 11:54:45,766 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-06 11:54:45,766 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 2716db1eb01ab77f5e97af8e87170f80 2/2 column families, dataSize=48 B heapSize=632 B 2023-03-06 11:54:46,150 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testScannerOnBulkLoadRefHFiles' 2023-03-06 11:54:46,184 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230306ad27a3c578164612a9023700a6fe266f to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230306ad27a3c578164612a9023700a6fe266f 2023-03-06 11:54:46,589 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=48, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testScannerOnBulkLoadRefHFiles/2716db1eb01ab77f5e97af8e87170f80/.tmp/family1/f50ee91749a84bafae0eac56c8b084dd 2023-03-06 11:54:46,595 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testScannerOnBulkLoadRefHFiles/2716db1eb01ab77f5e97af8e87170f80/.tmp/family1/f50ee91749a84bafae0eac56c8b084dd as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testScannerOnBulkLoadRefHFiles/2716db1eb01ab77f5e97af8e87170f80/family1/f50ee91749a84bafae0eac56c8b084dd 2023-03-06 11:54:46,599 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testScannerOnBulkLoadRefHFiles/2716db1eb01ab77f5e97af8e87170f80/family1/f50ee91749a84bafae0eac56c8b084dd, entries=1, sequenceid=5, filesize=4.9 K 2023-03-06 11:54:46,600 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~48 B/48, heapSize ~360 B/360, currentSize=0 B/0 for 2716db1eb01ab77f5e97af8e87170f80 in 834ms, sequenceid=5, compaction requested=false 2023-03-06 11:54:46,601 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 2716db1eb01ab77f5e97af8e87170f80: 2023-03-06 11:54:46,601 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1678103683637.2716db1eb01ab77f5e97af8e87170f80. 2023-03-06 11:54:46,601 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-06 11:54:46,601 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-06 11:54:46,601 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:46,601 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-03-06 11:54:46,601 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-03-06 11:54:46,603 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:46,603 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-06 11:54:46,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:46,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:46,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:46,604 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-06 11:54:46,604 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:54:46,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:46,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:46,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-06 11:54:46,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:46,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:46,605 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-03-06 11:54:46,605 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2b92bf9c[Count = 0] remaining members to acquire global barrier 2023-03-06 11:54:46,605 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-03-06 11:54:46,605 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-06 11:54:46,606 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-06 11:54:46,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-06 11:54:46,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-06 11:54:46,606 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-03-06 11:54:46,607 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-03-06 11:54:46,607 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:54:46,607 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:46,607 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:54:46,608 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:46,608 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-03-06 11:54:46,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:46,608 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:46,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:46,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:46,608 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-03-06 11:54:46,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:46,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:46,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-06 11:54:46,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:46,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:46,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-06 11:54:46,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:46,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:54:46,611 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-03-06 11:54:46,611 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-03-06 11:54:46,611 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:54:46,611 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:54:46,611 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-03-06 11:54:46,611 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:54:46,614 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-06 11:54:46,614 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-06 11:54:46,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-06 11:54:46,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-06 11:54:46,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-06 11:54:46,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:46,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:46,614 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:46,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:46,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:46,615 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:46,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:46,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-06 11:54:46,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-06 11:54:46,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:46,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-06 11:54:46,616 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:46,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:46,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:46,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-06 11:54:46,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:46,622 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:46,622 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:46,622 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-06 11:54:46,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:46,622 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-06 11:54:46,622 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-03-06 11:54:46,623 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:54:46,622 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:46,622 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:46,623 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-03-06 11:54:46,622 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:46,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:46,623 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-03-06 11:54:46,623 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-06 11:54:46,623 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:54:46,623 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-06 11:54:46,623 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-06 11:54:46,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:46,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:46,723 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:54:46,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:54:46,728 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:54:46,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testScannerOnBulkLoadRefHFiles was in running list but was completed. Accepting new attempt. 2023-03-06 11:54:46,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-03-06 11:54:46,731 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-03-06 11:54:46,731 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:46,731 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-03-06 11:54:46,731 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-03-06 11:54:46,731 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-06 11:54:46,731 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-06 11:54:46,732 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:46,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:46,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:46,733 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:46,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-06 11:54:46,733 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:46,733 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:54:46,733 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-06 11:54:46,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:54:46,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-06 11:54:46,734 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-03-06 11:54:46,734 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testScannerOnBulkLoadRefHFiles is still present, removing 2023-03-06 11:54:46,734 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-03-06 11:54:46,734 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-03-06 11:54:46,734 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:46,734 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-03-06 11:54:46,734 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1678103683637.481a06c29321823efe5a4e1277a22968. 2023-03-06 11:54:46,734 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1678103683637.481a06c29321823efe5a4e1277a22968. started... 2023-03-06 11:54:46,735 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 481a06c29321823efe5a4e1277a22968: 2023-03-06 11:54:46,735 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1678103683637.481a06c29321823efe5a4e1277a22968. 2023-03-06 11:54:46,737 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1678103683637.2716db1eb01ab77f5e97af8e87170f80. 2023-03-06 11:54:46,737 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1678103683637.2716db1eb01ab77f5e97af8e87170f80. started... 2023-03-06 11:54:46,737 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-06 11:54:46,737 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:54:46,737 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 2716db1eb01ab77f5e97af8e87170f80 2/2 column families, dataSize=90 B heapSize=752 B 2023-03-06 11:54:46,737 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1678103683637.2921237176876ba2f9c28123b4f2743d. 2023-03-06 11:54:46,737 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-06 11:54:46,738 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1678103683637.2921237176876ba2f9c28123b4f2743d. started... 2023-03-06 11:54:46,738 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 2921237176876ba2f9c28123b4f2743d: 2023-03-06 11:54:46,738 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1678103683637.2921237176876ba2f9c28123b4f2743d. 2023-03-06 11:54:46,738 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-06 11:54:47,160 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230306794056660cb249ad8131148d8b4a74bb to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230306794056660cb249ad8131148d8b4a74bb 2023-03-06 11:54:47,166 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=90, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testScannerOnBulkLoadRefHFiles/2716db1eb01ab77f5e97af8e87170f80/.tmp/family1/0650d3cc111a426eba138094fd3cc890 2023-03-06 11:54:47,171 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testScannerOnBulkLoadRefHFiles/2716db1eb01ab77f5e97af8e87170f80/.tmp/family1/0650d3cc111a426eba138094fd3cc890 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testScannerOnBulkLoadRefHFiles/2716db1eb01ab77f5e97af8e87170f80/family1/0650d3cc111a426eba138094fd3cc890 2023-03-06 11:54:47,175 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testScannerOnBulkLoadRefHFiles/2716db1eb01ab77f5e97af8e87170f80/family1/0650d3cc111a426eba138094fd3cc890, entries=2, sequenceid=9, filesize=5.0 K 2023-03-06 11:54:47,176 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~90 B/90, heapSize ~480 B/480, currentSize=0 B/0 for 2716db1eb01ab77f5e97af8e87170f80 in 439ms, sequenceid=9, compaction requested=false 2023-03-06 11:54:47,176 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 2716db1eb01ab77f5e97af8e87170f80: 2023-03-06 11:54:47,176 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1678103683637.2716db1eb01ab77f5e97af8e87170f80. 2023-03-06 11:54:47,176 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-06 11:54:47,176 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-06 11:54:47,176 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:47,176 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-03-06 11:54:47,176 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-03-06 11:54:47,179 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:47,179 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-06 11:54:47,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:47,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:47,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:47,180 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-06 11:54:47,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:47,180 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:54:47,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:47,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-06 11:54:47,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:47,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:47,181 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-03-06 11:54:47,181 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3310154e[Count = 0] remaining members to acquire global barrier 2023-03-06 11:54:47,181 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-03-06 11:54:47,181 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-06 11:54:47,182 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-06 11:54:47,182 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-06 11:54:47,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-06 11:54:47,182 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-03-06 11:54:47,182 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:47,183 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:54:47,182 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-03-06 11:54:47,183 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:54:47,184 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:47,184 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-03-06 11:54:47,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:47,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:47,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:47,184 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:47,184 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-03-06 11:54:47,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:47,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:47,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-06 11:54:47,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:47,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:47,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-06 11:54:47,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:47,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:54:47,187 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-03-06 11:54:47,187 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-03-06 11:54:47,187 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:54:47,187 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:54:47,187 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-03-06 11:54:47,187 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:54:47,188 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-06 11:54:47,188 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-06 11:54:47,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-06 11:54:47,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-06 11:54:47,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:47,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:47,188 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:47,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-06 11:54:47,194 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:47,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:47,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:47,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:47,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-06 11:54:47,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-06 11:54:47,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:47,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-06 11:54:47,195 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:47,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:47,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:47,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-06 11:54:47,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:47,198 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:47,198 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:47,198 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:47,198 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-03-06 11:54:47,198 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-03-06 11:54:47,198 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:54:47,198 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:47,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:47,198 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-06 11:54:47,198 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-06 11:54:47,198 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:47,199 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-06 11:54:47,199 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-06 11:54:47,199 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-06 11:54:47,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:47,199 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-03-06 11:54:47,199 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:54:47,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:47,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:47,299 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:54:47,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:54:47,307 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=36301] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testScannerOnBulkLoadRefHFiles 2023-03-06 11:54:47,309 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-03-06 11:54:47,310 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-03-06 11:54:47,311 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678104287311 2023-03-06 11:54:47,311 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] mob.MobUtils(833): start MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-06 11:54:47,312 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-06 11:54:47,312 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testScannerOnBulkLoadRefHFiles' and column 'family1' 2023-03-06 11:54:47,312 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-03-06 11:54:47,313 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] zookeeper.ReadOnlyZKClient(139): Connect 0x124ef63c to 127.0.0.1:62659 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-06 11:54:47,318 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7901350c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-06 11:54:47,318 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230306 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-03-06 11:54:48,155 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023030659f84c4dcc814052be528c95bcf0bcc9 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c2023030659f84c4dcc814052be528c95bcf0bcc9 2023-03-06 11:54:48,156 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230306 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-03-06 11:54:48,177 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-06 11:54:48,179 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:46084, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-06 11:54:48,187 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-06 11:54:48,189 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:42714, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-06 11:54:48,210 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230306/family1/89c2ff1e2c3c4001be03fbfa73b16b30 first=Optional[k0] last=Optional[k1] 2023-03-06 11:54:48,211 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testScannerOnBulkLoadRefHFiles,2,1678103683637.2716db1eb01ab77f5e97af8e87170f80., hostname=jenkins-hbase5.apache.org,42547,1678103642479, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230306/family1/89c2ff1e2c3c4001be03fbfa73b16b30}] 2023-03-06 11:54:48,216 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(763): Validating hfile at hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230306/family1/89c2ff1e2c3c4001be03fbfa73b16b30 for inclusion in 2716db1eb01ab77f5e97af8e87170f80/family1 2023-03-06 11:54:48,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(775): HFile bounds: first=k0 last=k1 2023-03-06 11:54:48,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(777): Region bounds: first=2 last= 2023-03-06 11:54:48,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegion(2446): Flush status journal for 2716db1eb01ab77f5e97af8e87170f80: 2023-03-06 11:54:48,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230306/family1/89c2ff1e2c3c4001be03fbfa73b16b30 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testScannerOnBulkLoadRefHFiles__n8oc0qhmbts2vgelb8hl2fejhl3mlvo772joujhhqlefo52195a2vk92k2rpcacr/family1/89c2ff1e2c3c4001be03fbfa73b16b30 2023-03-06 11:54:48,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testScannerOnBulkLoadRefHFiles__n8oc0qhmbts2vgelb8hl2fejhl3mlvo772joujhhqlefo52195a2vk92k2rpcacr/family1/89c2ff1e2c3c4001be03fbfa73b16b30 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testScannerOnBulkLoadRefHFiles/2716db1eb01ab77f5e97af8e87170f80/family1/5b6bd2b540064094bce2d3b1b6bf02dc_SeqId_12_ 2023-03-06 11:54:48,223 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(849): Loaded HFile hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testScannerOnBulkLoadRefHFiles__n8oc0qhmbts2vgelb8hl2fejhl3mlvo772joujhhqlefo52195a2vk92k2rpcacr/family1/89c2ff1e2c3c4001be03fbfa73b16b30 into 2716db1eb01ab77f5e97af8e87170f80/family1 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testScannerOnBulkLoadRefHFiles/2716db1eb01ab77f5e97af8e87170f80/family1/5b6bd2b540064094bce2d3b1b6bf02dc_SeqId_12_ - updating store file list. 2023-03-06 11:54:48,228 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(882): Loaded HFile hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testScannerOnBulkLoadRefHFiles/2716db1eb01ab77f5e97af8e87170f80/family1/5b6bd2b540064094bce2d3b1b6bf02dc_SeqId_12_ into 2716db1eb01ab77f5e97af8e87170f80/family1 2023-03-06 11:54:48,228 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(855): Successfully loaded hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testScannerOnBulkLoadRefHFiles__n8oc0qhmbts2vgelb8hl2fejhl3mlvo772joujhhqlefo52195a2vk92k2rpcacr/family1/89c2ff1e2c3c4001be03fbfa73b16b30 into 2716db1eb01ab77f5e97af8e87170f80/family1 (new location: hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testScannerOnBulkLoadRefHFiles/2716db1eb01ab77f5e97af8e87170f80/family1/5b6bd2b540064094bce2d3b1b6bf02dc_SeqId_12_) 2023-03-06 11:54:48,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testScannerOnBulkLoadRefHFiles__n8oc0qhmbts2vgelb8hl2fejhl3mlvo772joujhhqlefo52195a2vk92k2rpcacr/family1/89c2ff1e2c3c4001be03fbfa73b16b30 2023-03-06 11:54:48,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-06 11:54:48,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 15445 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-06 11:54:48,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(1912): 2716db1eb01ab77f5e97af8e87170f80/family1 is initiating minor compaction (all files) 2023-03-06 11:54:48,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@4200be53; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-06 11:54:48,231 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 2716db1eb01ab77f5e97af8e87170f80/family1 in testScannerOnBulkLoadRefHFiles,2,1678103683637.2716db1eb01ab77f5e97af8e87170f80. 2023-03-06 11:54:48,231 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testScannerOnBulkLoadRefHFiles/2716db1eb01ab77f5e97af8e87170f80/family1/f50ee91749a84bafae0eac56c8b084dd, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testScannerOnBulkLoadRefHFiles/2716db1eb01ab77f5e97af8e87170f80/family1/0650d3cc111a426eba138094fd3cc890, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testScannerOnBulkLoadRefHFiles/2716db1eb01ab77f5e97af8e87170f80/family1/5b6bd2b540064094bce2d3b1b6bf02dc_SeqId_12_] into tmpdir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testScannerOnBulkLoadRefHFiles/2716db1eb01ab77f5e97af8e87170f80/.tmp, totalSize=15.1 K 2023-03-06 11:54:48,232 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting f50ee91749a84bafae0eac56c8b084dd, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678103685753 2023-03-06 11:54:48,232 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting 0650d3cc111a426eba138094fd3cc890, keycount=2, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678103685753 2023-03-06 11:54:48,233 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting 5b6bd2b540064094bce2d3b1b6bf02dc_SeqId_12_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678103685753 2023-03-06 11:54:48,235 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230306 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-03-06 11:54:48,236 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:54:48,238 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230306794056660cb249ad8131148d8b4a74bb to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230306794056660cb249ad8131148d8b4a74bb 2023-03-06 11:54:48,239 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230306ad27a3c578164612a9023700a6fe266f to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230306ad27a3c578164612a9023700a6fe266f 2023-03-06 11:54:48,239 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testScannerOnBulkLoadRefHFiles 2 expired mob files are deleted 2023-03-06 11:54:48,239 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230306' 2023-03-06 11:54:48,240 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230306 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-03-06 11:54:48,240 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-03-06 11:54:48,240 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] mob.MobUtils(840): end MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-06 11:54:48,242 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-03-06 11:54:48,243 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE in 933 msec 2023-03-06 11:54:48,251 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] throttle.PressureAwareThroughputController(145): 2716db1eb01ab77f5e97af8e87170f80#family1#compaction#38 average throughput is 0.05 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-06 11:54:48,282 INFO [Listener at localhost/46717] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=250 (was 249) - Thread LEAK? -, OpenFileDescriptor=590 (was 592), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=307 (was 308), ProcessCount=160 (was 160), AvailableMemoryMB=10188 (was 10432) 2023-03-06 11:54:48,294 INFO [Listener at localhost/46717] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=250, OpenFileDescriptor=590, MaxFileDescriptor=60000, SystemLoadAverage=307, ProcessCount=160, AvailableMemoryMB=10186 2023-03-06 11:54:48,296 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.HMaster$4(2112): Client=jenkins//172.31.10.131 create 'testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-06 11:54:48,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:48,299 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-03-06 11:54:48,299 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(697): Client=jenkins//172.31.10.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyPolicy" procId is: 35 2023-03-06 11:54:48,300 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-06 11:54:48,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-03-06 11:54:48,301 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436 2023-03-06 11:54:48,302 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436 empty. 2023-03-06 11:54:48,303 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436 2023-03-06 11:54:48,303 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyPolicy regions 2023-03-06 11:54:48,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-03-06 11:54:48,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-03-06 11:54:48,720 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-03-06 11:54:48,721 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => f8635a0b679e1e26cb0200488a8ce436, NAME => 'testMajorCompactionWithWeeklyPolicy,,1678103688296.f8635a0b679e1e26cb0200488a8ce436.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp 2023-03-06 11:54:48,728 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1678103688296.f8635a0b679e1e26cb0200488a8ce436.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-06 11:54:48,728 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing f8635a0b679e1e26cb0200488a8ce436, disabling compactions & flushes 2023-03-06 11:54:48,728 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1678103688296.f8635a0b679e1e26cb0200488a8ce436. 2023-03-06 11:54:48,728 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1678103688296.f8635a0b679e1e26cb0200488a8ce436. 2023-03-06 11:54:48,728 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1678103688296.f8635a0b679e1e26cb0200488a8ce436. after waiting 0 ms 2023-03-06 11:54:48,729 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1678103688296.f8635a0b679e1e26cb0200488a8ce436. 2023-03-06 11:54:48,729 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1678103688296.f8635a0b679e1e26cb0200488a8ce436. 2023-03-06 11:54:48,729 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for f8635a0b679e1e26cb0200488a8ce436: 2023-03-06 11:54:48,731 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-03-06 11:54:48,732 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyPolicy,,1678103688296.f8635a0b679e1e26cb0200488a8ce436.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1678103688732"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678103688732"}]},"ts":"1678103688732"} 2023-03-06 11:54:48,734 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-06 11:54:48,735 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-06 11:54:48,735 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678103688735"}]},"ts":"1678103688735"} 2023-03-06 11:54:48,736 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-03-06 11:54:48,739 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=f8635a0b679e1e26cb0200488a8ce436, ASSIGN}] 2023-03-06 11:54:48,741 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=f8635a0b679e1e26cb0200488a8ce436, ASSIGN 2023-03-06 11:54:48,742 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=f8635a0b679e1e26cb0200488a8ce436, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,42547,1678103642479; forceNewPlan=false, retain=false 2023-03-06 11:54:48,893 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=f8635a0b679e1e26cb0200488a8ce436, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:48,893 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyPolicy,,1678103688296.f8635a0b679e1e26cb0200488a8ce436.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1678103688893"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678103688893"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678103688893"}]},"ts":"1678103688893"} 2023-03-06 11:54:48,895 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; OpenRegionProcedure f8635a0b679e1e26cb0200488a8ce436, server=jenkins-hbase5.apache.org,42547,1678103642479}] 2023-03-06 11:54:48,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-03-06 11:54:49,050 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyPolicy,,1678103688296.f8635a0b679e1e26cb0200488a8ce436. 2023-03-06 11:54:49,050 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f8635a0b679e1e26cb0200488a8ce436, NAME => 'testMajorCompactionWithWeeklyPolicy,,1678103688296.f8635a0b679e1e26cb0200488a8ce436.', STARTKEY => '', ENDKEY => ''} 2023-03-06 11:54:49,050 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyPolicy f8635a0b679e1e26cb0200488a8ce436 2023-03-06 11:54:49,050 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1678103688296.f8635a0b679e1e26cb0200488a8ce436.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-06 11:54:49,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for f8635a0b679e1e26cb0200488a8ce436 2023-03-06 11:54:49,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for f8635a0b679e1e26cb0200488a8ce436 2023-03-06 11:54:49,052 INFO [StoreOpener-f8635a0b679e1e26cb0200488a8ce436-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region f8635a0b679e1e26cb0200488a8ce436 2023-03-06 11:54:49,054 DEBUG [StoreOpener-f8635a0b679e1e26cb0200488a8ce436-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1 2023-03-06 11:54:49,054 DEBUG [StoreOpener-f8635a0b679e1e26cb0200488a8ce436-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1 2023-03-06 11:54:49,054 INFO [StoreOpener-f8635a0b679e1e26cb0200488a8ce436-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f8635a0b679e1e26cb0200488a8ce436 columnFamilyName family1 2023-03-06 11:54:49,056 INFO [StoreOpener-f8635a0b679e1e26cb0200488a8ce436-1] regionserver.HStore(310): Store=f8635a0b679e1e26cb0200488a8ce436/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-06 11:54:49,057 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436 2023-03-06 11:54:49,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436 2023-03-06 11:54:49,061 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for f8635a0b679e1e26cb0200488a8ce436 2023-03-06 11:54:49,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-06 11:54:49,064 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened f8635a0b679e1e26cb0200488a8ce436; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70393557, jitterRate=0.04894573986530304}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-06 11:54:49,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for f8635a0b679e1e26cb0200488a8ce436: 2023-03-06 11:54:49,065 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyPolicy,,1678103688296.f8635a0b679e1e26cb0200488a8ce436., pid=37, masterSystemTime=1678103689046 2023-03-06 11:54:49,067 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyPolicy,,1678103688296.f8635a0b679e1e26cb0200488a8ce436. 2023-03-06 11:54:49,067 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyPolicy,,1678103688296.f8635a0b679e1e26cb0200488a8ce436. 2023-03-06 11:54:49,067 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=f8635a0b679e1e26cb0200488a8ce436, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:49,068 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyPolicy,,1678103688296.f8635a0b679e1e26cb0200488a8ce436.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1678103689067"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678103689067"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678103689067"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678103689067"}]},"ts":"1678103689067"} 2023-03-06 11:54:49,071 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-03-06 11:54:49,072 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; OpenRegionProcedure f8635a0b679e1e26cb0200488a8ce436, server=jenkins-hbase5.apache.org,42547,1678103642479 in 174 msec 2023-03-06 11:54:49,074 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=36, resume processing ppid=35 2023-03-06 11:54:49,074 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=f8635a0b679e1e26cb0200488a8ce436, ASSIGN in 333 msec 2023-03-06 11:54:49,075 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-06 11:54:49,075 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678103689075"}]},"ts":"1678103689075"} 2023-03-06 11:54:49,076 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-03-06 11:54:49,079 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-03-06 11:54:49,081 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy in 783 msec 2023-03-06 11:54:49,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-03-06 11:54:49,405 INFO [Listener at localhost/46717] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyPolicy, procId: 35 completed 2023-03-06 11:54:49,437 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:54:49,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:49,447 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-06 11:54:49,447 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:49,447 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-06 11:54:49,447 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-06 11:54:49,447 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:49,447 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:49,448 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:49,448 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:49,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:49,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:49,449 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:49,449 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:54:49,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:49,449 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:49,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:54:49,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:49,450 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:49,450 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:49,450 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-06 11:54:49,450 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:49,450 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-06 11:54:49,450 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-06 11:54:49,450 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:54:49,450 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1678103688296.f8635a0b679e1e26cb0200488a8ce436. 2023-03-06 11:54:49,450 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1678103688296.f8635a0b679e1e26cb0200488a8ce436. started... 2023-03-06 11:54:49,451 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f8635a0b679e1e26cb0200488a8ce436 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-06 11:54:49,478 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testScannerOnBulkLoadRefHFiles/2716db1eb01ab77f5e97af8e87170f80/.tmp/family1/08291adb618848fcb5b294d9656e31cb as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testScannerOnBulkLoadRefHFiles/2716db1eb01ab77f5e97af8e87170f80/family1/08291adb618848fcb5b294d9656e31cb 2023-03-06 11:54:49,483 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 2716db1eb01ab77f5e97af8e87170f80/family1 of 2716db1eb01ab77f5e97af8e87170f80 into 08291adb618848fcb5b294d9656e31cb(size=5.1 K), total size for store is 5.1 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-06 11:54:49,483 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 2716db1eb01ab77f5e97af8e87170f80: 2023-03-06 11:54:49,483 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testScannerOnBulkLoadRefHFiles,2,1678103683637.2716db1eb01ab77f5e97af8e87170f80., storeName=family1, fileCount=3, fileSize=15.1 K (4.9 K, 5.0 K, 5.2 K), priority=2, time=1678103688231; duration=1sec 2023-03-06 11:54:49,483 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-06 11:54:49,508 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testScannerOnBulkLoadRefHFiles/2716db1eb01ab77f5e97af8e87170f80/family1/f50ee91749a84bafae0eac56c8b084dd, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testScannerOnBulkLoadRefHFiles/2716db1eb01ab77f5e97af8e87170f80/family1/0650d3cc111a426eba138094fd3cc890, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testScannerOnBulkLoadRefHFiles/2716db1eb01ab77f5e97af8e87170f80/family1/5b6bd2b540064094bce2d3b1b6bf02dc_SeqId_12_] to archive 2023-03-06 11:54:49,509 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:54:49,511 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testScannerOnBulkLoadRefHFiles/2716db1eb01ab77f5e97af8e87170f80/family1/f50ee91749a84bafae0eac56c8b084dd to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testScannerOnBulkLoadRefHFiles/2716db1eb01ab77f5e97af8e87170f80/family1/f50ee91749a84bafae0eac56c8b084dd 2023-03-06 11:54:49,513 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testScannerOnBulkLoadRefHFiles/2716db1eb01ab77f5e97af8e87170f80/family1/0650d3cc111a426eba138094fd3cc890 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testScannerOnBulkLoadRefHFiles/2716db1eb01ab77f5e97af8e87170f80/family1/0650d3cc111a426eba138094fd3cc890 2023-03-06 11:54:49,514 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testScannerOnBulkLoadRefHFiles/2716db1eb01ab77f5e97af8e87170f80/family1/5b6bd2b540064094bce2d3b1b6bf02dc_SeqId_12_ to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testScannerOnBulkLoadRefHFiles/2716db1eb01ab77f5e97af8e87170f80/family1/5b6bd2b540064094bce2d3b1b6bf02dc_SeqId_12_ 2023-03-06 11:54:49,870 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511302e46422b06324b42bde762bdc4159976 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511302e46422b06324b42bde762bdc4159976 2023-03-06 11:54:50,277 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/.tmp/family1/1bf5851a586c4971bbfd3f9d9906abb2 2023-03-06 11:54:50,284 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/.tmp/family1/1bf5851a586c4971bbfd3f9d9906abb2 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1/1bf5851a586c4971bbfd3f9d9906abb2 2023-03-06 11:54:50,288 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1/1bf5851a586c4971bbfd3f9d9906abb2, entries=1000, sequenceid=5, filesize=165.1 K 2023-03-06 11:54:50,289 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for f8635a0b679e1e26cb0200488a8ce436 in 838ms, sequenceid=5, compaction requested=false 2023-03-06 11:54:50,289 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyPolicy' 2023-03-06 11:54:50,290 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f8635a0b679e1e26cb0200488a8ce436: 2023-03-06 11:54:50,290 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1678103688296.f8635a0b679e1e26cb0200488a8ce436. 2023-03-06 11:54:50,290 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-06 11:54:50,290 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-06 11:54:50,290 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:50,290 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-06 11:54:50,290 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-06 11:54:50,291 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:50,291 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:50,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:50,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:50,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:50,292 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:50,292 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:54:50,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:50,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:50,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:50,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:50,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:50,293 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-06 11:54:50,293 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@347c45e4[Count = 0] remaining members to acquire global barrier 2023-03-06 11:54:50,293 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-06 11:54:50,293 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:50,294 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:50,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:50,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:50,295 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-06 11:54:50,295 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-06 11:54:50,295 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:54:50,295 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:50,295 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:54:50,297 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-06 11:54:50,297 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:50,297 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:50,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:50,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:50,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:50,297 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-06 11:54:50,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:50,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:50,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:50,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:50,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:50,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:50,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:50,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:54:50,300 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-06 11:54:50,300 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-06 11:54:50,300 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:54:50,300 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:54:50,300 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:50,300 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:54:50,301 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:50,301 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:50,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:50,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:50,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:50,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:50,301 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:50,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:50,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:50,302 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:50,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:50,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:50,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:50,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:50,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:50,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:50,303 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:50,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:50,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:50,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:50,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:50,305 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:50,305 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:50,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:50,305 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:50,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:50,306 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:50,306 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-06 11:54:50,306 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:50,306 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-06 11:54:50,306 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:54:50,306 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:50,306 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:50,306 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:50,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:50,306 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:50,306 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:50,306 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:50,306 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-06 11:54:50,306 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:54:50,349 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-06 11:54:50,406 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:54:50,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:54:50,413 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:54:50,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-06 11:54:50,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:50,415 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-06 11:54:50,415 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:50,415 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-06 11:54:50,415 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-06 11:54:50,415 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:50,415 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:50,417 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:50,417 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:50,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:50,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:50,417 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:50,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:50,417 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:54:50,418 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:50,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:54:50,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:50,418 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:50,418 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-06 11:54:50,418 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:50,419 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-06 11:54:50,419 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:50,419 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-06 11:54:50,419 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-06 11:54:50,419 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:54:50,419 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1678103688296.f8635a0b679e1e26cb0200488a8ce436. 2023-03-06 11:54:50,419 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1678103688296.f8635a0b679e1e26cb0200488a8ce436. started... 2023-03-06 11:54:50,419 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f8635a0b679e1e26cb0200488a8ce436 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-06 11:54:50,837 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128a4d2138428f843ff94060c9eead0feaf to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151128a4d2138428f843ff94060c9eead0feaf 2023-03-06 11:54:50,843 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/.tmp/family1/30011fecf2a24d3e9c4107b8a02beab3 2023-03-06 11:54:50,848 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/.tmp/family1/30011fecf2a24d3e9c4107b8a02beab3 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1/30011fecf2a24d3e9c4107b8a02beab3 2023-03-06 11:54:50,852 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1/30011fecf2a24d3e9c4107b8a02beab3, entries=1, sequenceid=9, filesize=5.0 K 2023-03-06 11:54:50,853 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for f8635a0b679e1e26cb0200488a8ce436 in 434ms, sequenceid=9, compaction requested=false 2023-03-06 11:54:50,853 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f8635a0b679e1e26cb0200488a8ce436: 2023-03-06 11:54:50,853 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1678103688296.f8635a0b679e1e26cb0200488a8ce436. 2023-03-06 11:54:50,853 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-06 11:54:50,853 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-06 11:54:50,853 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:50,853 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-06 11:54:50,853 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-06 11:54:50,857 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:50,857 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:50,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:50,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:50,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:50,858 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:50,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:50,858 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:54:50,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:50,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:50,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:50,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:50,859 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-06 11:54:50,859 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@621ed15e[Count = 0] remaining members to acquire global barrier 2023-03-06 11:54:50,859 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-06 11:54:50,859 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:50,866 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:50,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:50,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:50,866 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-06 11:54:50,866 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-06 11:54:50,867 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:54:50,867 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:50,867 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:54:50,868 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:50,868 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-06 11:54:50,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:50,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:50,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:50,868 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:50,868 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-06 11:54:50,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:50,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:50,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:50,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:50,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:50,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:50,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:50,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:54:50,870 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-06 11:54:50,870 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-06 11:54:50,870 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:54:50,870 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:54:50,870 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:50,870 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:54:50,871 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:50,871 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:50,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:50,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:50,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:50,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:50,872 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:50,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:50,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:50,872 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:50,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:50,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:50,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:50,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:50,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:50,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:50,873 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:50,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:50,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:50,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:50,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:50,877 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:50,877 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:50,877 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:50,877 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:50,877 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-06 11:54:50,877 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-06 11:54:50,877 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:54:50,877 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:50,877 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:50,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:50,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:50,877 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-06 11:54:50,877 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:54:50,877 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:50,878 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:50,878 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:50,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:50,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:50,878 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:50,978 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:54:50,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:54:50,983 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:54:50,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-06 11:54:50,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:50,985 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-06 11:54:50,985 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:50,985 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-06 11:54:50,985 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-06 11:54:50,986 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:50,986 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:50,987 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:50,987 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:50,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:50,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:50,987 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:50,987 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:54:50,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:50,987 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:50,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:54:50,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:50,988 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:50,988 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-06 11:54:50,988 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:50,988 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-06 11:54:50,988 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:50,988 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-06 11:54:50,988 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-06 11:54:50,988 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:54:50,988 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1678103688296.f8635a0b679e1e26cb0200488a8ce436. 2023-03-06 11:54:50,988 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1678103688296.f8635a0b679e1e26cb0200488a8ce436. started... 2023-03-06 11:54:50,989 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f8635a0b679e1e26cb0200488a8ce436 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-06 11:54:51,010 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512011209470b54c94c2f8641919a820f48cc to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512011209470b54c94c2f8641919a820f48cc 2023-03-06 11:54:51,417 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/.tmp/family1/f92e0c2dab7044b99961d028d1ca7467 2023-03-06 11:54:51,421 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/.tmp/family1/f92e0c2dab7044b99961d028d1ca7467 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1/f92e0c2dab7044b99961d028d1ca7467 2023-03-06 11:54:51,425 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1/f92e0c2dab7044b99961d028d1ca7467, entries=1, sequenceid=13, filesize=4.9 K 2023-03-06 11:54:51,426 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f8635a0b679e1e26cb0200488a8ce436 in 437ms, sequenceid=13, compaction requested=true 2023-03-06 11:54:51,426 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f8635a0b679e1e26cb0200488a8ce436: 2023-03-06 11:54:51,426 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1678103688296.f8635a0b679e1e26cb0200488a8ce436. 2023-03-06 11:54:51,426 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-06 11:54:51,426 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-06 11:54:51,426 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:51,426 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-06 11:54:51,426 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-06 11:54:51,428 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:51,428 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:51,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:51,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:51,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:51,428 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:51,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:51,429 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:54:51,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:51,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:51,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:51,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:51,430 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-06 11:54:51,430 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5c4efcde[Count = 0] remaining members to acquire global barrier 2023-03-06 11:54:51,430 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-06 11:54:51,430 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:51,431 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:51,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:51,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:51,431 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-06 11:54:51,431 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-06 11:54:51,431 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:54:51,431 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:51,431 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:54:51,433 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-06 11:54:51,433 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:51,433 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:51,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:51,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:51,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:51,433 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-06 11:54:51,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:51,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:51,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:51,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:51,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:51,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:51,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:51,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:54:51,437 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-06 11:54:51,437 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-06 11:54:51,437 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:54:51,437 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:54:51,437 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:51,437 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:54:51,440 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:51,440 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:51,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:51,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:51,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:51,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:51,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:51,440 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:51,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:51,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:51,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:51,441 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:51,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:51,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:51,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:51,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:51,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:51,443 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:51,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:51,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:51,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:51,445 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:51,445 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:51,445 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:51,445 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:51,445 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-06 11:54:51,445 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-06 11:54:51,445 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:54:51,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:51,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:51,445 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:51,445 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:51,446 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:51,446 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:51,446 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-06 11:54:51,446 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:54:51,446 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:51,446 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:51,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:51,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:51,546 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:54:51,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:54:51,551 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:54:51,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-06 11:54:51,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:51,553 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-06 11:54:51,553 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:51,553 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-06 11:54:51,553 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-06 11:54:51,553 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:51,553 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:51,554 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:51,554 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:51,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:51,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:51,555 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:51,555 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:54:51,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:51,555 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:51,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:54:51,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:51,556 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:51,556 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-06 11:54:51,556 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:51,556 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-06 11:54:51,556 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:51,556 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-06 11:54:51,556 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-06 11:54:51,557 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:54:51,557 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1678103688296.f8635a0b679e1e26cb0200488a8ce436. 2023-03-06 11:54:51,557 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1678103688296.f8635a0b679e1e26cb0200488a8ce436. started... 2023-03-06 11:54:51,557 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f8635a0b679e1e26cb0200488a8ce436 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-06 11:54:51,978 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512053425f892e2bb472e9f1b98f1082a1f20 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512053425f892e2bb472e9f1b98f1082a1f20 2023-03-06 11:54:52,383 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/.tmp/family1/33946a6d81cf4185a80bfb347b858a0b 2023-03-06 11:54:52,390 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/.tmp/family1/33946a6d81cf4185a80bfb347b858a0b as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1/33946a6d81cf4185a80bfb347b858a0b 2023-03-06 11:54:52,394 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1/33946a6d81cf4185a80bfb347b858a0b, entries=1, sequenceid=17, filesize=4.9 K 2023-03-06 11:54:52,395 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f8635a0b679e1e26cb0200488a8ce436 in 838ms, sequenceid=17, compaction requested=true 2023-03-06 11:54:52,395 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f8635a0b679e1e26cb0200488a8ce436: 2023-03-06 11:54:52,395 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1678103688296.f8635a0b679e1e26cb0200488a8ce436. 2023-03-06 11:54:52,395 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-06 11:54:52,396 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-06 11:54:52,396 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:52,396 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-06 11:54:52,396 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-06 11:54:52,397 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:52,397 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:52,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:52,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:52,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:52,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:52,398 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:52,398 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:54:52,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:52,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:52,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:52,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:52,399 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-06 11:54:52,399 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6f47387c[Count = 0] remaining members to acquire global barrier 2023-03-06 11:54:52,399 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-06 11:54:52,399 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:52,402 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:52,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:52,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:52,403 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:52,403 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-06 11:54:52,403 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-06 11:54:52,403 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:54:52,403 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:54:52,405 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-06 11:54:52,405 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:52,405 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:52,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:52,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:52,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:52,405 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-06 11:54:52,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:52,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:52,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:52,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:52,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:52,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:52,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:52,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:54:52,408 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-06 11:54:52,408 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-06 11:54:52,408 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:54:52,408 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:54:52,408 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:52,408 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:54:52,410 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:52,410 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:52,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:52,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:52,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:52,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:52,410 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:52,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:52,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:52,410 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:52,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:52,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:52,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:52,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:52,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:52,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:52,412 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:52,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:52,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:52,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:52,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:52,414 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:52,414 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:52,414 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:52,414 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:52,414 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-06 11:54:52,414 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:54:52,414 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:52,414 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:52,414 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:52,414 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:52,414 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:52,414 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:52,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:52,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:52,415 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-06 11:54:52,415 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:54:52,415 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:52,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:52,515 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:54:52,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:54:52,520 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:54:52,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-06 11:54:52,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:52,522 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-06 11:54:52,522 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:52,522 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-06 11:54:52,522 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-06 11:54:52,522 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:52,522 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:52,525 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:52,525 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:52,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:52,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:52,525 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:52,525 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:54:52,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:52,525 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:52,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:54:52,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:52,526 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:52,526 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-06 11:54:52,526 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:52,526 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-06 11:54:52,526 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:52,526 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-06 11:54:52,526 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-06 11:54:52,526 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:54:52,526 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1678103688296.f8635a0b679e1e26cb0200488a8ce436. 2023-03-06 11:54:52,527 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1678103688296.f8635a0b679e1e26cb0200488a8ce436. started... 2023-03-06 11:54:52,527 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f8635a0b679e1e26cb0200488a8ce436 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-06 11:54:52,945 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228b2ceb74c00a44b679a712d401cbd6be2 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228b2ceb74c00a44b679a712d401cbd6be2 2023-03-06 11:54:53,353 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/.tmp/family1/a09fb040402e47a3a7b3bd62ea2ea7ee 2023-03-06 11:54:53,359 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/.tmp/family1/a09fb040402e47a3a7b3bd62ea2ea7ee as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1/a09fb040402e47a3a7b3bd62ea2ea7ee 2023-03-06 11:54:53,364 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1/a09fb040402e47a3a7b3bd62ea2ea7ee, entries=1, sequenceid=21, filesize=4.9 K 2023-03-06 11:54:53,365 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f8635a0b679e1e26cb0200488a8ce436 in 838ms, sequenceid=21, compaction requested=true 2023-03-06 11:54:53,365 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f8635a0b679e1e26cb0200488a8ce436: 2023-03-06 11:54:53,365 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1678103688296.f8635a0b679e1e26cb0200488a8ce436. 2023-03-06 11:54:53,365 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-06 11:54:53,365 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-06 11:54:53,365 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:53,366 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-06 11:54:53,366 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-06 11:54:53,370 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:53,370 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:53,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:53,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:53,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:53,371 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:53,371 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:54:53,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:53,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:53,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:53,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:53,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:53,372 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-06 11:54:53,372 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@39420315[Count = 0] remaining members to acquire global barrier 2023-03-06 11:54:53,372 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-06 11:54:53,372 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:53,373 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:53,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:53,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:53,374 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-06 11:54:53,374 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-06 11:54:53,374 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:54:53,374 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:53,374 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:54:53,377 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:53,377 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-06 11:54:53,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:53,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:53,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:53,377 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:53,377 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-06 11:54:53,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:53,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:53,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:53,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:53,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:53,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:53,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:53,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:54:53,380 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-06 11:54:53,380 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-06 11:54:53,380 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:54:53,380 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:54:53,380 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:53,380 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:54:53,381 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:53,381 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:53,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:53,382 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:53,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:53,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:53,381 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:53,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:53,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:53,382 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:53,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:53,382 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:53,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:53,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:53,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:53,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:53,384 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:53,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:53,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:53,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:53,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:53,386 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:53,386 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:53,386 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:53,386 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:53,386 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-06 11:54:53,387 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:54:53,386 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:53,386 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:53,387 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:53,387 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-06 11:54:53,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:53,387 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-06 11:54:53,387 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:54:53,387 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:53,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:53,387 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:53,387 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:53,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:53,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:53,487 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:54:53,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:54:53,492 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:54:53,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-06 11:54:53,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:53,493 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-06 11:54:53,493 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:53,493 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-06 11:54:53,494 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-06 11:54:53,494 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:53,494 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:53,495 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:53,495 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:53,495 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:53,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:53,496 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:53,496 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:54:53,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:53,496 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:53,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:54:53,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:53,496 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:53,496 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-06 11:54:53,496 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:53,496 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-06 11:54:53,497 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:53,497 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-06 11:54:53,497 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-06 11:54:53,497 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:54:53,497 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1678103688296.f8635a0b679e1e26cb0200488a8ce436. 2023-03-06 11:54:53,497 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1678103688296.f8635a0b679e1e26cb0200488a8ce436. started... 2023-03-06 11:54:53,497 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f8635a0b679e1e26cb0200488a8ce436 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-06 11:54:53,908 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123162b6aabf0f9c4a1197be03437703f915 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015123162b6aabf0f9c4a1197be03437703f915 2023-03-06 11:54:54,314 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/.tmp/family1/cb5bd17024ae418a924a4a468d366b15 2023-03-06 11:54:54,318 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/.tmp/family1/cb5bd17024ae418a924a4a468d366b15 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1/cb5bd17024ae418a924a4a468d366b15 2023-03-06 11:54:54,322 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1/cb5bd17024ae418a924a4a468d366b15, entries=1, sequenceid=25, filesize=4.9 K 2023-03-06 11:54:54,323 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f8635a0b679e1e26cb0200488a8ce436 in 826ms, sequenceid=25, compaction requested=true 2023-03-06 11:54:54,323 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f8635a0b679e1e26cb0200488a8ce436: 2023-03-06 11:54:54,323 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1678103688296.f8635a0b679e1e26cb0200488a8ce436. 2023-03-06 11:54:54,323 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-06 11:54:54,323 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-06 11:54:54,323 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:54,323 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-06 11:54:54,323 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-06 11:54:54,326 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:54,326 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:54,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:54,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:54,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:54,326 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:54,326 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:54:54,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:54,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:54,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:54,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:54,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:54,327 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-06 11:54:54,328 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2dc2b142[Count = 0] remaining members to acquire global barrier 2023-03-06 11:54:54,328 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-06 11:54:54,328 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:54,329 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:54,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:54,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:54,329 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-06 11:54:54,329 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-06 11:54:54,329 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:54:54,329 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:54,329 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:54:54,330 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-06 11:54:54,330 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:54,330 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:54,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:54,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:54,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:54,330 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-06 11:54:54,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:54,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:54,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:54,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:54,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:54,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:54,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:54,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:54:54,332 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-06 11:54:54,332 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-06 11:54:54,332 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:54:54,332 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:54:54,332 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:54,332 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:54:54,334 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:54,334 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:54,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:54,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:54,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:54,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:54,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:54,334 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:54,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:54,334 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:54,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:54,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:54,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:54,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:54,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:54,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:54,335 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:54,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:54,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:54,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:54,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:54,339 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:54,339 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:54,339 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:54,339 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:54,339 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:54,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:54,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:54,339 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-06 11:54:54,339 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-06 11:54:54,339 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:54:54,339 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:54,339 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:54,339 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:54,339 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:54,339 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:54,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:54,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:54,339 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-06 11:54:54,340 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:54:54,440 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:54:54,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:54:54,445 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:54:54,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-06 11:54:54,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:54,447 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-06 11:54:54,447 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:54,447 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-06 11:54:54,447 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-06 11:54:54,447 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:54,447 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:54,448 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:54,448 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:54,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:54,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:54,448 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:54,448 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:54:54,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:54,449 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:54,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:54:54,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:54,449 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:54,449 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-06 11:54:54,449 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:54,449 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-06 11:54:54,449 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:54,449 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-06 11:54:54,450 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-06 11:54:54,450 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:54:54,450 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1678103688296.f8635a0b679e1e26cb0200488a8ce436. 2023-03-06 11:54:54,450 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1678103688296.f8635a0b679e1e26cb0200488a8ce436. started... 2023-03-06 11:54:54,450 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f8635a0b679e1e26cb0200488a8ce436 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-06 11:54:54,861 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101f0ca997025c74051b4f7334f8eda1b7f to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101f0ca997025c74051b4f7334f8eda1b7f 2023-03-06 11:54:55,267 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/.tmp/family1/5717851122164b58a6eca7750203f023 2023-03-06 11:54:55,272 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/.tmp/family1/5717851122164b58a6eca7750203f023 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1/5717851122164b58a6eca7750203f023 2023-03-06 11:54:55,276 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1/5717851122164b58a6eca7750203f023, entries=1, sequenceid=29, filesize=4.9 K 2023-03-06 11:54:55,277 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f8635a0b679e1e26cb0200488a8ce436 in 827ms, sequenceid=29, compaction requested=true 2023-03-06 11:54:55,277 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f8635a0b679e1e26cb0200488a8ce436: 2023-03-06 11:54:55,277 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1678103688296.f8635a0b679e1e26cb0200488a8ce436. 2023-03-06 11:54:55,277 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-06 11:54:55,277 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-06 11:54:55,277 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:55,277 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-06 11:54:55,277 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-06 11:54:55,280 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:55,280 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:55,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:55,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:55,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:55,280 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:55,280 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:54:55,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:55,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:55,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:55,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:55,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:55,281 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-06 11:54:55,281 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-06 11:54:55,281 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6c11028[Count = 0] remaining members to acquire global barrier 2023-03-06 11:54:55,281 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:55,284 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:55,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:55,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:55,285 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-06 11:54:55,285 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-06 11:54:55,285 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:54:55,285 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:55,285 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:54:55,288 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-06 11:54:55,288 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:55,288 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:55,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:55,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:55,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:55,288 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-06 11:54:55,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:55,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:55,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:55,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:55,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:55,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:55,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:55,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:54:55,290 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-06 11:54:55,290 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-06 11:54:55,290 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:54:55,290 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:54:55,291 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:55,291 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:54:55,292 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:55,292 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:55,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:55,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:55,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:55,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:55,292 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:55,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:55,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:55,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:55,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:55,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:55,293 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:55,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:55,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:55,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:55,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:55,294 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:55,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:55,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:55,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:55,297 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:55,297 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:55,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:55,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:55,297 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:55,297 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:55,297 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:55,297 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:55,297 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:55,297 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:55,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:55,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:55,297 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-06 11:54:55,297 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:54:55,297 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:55,297 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:55,298 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-06 11:54:55,298 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:54:55,398 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:54:55,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:54:55,403 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:54:55,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-06 11:54:55,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:55,404 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-06 11:54:55,404 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:55,404 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-06 11:54:55,404 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-06 11:54:55,405 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:55,405 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:55,409 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:55,409 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:55,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:55,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:55,409 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:55,409 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:54:55,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:55,410 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:55,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:54:55,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:55,410 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:55,410 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-06 11:54:55,410 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:55,411 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-06 11:54:55,411 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:55,411 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-06 11:54:55,411 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-06 11:54:55,411 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:54:55,411 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1678103688296.f8635a0b679e1e26cb0200488a8ce436. 2023-03-06 11:54:55,411 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1678103688296.f8635a0b679e1e26cb0200488a8ce436. started... 2023-03-06 11:54:55,411 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f8635a0b679e1e26cb0200488a8ce436 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-06 11:54:55,823 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103f4798e2604634b0ebb3e74f589ee490b to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103f4798e2604634b0ebb3e74f589ee490b 2023-03-06 11:54:56,228 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/.tmp/family1/916351d6358b4947b9cced87e0c60eb4 2023-03-06 11:54:56,233 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/.tmp/family1/916351d6358b4947b9cced87e0c60eb4 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1/916351d6358b4947b9cced87e0c60eb4 2023-03-06 11:54:56,236 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1/916351d6358b4947b9cced87e0c60eb4, entries=1, sequenceid=33, filesize=4.9 K 2023-03-06 11:54:56,237 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f8635a0b679e1e26cb0200488a8ce436 in 826ms, sequenceid=33, compaction requested=true 2023-03-06 11:54:56,237 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f8635a0b679e1e26cb0200488a8ce436: 2023-03-06 11:54:56,237 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1678103688296.f8635a0b679e1e26cb0200488a8ce436. 2023-03-06 11:54:56,237 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-06 11:54:56,237 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-06 11:54:56,237 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:56,237 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-06 11:54:56,237 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-06 11:54:56,239 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:56,239 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:56,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:56,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:56,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:56,239 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:56,239 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:54:56,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:56,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:56,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:56,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:56,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:56,240 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-06 11:54:56,240 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-06 11:54:56,240 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@50135c54[Count = 0] remaining members to acquire global barrier 2023-03-06 11:54:56,240 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:56,241 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:56,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:56,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:56,241 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-06 11:54:56,241 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-06 11:54:56,241 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:54:56,241 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:56,242 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:54:56,243 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:56,243 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-06 11:54:56,243 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:56,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:56,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:56,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:56,243 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-06 11:54:56,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:56,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:56,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:56,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:56,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:56,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:56,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:56,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:54:56,245 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-06 11:54:56,245 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-06 11:54:56,245 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:54:56,245 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:54:56,245 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:56,245 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:54:56,248 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:56,248 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:56,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:56,248 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:56,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:56,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:56,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:56,248 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:56,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:56,248 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:56,248 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:56,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:56,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:56,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:56,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:56,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:56,249 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:56,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:56,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:56,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:56,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:56,252 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:56,252 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:56,252 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:56,252 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-06 11:54:56,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:56,252 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:54:56,252 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-06 11:54:56,252 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:56,252 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:56,252 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:56,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:56,252 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:56,252 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-06 11:54:56,252 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:56,252 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:54:56,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:56,252 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:56,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:56,252 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:56,352 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:54:56,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:54:56,357 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:54:56,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-06 11:54:56,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:56,359 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-06 11:54:56,359 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:56,359 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-06 11:54:56,359 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-06 11:54:56,360 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:56,360 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:56,361 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:56,361 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:56,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:56,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:56,361 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:56,361 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:54:56,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:56,362 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:56,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:54:56,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:56,362 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:56,362 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-06 11:54:56,362 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:56,362 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-06 11:54:56,363 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:56,363 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-06 11:54:56,363 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-06 11:54:56,363 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:54:56,363 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1678103688296.f8635a0b679e1e26cb0200488a8ce436. 2023-03-06 11:54:56,363 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1678103688296.f8635a0b679e1e26cb0200488a8ce436. started... 2023-03-06 11:54:56,363 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f8635a0b679e1e26cb0200488a8ce436 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-06 11:54:56,776 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907de5609c1b8f848de851125dda6371324 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20150907de5609c1b8f848de851125dda6371324 2023-03-06 11:54:57,183 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/.tmp/family1/75de87f85ba94253906e7a36157ee1de 2023-03-06 11:54:57,188 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/.tmp/family1/75de87f85ba94253906e7a36157ee1de as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1/75de87f85ba94253906e7a36157ee1de 2023-03-06 11:54:57,192 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1/75de87f85ba94253906e7a36157ee1de, entries=1, sequenceid=37, filesize=4.9 K 2023-03-06 11:54:57,193 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f8635a0b679e1e26cb0200488a8ce436 in 830ms, sequenceid=37, compaction requested=true 2023-03-06 11:54:57,193 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f8635a0b679e1e26cb0200488a8ce436: 2023-03-06 11:54:57,193 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1678103688296.f8635a0b679e1e26cb0200488a8ce436. 2023-03-06 11:54:57,193 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-06 11:54:57,193 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-06 11:54:57,193 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:57,193 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-06 11:54:57,193 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-06 11:54:57,194 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:57,194 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:57,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:57,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:57,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:57,195 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:57,195 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:54:57,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:57,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:57,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:57,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:57,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:57,196 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-06 11:54:57,196 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7960b7e8[Count = 0] remaining members to acquire global barrier 2023-03-06 11:54:57,196 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-06 11:54:57,196 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:57,199 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:57,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:57,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:57,199 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-06 11:54:57,199 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-06 11:54:57,199 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:54:57,199 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:57,199 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:54:57,200 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-06 11:54:57,200 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:57,200 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:57,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:57,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:57,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:57,200 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-06 11:54:57,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:57,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:57,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:57,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:57,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:57,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:57,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:57,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:54:57,202 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-06 11:54:57,202 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-06 11:54:57,203 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:54:57,203 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:54:57,203 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:57,203 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:54:57,204 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:57,204 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:57,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:57,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:57,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:57,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:57,204 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:57,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:57,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:57,205 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:57,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:57,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:57,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:57,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:57,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:57,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:57,206 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:57,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:57,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:57,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:57,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:57,207 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:57,207 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:57,207 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:57,208 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:57,208 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:57,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:57,208 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:57,208 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-06 11:54:57,208 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:54:57,208 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:57,208 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:57,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:57,208 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:57,208 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:57,208 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-06 11:54:57,208 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:54:57,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:57,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:57,308 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:54:57,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:54:57,313 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:54:57,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-06 11:54:57,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:57,315 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-06 11:54:57,315 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:57,315 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-06 11:54:57,315 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-06 11:54:57,315 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:57,315 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:57,318 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:57,318 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:57,318 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:57,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:57,318 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:57,318 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:54:57,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:57,318 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:57,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:54:57,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:57,319 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:57,319 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-06 11:54:57,319 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:57,319 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-06 11:54:57,319 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:54:57,319 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-06 11:54:57,319 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-06 11:54:57,319 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:54:57,319 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1678103688296.f8635a0b679e1e26cb0200488a8ce436. 2023-03-06 11:54:57,319 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1678103688296.f8635a0b679e1e26cb0200488a8ce436. started... 2023-03-06 11:54:57,319 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f8635a0b679e1e26cb0200488a8ce436 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-06 11:54:57,331 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120d603e6da02714bd2bafc54fd10324aa9 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151120d603e6da02714bd2bafc54fd10324aa9 2023-03-06 11:54:57,736 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/.tmp/family1/f7fdeca1cd924ba7979ed52f622e3fb2 2023-03-06 11:54:57,741 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/.tmp/family1/f7fdeca1cd924ba7979ed52f622e3fb2 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1/f7fdeca1cd924ba7979ed52f622e3fb2 2023-03-06 11:54:57,746 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1/f7fdeca1cd924ba7979ed52f622e3fb2, entries=1, sequenceid=41, filesize=4.9 K 2023-03-06 11:54:57,746 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f8635a0b679e1e26cb0200488a8ce436 in 427ms, sequenceid=41, compaction requested=true 2023-03-06 11:54:57,747 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f8635a0b679e1e26cb0200488a8ce436: 2023-03-06 11:54:57,747 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1678103688296.f8635a0b679e1e26cb0200488a8ce436. 2023-03-06 11:54:57,747 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-06 11:54:57,747 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-06 11:54:57,747 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:57,747 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-06 11:54:57,747 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-06 11:54:57,748 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:57,748 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:57,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:57,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:57,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:57,748 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:57,748 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:54:57,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:57,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:57,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:57,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:57,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:57,750 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-06 11:54:57,750 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@41104127[Count = 0] remaining members to acquire global barrier 2023-03-06 11:54:57,750 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-06 11:54:57,750 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:57,751 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:57,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:57,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:57,751 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-06 11:54:57,751 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-06 11:54:57,751 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:54:57,751 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:57,751 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:54:57,752 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-06 11:54:57,752 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:57,752 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:57,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:57,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:57,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:57,752 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-06 11:54:57,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:57,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:57,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:57,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:57,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:57,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:57,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:57,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:54:57,754 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-06 11:54:57,754 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-06 11:54:57,754 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:54:57,754 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:54:57,754 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:57,754 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:54:57,756 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:57,756 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:57,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:57,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:54:57,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:54:57,756 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:57,756 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:57,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:57,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:54:57,757 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:57,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:57,757 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:57,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:57,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:57,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:54:57,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:57,758 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:57,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:57,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:54:57,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:57,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:57,762 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:57,762 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:54:57,762 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:57,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:54:57,763 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:54:57,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:54:57,763 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-06 11:54:57,763 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:54:57,763 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:57,763 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:54:57,763 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:54:57,763 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-06 11:54:57,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:54:57,763 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-06 11:54:57,763 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:57,763 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:54:57,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:54:57,763 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:57,763 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:57,863 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:54:57,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:54:57,865 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=36301] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyPolicy 2023-03-06 11:54:57,867 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] procedure2.ProcedureExecutor(1029): Stored pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-06 11:54:57,868 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-06 11:54:57,869 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=38, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678104297869 2023-03-06 11:54:57,869 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-06 11:54:57,870 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-06 11:54:57,871 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyPolicy' and column 'family1' 2023-03-06 11:54:57,871 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-06 11:54:57,872 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] zookeeper.ReadOnlyZKClient(139): Connect 0x15b38911 to 127.0.0.1:62659 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-06 11:54:57,876 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@656a77fe, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-06 11:54:57,876 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-06 11:54:58,720 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103181aa0cca81f4d96a318fb1969103730 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103181aa0cca81f4d96a318fb1969103730 2023-03-06 11:54:58,721 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-06 11:54:58,734 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-06 11:54:58,735 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:53306, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-06 11:54:58,742 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-06 11:54:58,743 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:54502, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-06 11:54:58,752 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/d660c7dcecfc4243815f05e470bd3eeb first=Optional[r3] last=Optional[r6] 2023-03-06 11:54:58,753 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1678103688296.f8635a0b679e1e26cb0200488a8ce436., hostname=jenkins-hbase5.apache.org,42547,1678103642479, seqNum=2 for row with hfile group [{family1,hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/d660c7dcecfc4243815f05e470bd3eeb}] 2023-03-06 11:54:58,757 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(763): Validating hfile at hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/d660c7dcecfc4243815f05e470bd3eeb for inclusion in f8635a0b679e1e26cb0200488a8ce436/family1 2023-03-06 11:54:58,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-03-06 11:54:58,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(777): Region bounds: first= last= 2023-03-06 11:54:58,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegion(2446): Flush status journal for f8635a0b679e1e26cb0200488a8ce436: 2023-03-06 11:54:58,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/d660c7dcecfc4243815f05e470bd3eeb to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionWithWeeklyPolicy__8odaafg07gkp6fj50knlugt42npma9f7598gb336impm7nkacualjm1eiep3pqrj/family1/d660c7dcecfc4243815f05e470bd3eeb 2023-03-06 11:54:58,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionWithWeeklyPolicy__8odaafg07gkp6fj50knlugt42npma9f7598gb336impm7nkacualjm1eiep3pqrj/family1/d660c7dcecfc4243815f05e470bd3eeb as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1/8f8113ef9d3a4d4da085addb567b1981_SeqId_44_ 2023-03-06 11:54:58,764 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(849): Loaded HFile hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionWithWeeklyPolicy__8odaafg07gkp6fj50knlugt42npma9f7598gb336impm7nkacualjm1eiep3pqrj/family1/d660c7dcecfc4243815f05e470bd3eeb into f8635a0b679e1e26cb0200488a8ce436/family1 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1/8f8113ef9d3a4d4da085addb567b1981_SeqId_44_ - updating store file list. 2023-03-06 11:54:58,767 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(882): Loaded HFile hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1/8f8113ef9d3a4d4da085addb567b1981_SeqId_44_ into f8635a0b679e1e26cb0200488a8ce436/family1 2023-03-06 11:54:58,768 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(855): Successfully loaded hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionWithWeeklyPolicy__8odaafg07gkp6fj50knlugt42npma9f7598gb336impm7nkacualjm1eiep3pqrj/family1/d660c7dcecfc4243815f05e470bd3eeb into f8635a0b679e1e26cb0200488a8ce436/family1 (new location: hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1/8f8113ef9d3a4d4da085addb567b1981_SeqId_44_) 2023-03-06 11:54:58,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionWithWeeklyPolicy__8odaafg07gkp6fj50knlugt42npma9f7598gb336impm7nkacualjm1eiep3pqrj/family1/d660c7dcecfc4243815f05e470bd3eeb 2023-03-06 11:54:58,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-06 11:54:58,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-06 11:54:58,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(1912): f8635a0b679e1e26cb0200488a8ce436/family1 is initiating minor compaction 2023-03-06 11:54:58,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@641b0f8f; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-06 11:54:58,771 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of f8635a0b679e1e26cb0200488a8ce436/family1 in testMajorCompactionWithWeeklyPolicy,,1678103688296.f8635a0b679e1e26cb0200488a8ce436. 2023-03-06 11:54:58,771 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1/30011fecf2a24d3e9c4107b8a02beab3, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1/f92e0c2dab7044b99961d028d1ca7467, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1/33946a6d81cf4185a80bfb347b858a0b, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1/a09fb040402e47a3a7b3bd62ea2ea7ee, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1/cb5bd17024ae418a924a4a468d366b15, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1/5717851122164b58a6eca7750203f023, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1/916351d6358b4947b9cced87e0c60eb4, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1/75de87f85ba94253906e7a36157ee1de, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1/f7fdeca1cd924ba7979ed52f622e3fb2, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1/8f8113ef9d3a4d4da085addb567b1981_SeqId_44_] into tmpdir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/.tmp, totalSize=50.0 K 2023-03-06 11:54:58,771 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting 30011fecf2a24d3e9c4107b8a02beab3, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-06 11:54:58,771 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting f92e0c2dab7044b99961d028d1ca7467, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-06 11:54:58,771 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting 33946a6d81cf4185a80bfb347b858a0b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-06 11:54:58,771 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting a09fb040402e47a3a7b3bd62ea2ea7ee, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-06 11:54:58,771 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting cb5bd17024ae418a924a4a468d366b15, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-06 11:54:58,771 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting 5717851122164b58a6eca7750203f023, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-06 11:54:58,771 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting 916351d6358b4947b9cced87e0c60eb4, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-06 11:54:58,771 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting 75de87f85ba94253906e7a36157ee1de, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-06 11:54:58,772 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting f7fdeca1cd924ba7979ed52f622e3fb2, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-06 11:54:58,772 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting 8f8113ef9d3a4d4da085addb567b1981_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-06 11:54:58,773 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-06 11:54:58,774 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:54:58,776 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228b2ceb74c00a44b679a712d401cbd6be2 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228b2ceb74c00a44b679a712d401cbd6be2 2023-03-06 11:54:58,777 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015123162b6aabf0f9c4a1197be03437703f915 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015123162b6aabf0f9c4a1197be03437703f915 2023-03-06 11:54:58,778 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101f0ca997025c74051b4f7334f8eda1b7f to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101f0ca997025c74051b4f7334f8eda1b7f 2023-03-06 11:54:58,780 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103f4798e2604634b0ebb3e74f589ee490b to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103f4798e2604634b0ebb3e74f589ee490b 2023-03-06 11:54:58,780 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-03-06 11:54:58,780 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-03-06 11:54:58,780 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-06 11:54:58,780 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-06 11:54:58,780 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-06 11:54:58,781 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-06 11:54:58,781 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-06 11:54:58,781 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-06 11:54:58,781 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-06 11:54:58,781 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-06 11:54:58,817 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] throttle.PressureAwareThroughputController(145): f8635a0b679e1e26cb0200488a8ce436#family1#compaction#49 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-06 11:54:59,253 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120587b15b5f5ac14081b67d742dc831f280 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015120587b15b5f5ac14081b67d742dc831f280 2023-03-06 11:54:59,255 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-06 11:54:59,292 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/6a3cc27d5acb4615a6b4647f58f4c1e7 first=Optional[r00] last=Optional[r2] 2023-03-06 11:54:59,293 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1678103688296.f8635a0b679e1e26cb0200488a8ce436., hostname=jenkins-hbase5.apache.org,42547,1678103642479, seqNum=2 for row with hfile group [{family1,hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/6a3cc27d5acb4615a6b4647f58f4c1e7}] 2023-03-06 11:54:59,296 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(763): Validating hfile at hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/6a3cc27d5acb4615a6b4647f58f4c1e7 for inclusion in f8635a0b679e1e26cb0200488a8ce436/family1 2023-03-06 11:54:59,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-03-06 11:54:59,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(777): Region bounds: first= last= 2023-03-06 11:54:59,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegion(2446): Flush status journal for f8635a0b679e1e26cb0200488a8ce436: 2023-03-06 11:54:59,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/6a3cc27d5acb4615a6b4647f58f4c1e7 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionWithWeeklyPolicy__l981ch323p7pju4d2uon0sd83mudl3vddjf3jaonq04ka9lks908gk60f464hjfi/family1/6a3cc27d5acb4615a6b4647f58f4c1e7 2023-03-06 11:54:59,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionWithWeeklyPolicy__l981ch323p7pju4d2uon0sd83mudl3vddjf3jaonq04ka9lks908gk60f464hjfi/family1/6a3cc27d5acb4615a6b4647f58f4c1e7 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1/95a968a4e6ef41aa9ac32d44c1cd1f2b_SeqId_46_ 2023-03-06 11:54:59,303 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(849): Loaded HFile hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionWithWeeklyPolicy__l981ch323p7pju4d2uon0sd83mudl3vddjf3jaonq04ka9lks908gk60f464hjfi/family1/6a3cc27d5acb4615a6b4647f58f4c1e7 into f8635a0b679e1e26cb0200488a8ce436/family1 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1/95a968a4e6ef41aa9ac32d44c1cd1f2b_SeqId_46_ - updating store file list. 2023-03-06 11:54:59,307 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(882): Loaded HFile hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1/95a968a4e6ef41aa9ac32d44c1cd1f2b_SeqId_46_ into f8635a0b679e1e26cb0200488a8ce436/family1 2023-03-06 11:54:59,307 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(855): Successfully loaded hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionWithWeeklyPolicy__l981ch323p7pju4d2uon0sd83mudl3vddjf3jaonq04ka9lks908gk60f464hjfi/family1/6a3cc27d5acb4615a6b4647f58f4c1e7 into f8635a0b679e1e26cb0200488a8ce436/family1 (new location: hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1/95a968a4e6ef41aa9ac32d44c1cd1f2b_SeqId_46_) 2023-03-06 11:54:59,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionWithWeeklyPolicy__l981ch323p7pju4d2uon0sd83mudl3vddjf3jaonq04ka9lks908gk60f464hjfi/family1/6a3cc27d5acb4615a6b4647f58f4c1e7 2023-03-06 11:54:59,312 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-06 11:54:59,312 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:54:59,314 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511302e46422b06324b42bde762bdc4159976 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511302e46422b06324b42bde762bdc4159976 2023-03-06 11:54:59,316 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512011209470b54c94c2f8641919a820f48cc to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512011209470b54c94c2f8641919a820f48cc 2023-03-06 11:54:59,318 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512053425f892e2bb472e9f1b98f1082a1f20 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512053425f892e2bb472e9f1b98f1082a1f20 2023-03-06 11:54:59,318 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 3 expired mob files are deleted 2023-03-06 11:54:59,318 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-03-06 11:54:59,318 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-06 11:54:59,319 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-06 11:54:59,319 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-06 11:54:59,320 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=38, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-06 11:54:59,322 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=38, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.4540 sec 2023-03-06 11:54:59,430 INFO [Listener at localhost/46717] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=257 (was 250) - Thread LEAK? -, OpenFileDescriptor=634 (was 590) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=304 (was 307), ProcessCount=160 (was 160), AvailableMemoryMB=9918 (was 10186) 2023-03-06 11:54:59,441 INFO [Listener at localhost/46717] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=257, OpenFileDescriptor=634, MaxFileDescriptor=60000, SystemLoadAverage=304, ProcessCount=160, AvailableMemoryMB=9918 2023-03-06 11:54:59,443 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.HMaster$4(2112): Client=jenkins//172.31.10.131 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-06 11:54:59,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure2.ProcedureExecutor(1029): Stored pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:54:59,445 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_PRE_OPERATION 2023-03-06 11:54:59,445 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(697): Client=jenkins//172.31.10.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly" procId is: 39 2023-03-06 11:54:59,445 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-06 11:54:59,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-03-06 11:54:59,447 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f 2023-03-06 11:54:59,447 DEBUG [HFileArchiver-9] backup.HFileArchiver(153): Directory hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f empty. 2023-03-06 11:54:59,447 DEBUG [HFileArchiver-9] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f 2023-03-06 11:54:59,448 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly regions 2023-03-06 11:54:59,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-03-06 11:54:59,656 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/.tmp/family1/5301434d6a0949bda7ce8f05fd7914c1 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1/5301434d6a0949bda7ce8f05fd7914c1 2023-03-06 11:54:59,661 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in f8635a0b679e1e26cb0200488a8ce436/family1 of f8635a0b679e1e26cb0200488a8ce436 into 5301434d6a0949bda7ce8f05fd7914c1(size=6.6 K), total size for store is 337.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-06 11:54:59,661 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for f8635a0b679e1e26cb0200488a8ce436: 2023-03-06 11:54:59,661 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1678103688296.f8635a0b679e1e26cb0200488a8ce436., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1678103698771; duration=0sec 2023-03-06 11:54:59,661 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-06 11:54:59,717 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1/30011fecf2a24d3e9c4107b8a02beab3, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1/f92e0c2dab7044b99961d028d1ca7467, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1/33946a6d81cf4185a80bfb347b858a0b, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1/a09fb040402e47a3a7b3bd62ea2ea7ee, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1/cb5bd17024ae418a924a4a468d366b15, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1/5717851122164b58a6eca7750203f023, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1/916351d6358b4947b9cced87e0c60eb4, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1/75de87f85ba94253906e7a36157ee1de, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1/f7fdeca1cd924ba7979ed52f622e3fb2, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1/8f8113ef9d3a4d4da085addb567b1981_SeqId_44_] to archive 2023-03-06 11:54:59,718 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:54:59,720 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1/30011fecf2a24d3e9c4107b8a02beab3 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1/30011fecf2a24d3e9c4107b8a02beab3 2023-03-06 11:54:59,721 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1/f92e0c2dab7044b99961d028d1ca7467 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1/f92e0c2dab7044b99961d028d1ca7467 2023-03-06 11:54:59,722 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1/33946a6d81cf4185a80bfb347b858a0b to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1/33946a6d81cf4185a80bfb347b858a0b 2023-03-06 11:54:59,723 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1/a09fb040402e47a3a7b3bd62ea2ea7ee to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1/a09fb040402e47a3a7b3bd62ea2ea7ee 2023-03-06 11:54:59,724 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1/cb5bd17024ae418a924a4a468d366b15 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1/cb5bd17024ae418a924a4a468d366b15 2023-03-06 11:54:59,725 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1/5717851122164b58a6eca7750203f023 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1/5717851122164b58a6eca7750203f023 2023-03-06 11:54:59,726 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1/916351d6358b4947b9cced87e0c60eb4 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1/916351d6358b4947b9cced87e0c60eb4 2023-03-06 11:54:59,727 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1/75de87f85ba94253906e7a36157ee1de to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1/75de87f85ba94253906e7a36157ee1de 2023-03-06 11:54:59,728 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1/f7fdeca1cd924ba7979ed52f622e3fb2 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1/f7fdeca1cd924ba7979ed52f622e3fb2 2023-03-06 11:54:59,729 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1/8f8113ef9d3a4d4da085addb567b1981_SeqId_44_ to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/family1/8f8113ef9d3a4d4da085addb567b1981_SeqId_44_ 2023-03-06 11:54:59,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-03-06 11:54:59,855 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-03-06 11:54:59,857 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6dad7421b77af3fd70e66df0531fef4f, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp 2023-03-06 11:55:00,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-03-06 11:55:00,263 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-06 11:55:00,263 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1604): Closing 6dad7421b77af3fd70e66df0531fef4f, disabling compactions & flushes 2023-03-06 11:55:00,263 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f. 2023-03-06 11:55:00,263 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f. 2023-03-06 11:55:00,263 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f. after waiting 0 ms 2023-03-06 11:55:00,263 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f. 2023-03-06 11:55:00,263 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f. 2023-03-06 11:55:00,263 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1558): Region close journal for 6dad7421b77af3fd70e66df0531fef4f: 2023-03-06 11:55:00,265 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ADD_TO_META 2023-03-06 11:55:00,266 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1678103700266"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678103700266"}]},"ts":"1678103700266"} 2023-03-06 11:55:00,273 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-06 11:55:00,274 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-06 11:55:00,274 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678103700274"}]},"ts":"1678103700274"} 2023-03-06 11:55:00,275 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLING in hbase:meta 2023-03-06 11:55:00,279 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=6dad7421b77af3fd70e66df0531fef4f, ASSIGN}] 2023-03-06 11:55:00,281 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=6dad7421b77af3fd70e66df0531fef4f, ASSIGN 2023-03-06 11:55:00,282 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=6dad7421b77af3fd70e66df0531fef4f, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,42547,1678103642479; forceNewPlan=false, retain=false 2023-03-06 11:55:00,433 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=6dad7421b77af3fd70e66df0531fef4f, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:00,433 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1678103700433"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678103700433"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678103700433"}]},"ts":"1678103700433"} 2023-03-06 11:55:00,435 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=41, ppid=40, state=RUNNABLE; OpenRegionProcedure 6dad7421b77af3fd70e66df0531fef4f, server=jenkins-hbase5.apache.org,42547,1678103642479}] 2023-03-06 11:55:00,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-03-06 11:55:00,590 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f. 2023-03-06 11:55:00,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6dad7421b77af3fd70e66df0531fef4f, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f.', STARTKEY => '', ENDKEY => ''} 2023-03-06 11:55:00,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 6dad7421b77af3fd70e66df0531fef4f 2023-03-06 11:55:00,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-06 11:55:00,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 6dad7421b77af3fd70e66df0531fef4f 2023-03-06 11:55:00,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 6dad7421b77af3fd70e66df0531fef4f 2023-03-06 11:55:00,591 INFO [StoreOpener-6dad7421b77af3fd70e66df0531fef4f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 6dad7421b77af3fd70e66df0531fef4f 2023-03-06 11:55:00,593 DEBUG [StoreOpener-6dad7421b77af3fd70e66df0531fef4f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1 2023-03-06 11:55:00,593 DEBUG [StoreOpener-6dad7421b77af3fd70e66df0531fef4f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1 2023-03-06 11:55:00,593 INFO [StoreOpener-6dad7421b77af3fd70e66df0531fef4f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6dad7421b77af3fd70e66df0531fef4f columnFamilyName family1 2023-03-06 11:55:00,595 INFO [StoreOpener-6dad7421b77af3fd70e66df0531fef4f-1] regionserver.HStore(310): Store=6dad7421b77af3fd70e66df0531fef4f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-06 11:55:00,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f 2023-03-06 11:55:00,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f 2023-03-06 11:55:00,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 6dad7421b77af3fd70e66df0531fef4f 2023-03-06 11:55:00,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-06 11:55:00,602 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 6dad7421b77af3fd70e66df0531fef4f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74464770, jitterRate=0.10961154103279114}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-06 11:55:00,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 6dad7421b77af3fd70e66df0531fef4f: 2023-03-06 11:55:00,602 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f., pid=41, masterSystemTime=1678103700587 2023-03-06 11:55:00,604 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f. 2023-03-06 11:55:00,604 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f. 2023-03-06 11:55:00,605 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=6dad7421b77af3fd70e66df0531fef4f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:00,605 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1678103700604"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678103700604"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678103700604"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678103700604"}]},"ts":"1678103700604"} 2023-03-06 11:55:00,608 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=41, resume processing ppid=40 2023-03-06 11:55:00,608 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=40, state=SUCCESS; OpenRegionProcedure 6dad7421b77af3fd70e66df0531fef4f, server=jenkins-hbase5.apache.org,42547,1678103642479 in 171 msec 2023-03-06 11:55:00,610 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=39 2023-03-06 11:55:00,610 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=6dad7421b77af3fd70e66df0531fef4f, ASSIGN in 329 msec 2023-03-06 11:55:00,611 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-06 11:55:00,611 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678103700611"}]},"ts":"1678103700611"} 2023-03-06 11:55:00,612 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLED in hbase:meta 2023-03-06 11:55:00,615 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_POST_OPERATION 2023-03-06 11:55:00,616 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=39, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.1720 sec 2023-03-06 11:55:01,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-03-06 11:55:01,551 INFO [Listener at localhost/46717] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, procId: 39 completed 2023-03-06 11:55:01,580 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:55:01,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:01,583 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-06 11:55:01,583 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:55:01,583 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-06 11:55:01,583 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-06 11:55:01,583 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:01,583 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:01,584 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:55:01,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:55:01,585 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:01,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:55:01,585 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:01,585 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:55:01,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:01,585 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:01,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:55:01,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:01,586 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:01,586 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:01,586 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-06 11:55:01,586 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:55:01,586 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-06 11:55:01,586 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-06 11:55:01,586 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:55:01,586 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f. 2023-03-06 11:55:01,586 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f. started... 2023-03-06 11:55:01,587 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6dad7421b77af3fd70e66df0531fef4f 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-06 11:55:02,015 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511305e284abf72354cdda2bd14c69c8b48cc to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511305e284abf72354cdda2bd14c69c8b48cc 2023-03-06 11:55:02,022 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/.tmp/family1/7f5aad7eebbc4bcf9a772d951e1fdd8e 2023-03-06 11:55:02,027 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/.tmp/family1/7f5aad7eebbc4bcf9a772d951e1fdd8e as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/7f5aad7eebbc4bcf9a772d951e1fdd8e 2023-03-06 11:55:02,033 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/7f5aad7eebbc4bcf9a772d951e1fdd8e, entries=1000, sequenceid=5, filesize=191.4 K 2023-03-06 11:55:02,033 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 6dad7421b77af3fd70e66df0531fef4f in 446ms, sequenceid=5, compaction requested=false 2023-03-06 11:55:02,034 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-06 11:55:02,034 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6dad7421b77af3fd70e66df0531fef4f: 2023-03-06 11:55:02,034 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f. 2023-03-06 11:55:02,034 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-06 11:55:02,034 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-06 11:55:02,034 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:02,034 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-06 11:55:02,034 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-06 11:55:02,036 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:02,036 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:02,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:02,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:02,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:02,036 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:02,036 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:55:02,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:02,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:02,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:02,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:02,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:02,037 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-06 11:55:02,037 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4fde497d[Count = 0] remaining members to acquire global barrier 2023-03-06 11:55:02,037 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-06 11:55:02,038 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:02,038 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:02,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:02,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:02,039 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-06 11:55:02,039 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-06 11:55:02,039 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:55:02,039 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:02,039 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:55:02,041 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-06 11:55:02,041 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:55:02,041 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:02,041 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-06 11:55:02,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:02,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:02,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:02,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:02,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:02,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:02,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:02,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:02,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:02,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:02,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:55:02,044 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-06 11:55:02,044 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-06 11:55:02,044 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:55:02,044 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:55:02,044 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:02,044 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:55:02,045 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:02,045 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:02,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:02,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:02,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:02,045 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:55:02,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:02,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:02,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:02,046 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:02,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:55:02,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:55:02,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:02,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:02,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:02,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:02,047 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:02,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:02,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:02,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:02,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:02,048 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:02,048 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:02,048 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:55:02,048 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:02,049 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-06 11:55:02,049 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:55:02,049 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:02,049 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-06 11:55:02,049 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:55:02,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:55:02,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:55:02,049 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:55:02,049 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:02,049 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-06 11:55:02,049 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:55:02,049 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:02,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:55:02,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:55:02,049 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:02,149 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:55:02,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:55:02,155 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:55:02,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-06 11:55:02,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:02,159 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-06 11:55:02,159 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:55:02,159 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-06 11:55:02,159 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-06 11:55:02,160 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:02,160 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:02,161 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:55:02,161 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:02,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:55:02,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:55:02,162 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:02,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:02,162 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:55:02,162 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:02,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:55:02,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:02,162 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:02,163 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-06 11:55:02,163 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:02,163 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-06 11:55:02,163 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:55:02,163 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-06 11:55:02,163 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-06 11:55:02,163 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:55:02,163 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f. 2023-03-06 11:55:02,163 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f. started... 2023-03-06 11:55:02,163 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6dad7421b77af3fd70e66df0531fef4f 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-06 11:55:02,189 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128138cc7b2cde2438b8e4db6207958b8c2 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128138cc7b2cde2438b8e4db6207958b8c2 2023-03-06 11:55:02,599 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/.tmp/family1/ae1d7ce8f08f4289a7aca2f8998e6057 2023-03-06 11:55:02,605 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/.tmp/family1/ae1d7ce8f08f4289a7aca2f8998e6057 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/ae1d7ce8f08f4289a7aca2f8998e6057 2023-03-06 11:55:02,610 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/ae1d7ce8f08f4289a7aca2f8998e6057, entries=1, sequenceid=9, filesize=5.0 K 2023-03-06 11:55:02,610 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 6dad7421b77af3fd70e66df0531fef4f in 447ms, sequenceid=9, compaction requested=false 2023-03-06 11:55:02,611 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6dad7421b77af3fd70e66df0531fef4f: 2023-03-06 11:55:02,611 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f. 2023-03-06 11:55:02,611 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-06 11:55:02,611 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-06 11:55:02,611 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:02,611 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-06 11:55:02,611 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-06 11:55:02,612 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:02,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:02,612 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:02,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:02,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:02,613 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:02,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:02,613 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:55:02,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:02,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:02,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:02,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:02,614 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-06 11:55:02,614 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5654d2e[Count = 0] remaining members to acquire global barrier 2023-03-06 11:55:02,614 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-06 11:55:02,614 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:02,616 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:02,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:02,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:02,616 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-06 11:55:02,616 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-06 11:55:02,616 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:55:02,616 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:02,616 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:55:02,619 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-06 11:55:02,619 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:55:02,619 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:02,619 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-06 11:55:02,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:02,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:02,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:02,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:02,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:02,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:02,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:02,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:02,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:02,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:02,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:55:02,621 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-06 11:55:02,621 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-06 11:55:02,622 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:55:02,622 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:55:02,622 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:02,622 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:55:02,623 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:02,623 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:02,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:02,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:02,623 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:55:02,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:02,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:02,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:02,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:55:02,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:55:02,624 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:02,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:02,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:02,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:02,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:02,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:02,625 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:02,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:02,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:02,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:02,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:02,631 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:02,631 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:55:02,631 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:02,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:55:02,631 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-06 11:55:02,631 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:55:02,631 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:55:02,631 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:02,631 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:55:02,631 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-06 11:55:02,631 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-06 11:55:02,631 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:02,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:55:02,631 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:02,631 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:55:02,631 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:02,631 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:02,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:55:02,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:55:02,731 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:55:02,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:55:02,736 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:55:02,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-06 11:55:02,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:02,738 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-06 11:55:02,738 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:55:02,738 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-06 11:55:02,738 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-06 11:55:02,738 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:02,738 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:02,739 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:02,739 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:55:02,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:55:02,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:55:02,740 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:02,740 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:55:02,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:02,740 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:02,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:55:02,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:02,740 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:02,741 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-06 11:55:02,741 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:02,741 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-06 11:55:02,741 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:55:02,741 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-06 11:55:02,741 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-06 11:55:02,741 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:55:02,741 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f. 2023-03-06 11:55:02,741 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f. started... 2023-03-06 11:55:02,741 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6dad7421b77af3fd70e66df0531fef4f 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-06 11:55:03,154 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201bc3d4bb1bfd1457b84ec638772eb9b14 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201bc3d4bb1bfd1457b84ec638772eb9b14 2023-03-06 11:55:03,560 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/.tmp/family1/30aa1eec20934f1bb4bb95fff7986c0a 2023-03-06 11:55:03,565 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/.tmp/family1/30aa1eec20934f1bb4bb95fff7986c0a as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/30aa1eec20934f1bb4bb95fff7986c0a 2023-03-06 11:55:03,569 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/30aa1eec20934f1bb4bb95fff7986c0a, entries=1, sequenceid=13, filesize=5.0 K 2023-03-06 11:55:03,570 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6dad7421b77af3fd70e66df0531fef4f in 829ms, sequenceid=13, compaction requested=true 2023-03-06 11:55:03,570 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6dad7421b77af3fd70e66df0531fef4f: 2023-03-06 11:55:03,570 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f. 2023-03-06 11:55:03,570 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-06 11:55:03,570 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-06 11:55:03,570 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:03,570 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-06 11:55:03,570 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-06 11:55:03,572 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:03,572 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:03,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:03,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:03,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:03,572 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:03,572 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:55:03,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:03,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:03,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:03,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:03,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:03,574 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-06 11:55:03,574 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7946659d[Count = 0] remaining members to acquire global barrier 2023-03-06 11:55:03,574 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-06 11:55:03,574 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:03,575 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:03,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:03,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:03,576 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-06 11:55:03,576 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-06 11:55:03,576 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:55:03,576 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:03,576 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:55:03,578 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:03,578 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-06 11:55:03,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:03,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:03,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:03,578 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:55:03,579 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-06 11:55:03,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:03,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:03,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:03,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:03,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:03,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:03,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:03,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:55:03,581 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-06 11:55:03,581 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-06 11:55:03,581 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:55:03,581 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:55:03,581 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:03,581 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:55:03,582 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:03,582 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:03,582 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:55:03,582 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:03,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:03,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:03,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:03,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:03,583 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:03,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:03,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:55:03,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:55:03,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:03,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:03,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:03,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:03,584 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:03,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:03,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:03,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:03,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:03,585 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:03,585 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:03,585 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:55:03,586 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:03,586 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-06 11:55:03,586 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:55:03,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:55:03,586 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:55:03,586 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:55:03,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:55:03,586 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-06 11:55:03,586 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-06 11:55:03,586 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:03,586 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:55:03,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:55:03,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:55:03,586 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:03,586 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:03,586 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:03,686 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:55:03,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:55:03,691 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:55:03,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-06 11:55:03,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:03,693 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-06 11:55:03,693 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:55:03,693 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-06 11:55:03,693 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-06 11:55:03,693 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:03,693 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:03,695 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:03,695 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:55:03,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:55:03,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:55:03,695 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:03,695 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:55:03,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:03,695 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:03,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:55:03,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:03,696 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:03,696 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-06 11:55:03,696 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:03,696 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-06 11:55:03,696 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:55:03,696 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-06 11:55:03,696 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-06 11:55:03,696 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:55:03,696 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f. 2023-03-06 11:55:03,696 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f. started... 2023-03-06 11:55:03,696 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6dad7421b77af3fd70e66df0531fef4f 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-06 11:55:03,799 DEBUG [regionserver/jenkins-hbase5:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-03-06 11:55:04,110 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512053915d5bcf55b4041baf626919bb9c00e to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512053915d5bcf55b4041baf626919bb9c00e 2023-03-06 11:55:04,516 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/.tmp/family1/41a9886d5a2e486c8a58491cc8a4a1c0 2023-03-06 11:55:04,520 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/.tmp/family1/41a9886d5a2e486c8a58491cc8a4a1c0 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/41a9886d5a2e486c8a58491cc8a4a1c0 2023-03-06 11:55:04,524 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/41a9886d5a2e486c8a58491cc8a4a1c0, entries=1, sequenceid=17, filesize=5.0 K 2023-03-06 11:55:04,524 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6dad7421b77af3fd70e66df0531fef4f in 828ms, sequenceid=17, compaction requested=true 2023-03-06 11:55:04,525 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6dad7421b77af3fd70e66df0531fef4f: 2023-03-06 11:55:04,525 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f. 2023-03-06 11:55:04,525 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-06 11:55:04,525 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-06 11:55:04,525 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:04,525 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-06 11:55:04,525 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-06 11:55:04,529 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:04,529 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:04,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:04,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:04,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:04,529 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:04,529 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:55:04,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:04,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:04,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:04,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:04,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:04,530 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-06 11:55:04,531 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3a1c1aeb[Count = 0] remaining members to acquire global barrier 2023-03-06 11:55:04,531 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-06 11:55:04,531 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:04,532 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:04,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:04,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:04,532 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-06 11:55:04,532 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-06 11:55:04,532 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:55:04,532 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:04,532 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:55:04,534 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-06 11:55:04,534 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:04,534 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:55:04,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:04,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:04,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:04,534 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-06 11:55:04,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:04,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:04,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:04,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:04,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:04,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:04,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:04,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:55:04,536 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-06 11:55:04,536 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-06 11:55:04,536 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:55:04,536 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:55:04,536 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:04,536 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:55:04,538 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:04,538 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:04,538 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:55:04,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:04,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:04,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:04,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:04,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:04,538 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:04,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:04,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:55:04,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:55:04,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:04,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:04,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:04,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:04,539 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:04,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:04,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:04,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:04,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:04,543 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:04,543 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:04,543 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:04,543 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:04,543 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:55:04,543 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-06 11:55:04,543 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:55:04,543 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:55:04,543 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:04,543 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:55:04,543 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:04,543 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:04,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:55:04,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:55:04,543 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-06 11:55:04,543 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-06 11:55:04,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:55:04,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:55:04,543 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:55:04,644 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:55:04,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:55:04,648 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:55:04,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-06 11:55:04,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:04,650 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-06 11:55:04,650 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:55:04,650 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-06 11:55:04,650 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-06 11:55:04,650 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:04,651 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:04,652 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:04,652 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:55:04,652 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:55:04,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:55:04,652 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:04,652 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:55:04,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:04,653 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:04,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:55:04,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:04,653 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:04,656 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-06 11:55:04,656 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:04,656 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-06 11:55:04,656 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:55:04,657 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-06 11:55:04,657 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-06 11:55:04,657 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:55:04,657 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f. 2023-03-06 11:55:04,657 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f. started... 2023-03-06 11:55:04,657 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6dad7421b77af3fd70e66df0531fef4f 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-06 11:55:05,071 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512282a9dc896620c4c64ba452042f77b0acb to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512282a9dc896620c4c64ba452042f77b0acb 2023-03-06 11:55:05,476 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/.tmp/family1/086a13cea170409bba2b66da6fdc6fa2 2023-03-06 11:55:05,484 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/.tmp/family1/086a13cea170409bba2b66da6fdc6fa2 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/086a13cea170409bba2b66da6fdc6fa2 2023-03-06 11:55:05,489 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/086a13cea170409bba2b66da6fdc6fa2, entries=1, sequenceid=21, filesize=5.0 K 2023-03-06 11:55:05,490 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6dad7421b77af3fd70e66df0531fef4f in 833ms, sequenceid=21, compaction requested=true 2023-03-06 11:55:05,490 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6dad7421b77af3fd70e66df0531fef4f: 2023-03-06 11:55:05,490 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f. 2023-03-06 11:55:05,490 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-06 11:55:05,490 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-06 11:55:05,490 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:05,490 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-06 11:55:05,490 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-06 11:55:05,497 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:05,497 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:05,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:05,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:05,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:05,497 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:05,497 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:55:05,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:05,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:05,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:05,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:05,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:05,499 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-06 11:55:05,499 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7343974[Count = 0] remaining members to acquire global barrier 2023-03-06 11:55:05,499 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-06 11:55:05,499 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:05,501 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:05,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:05,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:05,501 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-06 11:55:05,501 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:05,501 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:55:05,501 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-06 11:55:05,501 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:55:05,502 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:05,503 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-06 11:55:05,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:05,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:05,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:05,503 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:55:05,503 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-06 11:55:05,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:05,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:05,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:05,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:05,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:05,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:05,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:05,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:55:05,505 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-06 11:55:05,505 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-06 11:55:05,505 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:55:05,505 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:55:05,505 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:05,505 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:55:05,507 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:05,507 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:05,507 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:55:05,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:05,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:05,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:05,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:05,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:05,508 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:05,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:05,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:55:05,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:55:05,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:05,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:05,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:05,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:05,509 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:05,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:05,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:05,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:05,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:05,513 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:05,513 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:05,513 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:05,513 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:05,513 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:05,513 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:55:05,513 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:05,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:55:05,513 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:55:05,513 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-06 11:55:05,513 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:55:05,513 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:05,513 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:55:05,513 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-06 11:55:05,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:55:05,513 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-06 11:55:05,513 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:55:05,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:55:05,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:55:05,614 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:55:05,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:55:05,620 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:55:05,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-06 11:55:05,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:05,648 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-06 11:55:05,648 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:55:05,648 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-06 11:55:05,648 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-06 11:55:05,649 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:05,649 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:05,649 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-06 11:55:05,649 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x15b38911 to 127.0.0.1:62659 2023-03-06 11:55:05,649 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-06 11:55:05,650 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-06 11:55:05,650 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x124ef63c to 127.0.0.1:62659 2023-03-06 11:55:05,650 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-06 11:55:05,650 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-06 11:55:05,650 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x43c86c74 to 127.0.0.1:62659 2023-03-06 11:55:05,650 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-06 11:55:05,650 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:55:05,650 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:05,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:55:05,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:55:05,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:05,652 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:05,652 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:55:05,652 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:05,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:55:05,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:05,652 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:05,653 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:05,653 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-06 11:55:05,653 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:55:05,653 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-06 11:55:05,653 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-06 11:55:05,653 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:55:05,653 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f. 2023-03-06 11:55:05,653 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f. started... 2023-03-06 11:55:05,653 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6dad7421b77af3fd70e66df0531fef4f 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-06 11:55:05,676 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231ba30ff4385d84067a0c7c8e8437a0ffb to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231ba30ff4385d84067a0c7c8e8437a0ffb 2023-03-06 11:55:06,083 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/.tmp/family1/a4bb1480970e4e0baa6de556b00e38cd 2023-03-06 11:55:06,089 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/.tmp/family1/a4bb1480970e4e0baa6de556b00e38cd as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/a4bb1480970e4e0baa6de556b00e38cd 2023-03-06 11:55:06,094 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/a4bb1480970e4e0baa6de556b00e38cd, entries=1, sequenceid=25, filesize=5.0 K 2023-03-06 11:55:06,095 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6dad7421b77af3fd70e66df0531fef4f in 442ms, sequenceid=25, compaction requested=true 2023-03-06 11:55:06,095 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6dad7421b77af3fd70e66df0531fef4f: 2023-03-06 11:55:06,095 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f. 2023-03-06 11:55:06,095 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-06 11:55:06,095 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-06 11:55:06,095 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:06,096 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-06 11:55:06,096 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-06 11:55:06,099 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:06,099 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:06,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:06,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:06,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:06,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:06,099 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:06,099 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:55:06,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:06,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:06,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:06,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:06,101 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-06 11:55:06,101 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@28170881[Count = 0] remaining members to acquire global barrier 2023-03-06 11:55:06,101 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-06 11:55:06,101 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:06,104 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:06,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:06,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:06,104 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-06 11:55:06,104 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-06 11:55:06,104 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:55:06,104 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:06,104 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:55:06,105 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:06,106 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-06 11:55:06,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:06,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:06,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:06,106 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:55:06,106 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-06 11:55:06,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:06,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:06,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:06,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:06,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:06,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:06,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:06,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:55:06,109 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-06 11:55:06,109 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-06 11:55:06,109 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:55:06,109 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:55:06,109 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:06,109 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:55:06,111 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:06,111 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:06,111 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:55:06,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:06,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:06,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:06,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:06,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:06,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:06,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:55:06,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:55:06,112 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:06,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:06,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:06,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:06,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:06,113 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:06,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:06,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:06,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:06,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:06,116 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:06,116 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:55:06,116 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:06,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:55:06,116 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-06 11:55:06,116 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:55:06,116 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:55:06,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:55:06,116 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-06 11:55:06,116 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:55:06,116 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-06 11:55:06,117 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:55:06,116 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:06,117 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:06,117 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:06,117 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:06,117 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:06,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:55:06,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:55:06,157 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-06 11:55:06,217 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:55:06,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:55:06,221 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:55:06,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-06 11:55:06,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:06,223 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-06 11:55:06,223 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:55:06,223 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-06 11:55:06,223 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-06 11:55:06,223 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:06,223 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:06,225 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:55:06,225 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:06,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:55:06,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:55:06,225 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:06,225 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:55:06,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:06,226 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:06,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:55:06,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:06,226 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:06,226 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-06 11:55:06,226 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:06,226 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-06 11:55:06,226 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:55:06,226 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-06 11:55:06,227 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-06 11:55:06,227 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:55:06,227 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f. 2023-03-06 11:55:06,227 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f. started... 2023-03-06 11:55:06,227 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6dad7421b77af3fd70e66df0531fef4f 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-06 11:55:06,643 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601012ed76891cdec41239b29d8f74c0b19ec to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601012ed76891cdec41239b29d8f74c0b19ec 2023-03-06 11:55:07,048 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/.tmp/family1/0e78d17fb2d446d98109f60c7ff5df86 2023-03-06 11:55:07,053 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/.tmp/family1/0e78d17fb2d446d98109f60c7ff5df86 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/0e78d17fb2d446d98109f60c7ff5df86 2023-03-06 11:55:07,057 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/0e78d17fb2d446d98109f60c7ff5df86, entries=1, sequenceid=29, filesize=5.0 K 2023-03-06 11:55:07,057 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6dad7421b77af3fd70e66df0531fef4f in 830ms, sequenceid=29, compaction requested=true 2023-03-06 11:55:07,058 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6dad7421b77af3fd70e66df0531fef4f: 2023-03-06 11:55:07,058 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f. 2023-03-06 11:55:07,058 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-06 11:55:07,058 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-06 11:55:07,058 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:07,058 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-06 11:55:07,058 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-06 11:55:07,060 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:07,060 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:07,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:07,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:07,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:07,060 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:07,060 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:55:07,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:07,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:07,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:07,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:07,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:07,062 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-06 11:55:07,062 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@62b7ea93[Count = 0] remaining members to acquire global barrier 2023-03-06 11:55:07,062 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-06 11:55:07,062 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:07,063 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:07,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:07,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:07,063 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-06 11:55:07,063 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:07,063 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:55:07,063 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-06 11:55:07,063 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:55:07,064 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-06 11:55:07,064 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:07,064 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:55:07,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:07,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:07,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:07,064 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-06 11:55:07,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:07,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:07,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:07,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:07,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:07,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:07,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:07,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:55:07,066 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-06 11:55:07,066 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-06 11:55:07,066 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:55:07,066 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:55:07,066 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:07,066 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:55:07,071 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:07,071 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:07,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:07,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:07,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:07,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:07,072 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:55:07,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:07,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:07,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:55:07,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:55:07,072 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:07,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:07,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:07,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:07,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:07,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:07,073 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:07,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:07,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:07,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:07,075 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:07,075 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:55:07,075 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:07,075 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:07,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:55:07,075 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-06 11:55:07,075 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:55:07,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:55:07,075 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:55:07,075 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-06 11:55:07,075 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:55:07,075 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:07,075 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:07,076 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:07,076 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:07,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:55:07,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:55:07,076 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-06 11:55:07,076 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:55:07,176 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:55:07,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:55:07,180 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:55:07,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-06 11:55:07,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:07,182 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-06 11:55:07,182 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:55:07,182 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-06 11:55:07,182 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-06 11:55:07,182 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:07,183 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:07,184 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:07,184 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:55:07,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:55:07,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:55:07,184 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:07,184 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:55:07,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:07,184 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:07,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:55:07,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:07,185 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:07,185 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-06 11:55:07,185 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:07,185 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-06 11:55:07,185 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:55:07,185 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-06 11:55:07,185 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-06 11:55:07,185 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:55:07,185 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f. 2023-03-06 11:55:07,185 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f. started... 2023-03-06 11:55:07,185 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6dad7421b77af3fd70e66df0531fef4f 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-06 11:55:07,597 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103843da0ee4f024c5e88785ad5bd6a25ec to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103843da0ee4f024c5e88785ad5bd6a25ec 2023-03-06 11:55:08,003 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/.tmp/family1/72afaf047c6942abb2a9264bb1a40584 2023-03-06 11:55:08,007 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/.tmp/family1/72afaf047c6942abb2a9264bb1a40584 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/72afaf047c6942abb2a9264bb1a40584 2023-03-06 11:55:08,011 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/72afaf047c6942abb2a9264bb1a40584, entries=1, sequenceid=33, filesize=5.0 K 2023-03-06 11:55:08,012 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6dad7421b77af3fd70e66df0531fef4f in 827ms, sequenceid=33, compaction requested=true 2023-03-06 11:55:08,012 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6dad7421b77af3fd70e66df0531fef4f: 2023-03-06 11:55:08,012 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f. 2023-03-06 11:55:08,012 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-06 11:55:08,012 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-06 11:55:08,012 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:08,012 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-06 11:55:08,012 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-06 11:55:08,014 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:08,014 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:08,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:08,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:08,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:08,015 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:08,015 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:55:08,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:08,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:08,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:08,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:08,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:08,016 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-06 11:55:08,016 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@38267f6c[Count = 0] remaining members to acquire global barrier 2023-03-06 11:55:08,016 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-06 11:55:08,016 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:08,017 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:08,017 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:08,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:08,017 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-06 11:55:08,017 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:08,017 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:55:08,017 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-06 11:55:08,017 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:55:08,019 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:08,019 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-06 11:55:08,019 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:55:08,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:08,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:08,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:08,019 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-06 11:55:08,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:08,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:08,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:08,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:08,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:08,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:08,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:08,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:55:08,021 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-06 11:55:08,021 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-06 11:55:08,021 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:55:08,021 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:55:08,021 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:08,021 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:55:08,023 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:08,023 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:08,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:08,023 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:55:08,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:08,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:08,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:08,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:08,023 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:08,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:55:08,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:55:08,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:08,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:08,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:08,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:08,024 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:08,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:08,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:08,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:08,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:08,028 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:08,028 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:08,028 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:08,028 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:08,028 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:55:08,028 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:55:08,028 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:08,028 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:08,028 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:08,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:55:08,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:55:08,028 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:55:08,028 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-06 11:55:08,028 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:55:08,028 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-06 11:55:08,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:55:08,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:55:08,028 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-06 11:55:08,029 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:55:08,129 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:55:08,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:55:08,134 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:55:08,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-06 11:55:08,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:08,135 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-06 11:55:08,135 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:55:08,135 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-06 11:55:08,135 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-06 11:55:08,136 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:08,136 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:08,137 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:55:08,137 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:08,137 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:55:08,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:55:08,137 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:08,137 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:55:08,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:08,138 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:08,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:55:08,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:08,138 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:08,138 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-06 11:55:08,138 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:08,138 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-06 11:55:08,138 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:55:08,138 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-06 11:55:08,139 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-06 11:55:08,139 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:55:08,139 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f. 2023-03-06 11:55:08,139 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f. started... 2023-03-06 11:55:08,139 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6dad7421b77af3fd70e66df0531fef4f 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-06 11:55:08,552 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907a7317529cea842208c3efaa731fb05f3 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20150907a7317529cea842208c3efaa731fb05f3 2023-03-06 11:55:08,558 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/.tmp/family1/623109e7b7f74e7abaa30752d661de36 2023-03-06 11:55:08,562 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/.tmp/family1/623109e7b7f74e7abaa30752d661de36 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/623109e7b7f74e7abaa30752d661de36 2023-03-06 11:55:08,566 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/623109e7b7f74e7abaa30752d661de36, entries=1, sequenceid=37, filesize=5.0 K 2023-03-06 11:55:08,567 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6dad7421b77af3fd70e66df0531fef4f in 428ms, sequenceid=37, compaction requested=true 2023-03-06 11:55:08,567 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6dad7421b77af3fd70e66df0531fef4f: 2023-03-06 11:55:08,567 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f. 2023-03-06 11:55:08,567 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-06 11:55:08,567 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-06 11:55:08,567 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:08,567 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-06 11:55:08,567 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-06 11:55:08,569 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:08,569 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:08,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:08,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:08,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:08,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:08,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:08,570 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:08,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:08,570 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:55:08,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:08,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:08,571 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-06 11:55:08,571 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e7f0e85[Count = 0] remaining members to acquire global barrier 2023-03-06 11:55:08,571 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-06 11:55:08,571 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:08,572 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:08,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:08,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:08,572 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-06 11:55:08,572 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-06 11:55:08,572 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:08,572 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:55:08,572 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:55:08,574 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:08,574 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-06 11:55:08,575 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:55:08,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:08,575 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-06 11:55:08,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:08,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:08,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:08,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:08,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:08,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:08,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:08,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:08,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:08,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:55:08,577 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-06 11:55:08,577 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-06 11:55:08,577 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:55:08,577 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:55:08,577 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:08,577 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:55:08,578 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:08,578 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:08,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:08,578 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:08,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:08,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:08,578 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:55:08,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:08,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:08,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:55:08,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:55:08,579 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:08,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:08,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:08,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:08,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:08,580 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:08,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:08,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:08,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:08,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:08,585 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:08,585 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:55:08,585 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:08,585 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:55:08,585 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:55:08,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:55:08,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:55:08,585 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:08,585 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-06 11:55:08,585 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:08,585 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:55:08,585 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:08,585 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:08,585 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:08,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:55:08,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:55:08,586 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-06 11:55:08,586 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:55:08,686 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:55:08,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:55:08,690 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:55:08,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-06 11:55:08,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:08,692 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-06 11:55:08,692 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:55:08,692 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-06 11:55:08,692 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-06 11:55:08,692 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:08,692 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:08,695 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:55:08,695 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:08,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:55:08,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:55:08,695 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:08,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:08,695 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:55:08,696 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:08,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:55:08,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:08,696 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:08,696 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-06 11:55:08,696 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:08,696 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-06 11:55:08,696 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:55:08,696 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-06 11:55:08,697 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-06 11:55:08,697 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:55:08,697 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f. 2023-03-06 11:55:08,697 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f. started... 2023-03-06 11:55:08,697 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6dad7421b77af3fd70e66df0531fef4f 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-06 11:55:09,108 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511203e5e772731da4ad29e2ab367063ee0be to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511203e5e772731da4ad29e2ab367063ee0be 2023-03-06 11:55:09,514 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/.tmp/family1/3805366e986d40c0b8ec0a2c97c201ce 2023-03-06 11:55:09,519 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/.tmp/family1/3805366e986d40c0b8ec0a2c97c201ce as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/3805366e986d40c0b8ec0a2c97c201ce 2023-03-06 11:55:09,523 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/3805366e986d40c0b8ec0a2c97c201ce, entries=1, sequenceid=41, filesize=5.0 K 2023-03-06 11:55:09,524 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6dad7421b77af3fd70e66df0531fef4f in 827ms, sequenceid=41, compaction requested=true 2023-03-06 11:55:09,524 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6dad7421b77af3fd70e66df0531fef4f: 2023-03-06 11:55:09,524 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f. 2023-03-06 11:55:09,524 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-06 11:55:09,524 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-06 11:55:09,524 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:09,524 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-06 11:55:09,524 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-06 11:55:09,525 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:09,525 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:09,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:09,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:09,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:09,526 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:09,526 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:55:09,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:09,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:09,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:09,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:09,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:09,527 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-06 11:55:09,527 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@ebc5ecb[Count = 0] remaining members to acquire global barrier 2023-03-06 11:55:09,527 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-06 11:55:09,527 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:09,528 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:09,528 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:09,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:09,528 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-06 11:55:09,528 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-06 11:55:09,528 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:55:09,529 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:09,529 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:55:09,530 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:09,530 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-06 11:55:09,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:09,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:09,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:09,530 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:55:09,530 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-06 11:55:09,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:09,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:09,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:09,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:09,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:09,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:09,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:09,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:55:09,532 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-06 11:55:09,532 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-06 11:55:09,532 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:55:09,532 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:55:09,532 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:09,532 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:55:09,535 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:09,535 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:09,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:09,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:09,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:09,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:09,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:09,535 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:55:09,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:09,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:55:09,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:55:09,536 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:09,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:09,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:09,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:09,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:09,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:09,537 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:09,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:09,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:09,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:09,539 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:09,539 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:55:09,539 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:09,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:55:09,539 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-06 11:55:09,540 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:55:09,539 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:09,539 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:55:09,540 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:09,540 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-06 11:55:09,540 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:55:09,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:55:09,540 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:09,540 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:09,540 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:09,540 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-06 11:55:09,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:55:09,540 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:55:09,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:55:09,640 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:55:09,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:55:09,642 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=36301] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:09,644 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-06 11:55:09,645 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-06 11:55:09,645 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-06 11:55:09,645 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=42, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678104309645 2023-03-06 11:55:09,646 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-06 11:55:09,647 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-03-06 11:55:09,647 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-06 11:55:09,648 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] zookeeper.ReadOnlyZKClient(139): Connect 0x7b445c68 to 127.0.0.1:62659 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-06 11:55:09,652 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4da71179, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-06 11:55:09,652 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-06 11:55:10,489 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103d99e98e5986542cbab72d99628a6c1b1 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103d99e98e5986542cbab72d99628a6c1b1 2023-03-06 11:55:10,490 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-06 11:55:10,502 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-06 11:55:10,503 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:38886, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-06 11:55:10,509 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-06 11:55:10,511 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:42888, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-06 11:55:10,527 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/26cc717a761d407d87c1c1d89baf97d2 first=Optional[r3] last=Optional[r6] 2023-03-06 11:55:10,527 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f., hostname=jenkins-hbase5.apache.org,42547,1678103642479, seqNum=2 for row with hfile group [{family1,hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/26cc717a761d407d87c1c1d89baf97d2}] 2023-03-06 11:55:10,532 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(763): Validating hfile at hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/26cc717a761d407d87c1c1d89baf97d2 for inclusion in 6dad7421b77af3fd70e66df0531fef4f/family1 2023-03-06 11:55:10,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-03-06 11:55:10,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(777): Region bounds: first= last= 2023-03-06 11:55:10,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegion(2446): Flush status journal for 6dad7421b77af3fd70e66df0531fef4f: 2023-03-06 11:55:10,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/26cc717a761d407d87c1c1d89baf97d2 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__nvd83536hulg9v47ksm8955fr6vbn4ugtkiiiphddi236kceb6j7hv1l26sp9g4l/family1/26cc717a761d407d87c1c1d89baf97d2 2023-03-06 11:55:10,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__nvd83536hulg9v47ksm8955fr6vbn4ugtkiiiphddi236kceb6j7hv1l26sp9g4l/family1/26cc717a761d407d87c1c1d89baf97d2 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/e7e5406dad0a4a50916e12b710f8ff4f_SeqId_44_ 2023-03-06 11:55:10,539 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(849): Loaded HFile hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__nvd83536hulg9v47ksm8955fr6vbn4ugtkiiiphddi236kceb6j7hv1l26sp9g4l/family1/26cc717a761d407d87c1c1d89baf97d2 into 6dad7421b77af3fd70e66df0531fef4f/family1 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/e7e5406dad0a4a50916e12b710f8ff4f_SeqId_44_ - updating store file list. 2023-03-06 11:55:10,542 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(882): Loaded HFile hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/e7e5406dad0a4a50916e12b710f8ff4f_SeqId_44_ into 6dad7421b77af3fd70e66df0531fef4f/family1 2023-03-06 11:55:10,542 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(855): Successfully loaded hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__nvd83536hulg9v47ksm8955fr6vbn4ugtkiiiphddi236kceb6j7hv1l26sp9g4l/family1/26cc717a761d407d87c1c1d89baf97d2 into 6dad7421b77af3fd70e66df0531fef4f/family1 (new location: hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/e7e5406dad0a4a50916e12b710f8ff4f_SeqId_44_) 2023-03-06 11:55:10,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__nvd83536hulg9v47ksm8955fr6vbn4ugtkiiiphddi236kceb6j7hv1l26sp9g4l/family1/26cc717a761d407d87c1c1d89baf97d2 2023-03-06 11:55:10,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-06 11:55:10,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51565 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-06 11:55:10,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(1912): 6dad7421b77af3fd70e66df0531fef4f/family1 is initiating minor compaction 2023-03-06 11:55:10,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@3dcd2fb3; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-06 11:55:10,546 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 6dad7421b77af3fd70e66df0531fef4f/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f. 2023-03-06 11:55:10,546 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/ae1d7ce8f08f4289a7aca2f8998e6057, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/30aa1eec20934f1bb4bb95fff7986c0a, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/41a9886d5a2e486c8a58491cc8a4a1c0, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/086a13cea170409bba2b66da6fdc6fa2, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/a4bb1480970e4e0baa6de556b00e38cd, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/0e78d17fb2d446d98109f60c7ff5df86, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/72afaf047c6942abb2a9264bb1a40584, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/623109e7b7f74e7abaa30752d661de36, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/3805366e986d40c0b8ec0a2c97c201ce, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/e7e5406dad0a4a50916e12b710f8ff4f_SeqId_44_] into tmpdir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/.tmp, totalSize=50.4 K 2023-03-06 11:55:10,546 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting ae1d7ce8f08f4289a7aca2f8998e6057, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-06 11:55:10,546 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting 30aa1eec20934f1bb4bb95fff7986c0a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-06 11:55:10,546 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting 41a9886d5a2e486c8a58491cc8a4a1c0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-06 11:55:10,547 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting 086a13cea170409bba2b66da6fdc6fa2, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-06 11:55:10,547 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting a4bb1480970e4e0baa6de556b00e38cd, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-06 11:55:10,547 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting 0e78d17fb2d446d98109f60c7ff5df86, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-06 11:55:10,547 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting 72afaf047c6942abb2a9264bb1a40584, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-06 11:55:10,547 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting 623109e7b7f74e7abaa30752d661de36, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-06 11:55:10,547 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting 3805366e986d40c0b8ec0a2c97c201ce, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-06 11:55:10,547 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting e7e5406dad0a4a50916e12b710f8ff4f_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-06 11:55:10,548 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-06 11:55:10,549 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:55:10,550 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512282a9dc896620c4c64ba452042f77b0acb to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512282a9dc896620c4c64ba452042f77b0acb 2023-03-06 11:55:10,551 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231ba30ff4385d84067a0c7c8e8437a0ffb to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231ba30ff4385d84067a0c7c8e8437a0ffb 2023-03-06 11:55:10,553 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601012ed76891cdec41239b29d8f74c0b19ec to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601012ed76891cdec41239b29d8f74c0b19ec 2023-03-06 11:55:10,554 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103843da0ee4f024c5e88785ad5bd6a25ec to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103843da0ee4f024c5e88785ad5bd6a25ec 2023-03-06 11:55:10,554 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 4 expired mob files are deleted 2023-03-06 11:55:10,554 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-03-06 11:55:10,554 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-06 11:55:10,554 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-06 11:55:10,554 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-06 11:55:10,554 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-06 11:55:10,555 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-06 11:55:10,555 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-06 11:55:10,555 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-06 11:55:10,555 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-06 11:55:10,580 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] throttle.PressureAwareThroughputController(145): 6dad7421b77af3fd70e66df0531fef4f#family1#compaction#60 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-06 11:55:11,401 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/.tmp/family1/e88972b4005348a2ab71d97c60d98990 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/e88972b4005348a2ab71d97c60d98990 2023-03-06 11:55:11,407 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 6dad7421b77af3fd70e66df0531fef4f/family1 of 6dad7421b77af3fd70e66df0531fef4f into e88972b4005348a2ab71d97c60d98990(size=6.8 K), total size for store is 198.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-06 11:55:11,407 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 6dad7421b77af3fd70e66df0531fef4f: 2023-03-06 11:55:11,407 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f., storeName=family1, fileCount=10, fileSize=50.4 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1678103710546; duration=0sec 2023-03-06 11:55:11,407 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-06 11:55:11,408 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205a966c60635c3481eb4cab5f70d44116f to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205a966c60635c3481eb4cab5f70d44116f 2023-03-06 11:55:11,409 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-06 11:55:11,434 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/6ff5bf242de14ac981ae47e4f9dcd5be first=Optional[r00] last=Optional[r2] 2023-03-06 11:55:11,434 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f., hostname=jenkins-hbase5.apache.org,42547,1678103642479, seqNum=2 for row with hfile group [{family1,hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/6ff5bf242de14ac981ae47e4f9dcd5be}] 2023-03-06 11:55:11,437 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(763): Validating hfile at hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/6ff5bf242de14ac981ae47e4f9dcd5be for inclusion in 6dad7421b77af3fd70e66df0531fef4f/family1 2023-03-06 11:55:11,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-03-06 11:55:11,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(777): Region bounds: first= last= 2023-03-06 11:55:11,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegion(2446): Flush status journal for 6dad7421b77af3fd70e66df0531fef4f: 2023-03-06 11:55:11,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/6ff5bf242de14ac981ae47e4f9dcd5be to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__54sbl3vrb16anmuc3g82vr19fq0qlaff8jcsgbkq6rjh9qob0gt62btvj4lo4jo4/family1/6ff5bf242de14ac981ae47e4f9dcd5be 2023-03-06 11:55:11,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__54sbl3vrb16anmuc3g82vr19fq0qlaff8jcsgbkq6rjh9qob0gt62btvj4lo4jo4/family1/6ff5bf242de14ac981ae47e4f9dcd5be as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/ef13bf55926548b3b1d5121daa20921b_SeqId_47_ 2023-03-06 11:55:11,444 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(849): Loaded HFile hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__54sbl3vrb16anmuc3g82vr19fq0qlaff8jcsgbkq6rjh9qob0gt62btvj4lo4jo4/family1/6ff5bf242de14ac981ae47e4f9dcd5be into 6dad7421b77af3fd70e66df0531fef4f/family1 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/ef13bf55926548b3b1d5121daa20921b_SeqId_47_ - updating store file list. 2023-03-06 11:55:11,448 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(882): Loaded HFile hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/ef13bf55926548b3b1d5121daa20921b_SeqId_47_ into 6dad7421b77af3fd70e66df0531fef4f/family1 2023-03-06 11:55:11,448 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(855): Successfully loaded hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__54sbl3vrb16anmuc3g82vr19fq0qlaff8jcsgbkq6rjh9qob0gt62btvj4lo4jo4/family1/6ff5bf242de14ac981ae47e4f9dcd5be into 6dad7421b77af3fd70e66df0531fef4f/family1 (new location: hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/ef13bf55926548b3b1d5121daa20921b_SeqId_47_) 2023-03-06 11:55:11,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__54sbl3vrb16anmuc3g82vr19fq0qlaff8jcsgbkq6rjh9qob0gt62btvj4lo4jo4/family1/6ff5bf242de14ac981ae47e4f9dcd5be 2023-03-06 11:55:11,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-06 11:55:11,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 399433 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-06 11:55:11,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(1912): 6dad7421b77af3fd70e66df0531fef4f/family1 is initiating minor compaction (all files) 2023-03-06 11:55:11,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7391dca4; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-06 11:55:11,449 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 6dad7421b77af3fd70e66df0531fef4f/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f. 2023-03-06 11:55:11,450 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/7f5aad7eebbc4bcf9a772d951e1fdd8e, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/e88972b4005348a2ab71d97c60d98990, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/ef13bf55926548b3b1d5121daa20921b_SeqId_47_] into tmpdir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/.tmp, totalSize=390.1 K 2023-03-06 11:55:11,450 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting 7f5aad7eebbc4bcf9a772d951e1fdd8e, keycount=1000, bloomtype=ROW, size=191.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878806372 2023-03-06 11:55:11,450 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting e88972b4005348a2ab71d97c60d98990, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621206372 2023-03-06 11:55:11,451 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting ef13bf55926548b3b1d5121daa20921b_SeqId_47_, keycount=1002, bloomtype=ROW, size=191.8 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878806372 2023-03-06 11:55:11,451 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-06 11:55:11,452 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:55:11,454 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511305e284abf72354cdda2bd14c69c8b48cc to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511305e284abf72354cdda2bd14c69c8b48cc 2023-03-06 11:55:11,455 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201bc3d4bb1bfd1457b84ec638772eb9b14 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201bc3d4bb1bfd1457b84ec638772eb9b14 2023-03-06 11:55:11,457 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512053915d5bcf55b4041baf626919bb9c00e to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512053915d5bcf55b4041baf626919bb9c00e 2023-03-06 11:55:11,457 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 3 expired mob files are deleted 2023-03-06 11:55:11,457 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-03-06 11:55:11,457 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-06 11:55:11,457 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-06 11:55:11,457 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-06 11:55:11,459 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=42, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-06 11:55:11,460 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 1.8160 sec 2023-03-06 11:55:11,468 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] throttle.PressureAwareThroughputController(145): 6dad7421b77af3fd70e66df0531fef4f#family1#compaction#61 average throughput is 22.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-06 11:55:11,519 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/ae1d7ce8f08f4289a7aca2f8998e6057, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/30aa1eec20934f1bb4bb95fff7986c0a, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/41a9886d5a2e486c8a58491cc8a4a1c0, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/086a13cea170409bba2b66da6fdc6fa2, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/a4bb1480970e4e0baa6de556b00e38cd, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/0e78d17fb2d446d98109f60c7ff5df86, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/72afaf047c6942abb2a9264bb1a40584, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/623109e7b7f74e7abaa30752d661de36, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/3805366e986d40c0b8ec0a2c97c201ce, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/e7e5406dad0a4a50916e12b710f8ff4f_SeqId_44_] to archive 2023-03-06 11:55:11,520 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:55:11,522 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/ae1d7ce8f08f4289a7aca2f8998e6057 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/ae1d7ce8f08f4289a7aca2f8998e6057 2023-03-06 11:55:11,524 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/30aa1eec20934f1bb4bb95fff7986c0a to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/30aa1eec20934f1bb4bb95fff7986c0a 2023-03-06 11:55:11,525 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/41a9886d5a2e486c8a58491cc8a4a1c0 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/41a9886d5a2e486c8a58491cc8a4a1c0 2023-03-06 11:55:11,527 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/086a13cea170409bba2b66da6fdc6fa2 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/086a13cea170409bba2b66da6fdc6fa2 2023-03-06 11:55:11,529 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/a4bb1480970e4e0baa6de556b00e38cd to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/a4bb1480970e4e0baa6de556b00e38cd 2023-03-06 11:55:11,534 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/0e78d17fb2d446d98109f60c7ff5df86 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/0e78d17fb2d446d98109f60c7ff5df86 2023-03-06 11:55:11,537 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/72afaf047c6942abb2a9264bb1a40584 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/72afaf047c6942abb2a9264bb1a40584 2023-03-06 11:55:11,539 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/623109e7b7f74e7abaa30752d661de36 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/623109e7b7f74e7abaa30752d661de36 2023-03-06 11:55:11,540 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/3805366e986d40c0b8ec0a2c97c201ce to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/3805366e986d40c0b8ec0a2c97c201ce 2023-03-06 11:55:11,542 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/e7e5406dad0a4a50916e12b710f8ff4f_SeqId_44_ to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/e7e5406dad0a4a50916e12b710f8ff4f_SeqId_44_ 2023-03-06 11:55:11,556 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.HMaster$12(2454): Client=jenkins//172.31.10.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-03-06 11:55:11,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure2.ProcedureExecutor(1029): Stored pid=43, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:11,894 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/.tmp/family1/473fcbb229164e3ba52e2736a79d08fa as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/473fcbb229164e3ba52e2736a79d08fa 2023-03-06 11:55:11,903 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 6dad7421b77af3fd70e66df0531fef4f/family1 of 6dad7421b77af3fd70e66df0531fef4f into 473fcbb229164e3ba52e2736a79d08fa(size=193.0 K), total size for store is 193.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-06 11:55:11,903 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 6dad7421b77af3fd70e66df0531fef4f: 2023-03-06 11:55:11,903 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f., storeName=family1, fileCount=3, fileSize=390.1 K (191.4 K, 6.8 K, 191.8 K), priority=2, time=1678103711449; duration=0sec 2023-03-06 11:55:11,903 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-06 11:55:11,906 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/7f5aad7eebbc4bcf9a772d951e1fdd8e, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/e88972b4005348a2ab71d97c60d98990, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/ef13bf55926548b3b1d5121daa20921b_SeqId_47_] to archive 2023-03-06 11:55:11,907 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:55:11,909 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/7f5aad7eebbc4bcf9a772d951e1fdd8e to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/7f5aad7eebbc4bcf9a772d951e1fdd8e 2023-03-06 11:55:11,910 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/e88972b4005348a2ab71d97c60d98990 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/e88972b4005348a2ab71d97c60d98990 2023-03-06 11:55:11,912 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/ef13bf55926548b3b1d5121daa20921b_SeqId_47_ to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/ef13bf55926548b3b1d5121daa20921b_SeqId_47_ 2023-03-06 11:55:11,972 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-03-06 11:55:11,973 DEBUG [PEWorker-2] util.FSTableDescriptors(519): Deleted hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-03-06 11:55:11,973 INFO [PEWorker-2] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-03-06 11:55:11,975 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-03-06 11:55:11,977 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=6dad7421b77af3fd70e66df0531fef4f, REOPEN/MOVE}] 2023-03-06 11:55:11,978 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=6dad7421b77af3fd70e66df0531fef4f, REOPEN/MOVE 2023-03-06 11:55:11,979 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=6dad7421b77af3fd70e66df0531fef4f, regionState=CLOSING, regionLocation=jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:11,979 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1678103711979"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678103711979"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678103711979"}]},"ts":"1678103711979"} 2023-03-06 11:55:11,980 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=45, state=RUNNABLE; CloseRegionProcedure 6dad7421b77af3fd70e66df0531fef4f, server=jenkins-hbase5.apache.org,42547,1678103642479}] 2023-03-06 11:55:12,132 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(109): Close 6dad7421b77af3fd70e66df0531fef4f 2023-03-06 11:55:12,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 6dad7421b77af3fd70e66df0531fef4f, disabling compactions & flushes 2023-03-06 11:55:12,132 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f. 2023-03-06 11:55:12,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f. 2023-03-06 11:55:12,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f. after waiting 0 ms 2023-03-06 11:55:12,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f. 2023-03-06 11:55:12,137 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-03-06 11:55:12,138 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f. 2023-03-06 11:55:12,138 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 6dad7421b77af3fd70e66df0531fef4f: 2023-03-06 11:55:12,138 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 6dad7421b77af3fd70e66df0531fef4f to self. 2023-03-06 11:55:12,139 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(147): Closed 6dad7421b77af3fd70e66df0531fef4f 2023-03-06 11:55:12,139 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=6dad7421b77af3fd70e66df0531fef4f, regionState=CLOSED 2023-03-06 11:55:12,140 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1678103712139"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678103712139"}]},"ts":"1678103712139"} 2023-03-06 11:55:12,142 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=45 2023-03-06 11:55:12,142 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=45, state=SUCCESS; CloseRegionProcedure 6dad7421b77af3fd70e66df0531fef4f, server=jenkins-hbase5.apache.org,42547,1678103642479 in 161 msec 2023-03-06 11:55:12,142 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=6dad7421b77af3fd70e66df0531fef4f, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase5.apache.org,42547,1678103642479; forceNewPlan=false, retain=true 2023-03-06 11:55:12,293 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=6dad7421b77af3fd70e66df0531fef4f, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:12,293 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1678103712293"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678103712293"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678103712293"}]},"ts":"1678103712293"} 2023-03-06 11:55:12,295 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=45, state=RUNNABLE; OpenRegionProcedure 6dad7421b77af3fd70e66df0531fef4f, server=jenkins-hbase5.apache.org,42547,1678103642479}] 2023-03-06 11:55:12,449 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f. 2023-03-06 11:55:12,449 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6dad7421b77af3fd70e66df0531fef4f, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f.', STARTKEY => '', ENDKEY => ''} 2023-03-06 11:55:12,450 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 6dad7421b77af3fd70e66df0531fef4f 2023-03-06 11:55:12,450 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-06 11:55:12,450 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 6dad7421b77af3fd70e66df0531fef4f 2023-03-06 11:55:12,450 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 6dad7421b77af3fd70e66df0531fef4f 2023-03-06 11:55:12,452 INFO [StoreOpener-6dad7421b77af3fd70e66df0531fef4f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 6dad7421b77af3fd70e66df0531fef4f 2023-03-06 11:55:12,453 DEBUG [StoreOpener-6dad7421b77af3fd70e66df0531fef4f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1 2023-03-06 11:55:12,453 DEBUG [StoreOpener-6dad7421b77af3fd70e66df0531fef4f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1 2023-03-06 11:55:12,454 INFO [StoreOpener-6dad7421b77af3fd70e66df0531fef4f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6dad7421b77af3fd70e66df0531fef4f columnFamilyName family1 2023-03-06 11:55:12,459 DEBUG [StoreOpener-6dad7421b77af3fd70e66df0531fef4f-1] regionserver.HStore(539): loaded hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/473fcbb229164e3ba52e2736a79d08fa 2023-03-06 11:55:12,460 INFO [StoreOpener-6dad7421b77af3fd70e66df0531fef4f-1] regionserver.HStore(310): Store=6dad7421b77af3fd70e66df0531fef4f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-06 11:55:12,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f 2023-03-06 11:55:12,462 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f 2023-03-06 11:55:12,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 6dad7421b77af3fd70e66df0531fef4f 2023-03-06 11:55:12,467 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 6dad7421b77af3fd70e66df0531fef4f; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68637250, jitterRate=0.022774726152420044}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-06 11:55:12,468 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 6dad7421b77af3fd70e66df0531fef4f: 2023-03-06 11:55:12,468 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f., pid=47, masterSystemTime=1678103712446 2023-03-06 11:55:12,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f. 2023-03-06 11:55:12,470 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f. 2023-03-06 11:55:12,470 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=6dad7421b77af3fd70e66df0531fef4f, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:12,470 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1678103712470"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678103712470"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678103712470"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678103712470"}]},"ts":"1678103712470"} 2023-03-06 11:55:12,473 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=45 2023-03-06 11:55:12,474 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=45, state=SUCCESS; OpenRegionProcedure 6dad7421b77af3fd70e66df0531fef4f, server=jenkins-hbase5.apache.org,42547,1678103642479 in 177 msec 2023-03-06 11:55:12,475 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-03-06 11:55:12,475 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=6dad7421b77af3fd70e66df0531fef4f, REOPEN/MOVE in 497 msec 2023-03-06 11:55:12,478 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=43 2023-03-06 11:55:12,478 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=43, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 501 msec 2023-03-06 11:55:12,479 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=43, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 922 msec 2023-03-06 11:55:12,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=43 2023-03-06 11:55:12,482 INFO [Listener at localhost/46717] compactions.TestMobCompactor(278): alter status finished 2023-03-06 11:55:12,482 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=36301] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:12,484 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-06 11:55:12,484 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-06 11:55:12,485 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-06 11:55:12,485 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678104312485 2023-03-06 11:55:12,486 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-06 11:55:12,486 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-03-06 11:55:12,486 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-06 11:55:12,487 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] zookeeper.ReadOnlyZKClient(139): Connect 0x35e3afca to 127.0.0.1:62659 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-06 11:55:12,495 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@403a4cd6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-06 11:55:12,495 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-06 11:55:12,495 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-06 11:55:12,495 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-06 11:55:12,495 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-06 11:55:12,495 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-06 11:55:13,327 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511282ebc1ad714c34f55b7eaec7bd8babecc to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511282ebc1ad714c34f55b7eaec7bd8babecc 2023-03-06 11:55:13,328 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-06 11:55:13,343 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-06 11:55:13,344 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:38892, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-06 11:55:13,350 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-06 11:55:13,352 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:42904, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-06 11:55:13,367 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/26e426c4f34d42fda56f227e820ed8b1 first=Optional[r05] last=Optional[r8] 2023-03-06 11:55:13,368 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f., hostname=jenkins-hbase5.apache.org,42547,1678103642479, seqNum=51 for row with hfile group [{family1,hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/26e426c4f34d42fda56f227e820ed8b1}] 2023-03-06 11:55:13,373 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(763): Validating hfile at hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/26e426c4f34d42fda56f227e820ed8b1 for inclusion in 6dad7421b77af3fd70e66df0531fef4f/family1 2023-03-06 11:55:13,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-03-06 11:55:13,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(777): Region bounds: first= last= 2023-03-06 11:55:13,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegion(2446): Flush status journal for 6dad7421b77af3fd70e66df0531fef4f: 2023-03-06 11:55:13,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/26e426c4f34d42fda56f227e820ed8b1 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__9edf60pgdut2cchnckeuq3at1339tv2v8ff6lnbc4728hqdpoplgl8lqe7s988d6/family1/26e426c4f34d42fda56f227e820ed8b1 2023-03-06 11:55:13,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__9edf60pgdut2cchnckeuq3at1339tv2v8ff6lnbc4728hqdpoplgl8lqe7s988d6/family1/26e426c4f34d42fda56f227e820ed8b1 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/a70f438bc93841df946b397047960b89_SeqId_53_ 2023-03-06 11:55:13,381 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(849): Loaded HFile hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__9edf60pgdut2cchnckeuq3at1339tv2v8ff6lnbc4728hqdpoplgl8lqe7s988d6/family1/26e426c4f34d42fda56f227e820ed8b1 into 6dad7421b77af3fd70e66df0531fef4f/family1 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/a70f438bc93841df946b397047960b89_SeqId_53_ - updating store file list. 2023-03-06 11:55:13,384 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(882): Loaded HFile hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/a70f438bc93841df946b397047960b89_SeqId_53_ into 6dad7421b77af3fd70e66df0531fef4f/family1 2023-03-06 11:55:13,384 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(855): Successfully loaded hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__9edf60pgdut2cchnckeuq3at1339tv2v8ff6lnbc4728hqdpoplgl8lqe7s988d6/family1/26e426c4f34d42fda56f227e820ed8b1 into 6dad7421b77af3fd70e66df0531fef4f/family1 (new location: hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/a70f438bc93841df946b397047960b89_SeqId_53_) 2023-03-06 11:55:13,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__9edf60pgdut2cchnckeuq3at1339tv2v8ff6lnbc4728hqdpoplgl8lqe7s988d6/family1/26e426c4f34d42fda56f227e820ed8b1 2023-03-06 11:55:13,387 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-06 11:55:13,387 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:55:13,389 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511203e5e772731da4ad29e2ab367063ee0be to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511203e5e772731da4ad29e2ab367063ee0be 2023-03-06 11:55:13,390 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128138cc7b2cde2438b8e4db6207958b8c2 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128138cc7b2cde2438b8e4db6207958b8c2 2023-03-06 11:55:13,390 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2 expired mob files are deleted 2023-03-06 11:55:13,390 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-03-06 11:55:13,390 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-06 11:55:13,391 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-06 11:55:13,391 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-06 11:55:13,391 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-06 11:55:13,391 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-06 11:55:13,392 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-06 11:55:13,393 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 909 msec 2023-03-06 11:55:13,447 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.HMaster$12(2454): Client=jenkins//172.31.10.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-06 11:55:13,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:13,856 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-03-06 11:55:13,858 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-03-06 11:55:13,858 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-03-06 11:55:13,860 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=49, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-03-06 11:55:13,863 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=6dad7421b77af3fd70e66df0531fef4f, REOPEN/MOVE}] 2023-03-06 11:55:13,864 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=6dad7421b77af3fd70e66df0531fef4f, REOPEN/MOVE 2023-03-06 11:55:13,865 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=6dad7421b77af3fd70e66df0531fef4f, regionState=CLOSING, regionLocation=jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:13,865 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1678103713865"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678103713865"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678103713865"}]},"ts":"1678103713865"} 2023-03-06 11:55:13,867 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE; CloseRegionProcedure 6dad7421b77af3fd70e66df0531fef4f, server=jenkins-hbase5.apache.org,42547,1678103642479}] 2023-03-06 11:55:14,019 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(109): Close 6dad7421b77af3fd70e66df0531fef4f 2023-03-06 11:55:14,019 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 6dad7421b77af3fd70e66df0531fef4f, disabling compactions & flushes 2023-03-06 11:55:14,019 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f. 2023-03-06 11:55:14,019 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f. 2023-03-06 11:55:14,019 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f. after waiting 0 ms 2023-03-06 11:55:14,019 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f. 2023-03-06 11:55:14,025 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-03-06 11:55:14,026 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f. 2023-03-06 11:55:14,026 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 6dad7421b77af3fd70e66df0531fef4f: 2023-03-06 11:55:14,026 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 6dad7421b77af3fd70e66df0531fef4f to self. 2023-03-06 11:55:14,028 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(147): Closed 6dad7421b77af3fd70e66df0531fef4f 2023-03-06 11:55:14,028 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=6dad7421b77af3fd70e66df0531fef4f, regionState=CLOSED 2023-03-06 11:55:14,028 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1678103714028"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678103714028"}]},"ts":"1678103714028"} 2023-03-06 11:55:14,031 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-03-06 11:55:14,031 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; CloseRegionProcedure 6dad7421b77af3fd70e66df0531fef4f, server=jenkins-hbase5.apache.org,42547,1678103642479 in 162 msec 2023-03-06 11:55:14,031 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=6dad7421b77af3fd70e66df0531fef4f, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase5.apache.org,42547,1678103642479; forceNewPlan=false, retain=true 2023-03-06 11:55:14,182 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=6dad7421b77af3fd70e66df0531fef4f, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:14,182 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1678103714182"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678103714182"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678103714182"}]},"ts":"1678103714182"} 2023-03-06 11:55:14,183 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=51, state=RUNNABLE; OpenRegionProcedure 6dad7421b77af3fd70e66df0531fef4f, server=jenkins-hbase5.apache.org,42547,1678103642479}] 2023-03-06 11:55:14,338 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f. 2023-03-06 11:55:14,338 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6dad7421b77af3fd70e66df0531fef4f, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f.', STARTKEY => '', ENDKEY => ''} 2023-03-06 11:55:14,338 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 6dad7421b77af3fd70e66df0531fef4f 2023-03-06 11:55:14,338 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-06 11:55:14,339 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 6dad7421b77af3fd70e66df0531fef4f 2023-03-06 11:55:14,339 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 6dad7421b77af3fd70e66df0531fef4f 2023-03-06 11:55:14,340 INFO [StoreOpener-6dad7421b77af3fd70e66df0531fef4f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 6dad7421b77af3fd70e66df0531fef4f 2023-03-06 11:55:14,341 DEBUG [StoreOpener-6dad7421b77af3fd70e66df0531fef4f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1 2023-03-06 11:55:14,341 DEBUG [StoreOpener-6dad7421b77af3fd70e66df0531fef4f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1 2023-03-06 11:55:14,341 INFO [StoreOpener-6dad7421b77af3fd70e66df0531fef4f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6dad7421b77af3fd70e66df0531fef4f columnFamilyName family1 2023-03-06 11:55:14,348 DEBUG [StoreOpener-6dad7421b77af3fd70e66df0531fef4f-1] regionserver.HStore(539): loaded hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/473fcbb229164e3ba52e2736a79d08fa 2023-03-06 11:55:14,351 DEBUG [StoreOpener-6dad7421b77af3fd70e66df0531fef4f-1] regionserver.HStore(539): loaded hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/family1/a70f438bc93841df946b397047960b89_SeqId_53_ 2023-03-06 11:55:14,351 INFO [StoreOpener-6dad7421b77af3fd70e66df0531fef4f-1] regionserver.HStore(310): Store=6dad7421b77af3fd70e66df0531fef4f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-06 11:55:14,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f 2023-03-06 11:55:14,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f 2023-03-06 11:55:14,356 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 6dad7421b77af3fd70e66df0531fef4f 2023-03-06 11:55:14,357 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 6dad7421b77af3fd70e66df0531fef4f; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69221889, jitterRate=0.031486526131629944}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-06 11:55:14,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 6dad7421b77af3fd70e66df0531fef4f: 2023-03-06 11:55:14,357 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f., pid=53, masterSystemTime=1678103714335 2023-03-06 11:55:14,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f. 2023-03-06 11:55:14,359 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f. 2023-03-06 11:55:14,359 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=6dad7421b77af3fd70e66df0531fef4f, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:14,359 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1678103714359"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678103714359"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678103714359"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678103714359"}]},"ts":"1678103714359"} 2023-03-06 11:55:14,362 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-03-06 11:55:14,362 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; OpenRegionProcedure 6dad7421b77af3fd70e66df0531fef4f, server=jenkins-hbase5.apache.org,42547,1678103642479 in 178 msec 2023-03-06 11:55:14,364 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=50 2023-03-06 11:55:14,364 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=50, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=6dad7421b77af3fd70e66df0531fef4f, REOPEN/MOVE in 499 msec 2023-03-06 11:55:14,370 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=49 2023-03-06 11:55:14,370 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=49, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 505 msec 2023-03-06 11:55:14,372 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 924 msec 2023-03-06 11:55:14,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=49 2023-03-06 11:55:14,374 INFO [Listener at localhost/46717] compactions.TestMobCompactor(278): alter status finished 2023-03-06 11:55:14,375 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=36301] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-06 11:55:14,377 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-06 11:55:14,378 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-06 11:55:14,378 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-06 11:55:14,378 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=54, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678104314378 2023-03-06 11:55:14,380 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-06 11:55:14,381 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-03-06 11:55:14,381 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-06 11:55:14,381 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] zookeeper.ReadOnlyZKClient(139): Connect 0x2e29745f to 127.0.0.1:62659 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-06 11:55:14,386 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3ce7c1b0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-06 11:55:14,386 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-06 11:55:14,386 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-06 11:55:14,386 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-06 11:55:14,386 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-06 11:55:14,386 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-06 11:55:14,386 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-06 11:55:14,386 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-06 11:55:14,386 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-06 11:55:14,386 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-06 11:55:14,386 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-06 11:55:14,388 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=54, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-06 11:55:14,389 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 12 msec 2023-03-06 11:55:14,447 INFO [Listener at localhost/46717] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=244 (was 257), OpenFileDescriptor=612 (was 634), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=244 (was 304), ProcessCount=160 (was 160), AvailableMemoryMB=9710 (was 9918) 2023-03-06 11:55:14,463 INFO [Listener at localhost/46717] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=243, OpenFileDescriptor=612, MaxFileDescriptor=60000, SystemLoadAverage=244, ProcessCount=160, AvailableMemoryMB=9708 2023-03-06 11:55:14,465 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.HMaster$4(2112): Client=jenkins//172.31.10.131 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-06 11:55:14,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure2.ProcedureExecutor(1029): Stored pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:14,469 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_PRE_OPERATION 2023-03-06 11:55:14,470 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-06 11:55:14,471 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(697): Client=jenkins//172.31.10.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily" procId is: 55 2023-03-06 11:55:14,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-03-06 11:55:14,477 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1 2023-03-06 11:55:14,478 DEBUG [HFileArchiver-10] backup.HFileArchiver(153): Directory hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1 empty. 2023-03-06 11:55:14,479 DEBUG [HFileArchiver-10] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1 2023-03-06 11:55:14,479 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily regions 2023-03-06 11:55:14,497 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-03-06 11:55:14,499 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1ea5b692133196fdda0700a7028a36a1, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp 2023-03-06 11:55:14,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-03-06 11:55:14,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-03-06 11:55:14,943 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-06 11:55:14,943 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1604): Closing 1ea5b692133196fdda0700a7028a36a1, disabling compactions & flushes 2023-03-06 11:55:14,943 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1. 2023-03-06 11:55:14,943 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1. 2023-03-06 11:55:14,943 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1. after waiting 0 ms 2023-03-06 11:55:14,943 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1. 2023-03-06 11:55:14,943 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1. 2023-03-06 11:55:14,943 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1558): Region close journal for 1ea5b692133196fdda0700a7028a36a1: 2023-03-06 11:55:14,945 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ADD_TO_META 2023-03-06 11:55:14,946 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1678103714946"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678103714946"}]},"ts":"1678103714946"} 2023-03-06 11:55:14,947 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-06 11:55:14,948 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-06 11:55:14,948 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678103714948"}]},"ts":"1678103714948"} 2023-03-06 11:55:14,949 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLING in hbase:meta 2023-03-06 11:55:14,951 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=1ea5b692133196fdda0700a7028a36a1, ASSIGN}] 2023-03-06 11:55:14,953 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=1ea5b692133196fdda0700a7028a36a1, ASSIGN 2023-03-06 11:55:14,953 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=1ea5b692133196fdda0700a7028a36a1, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,42547,1678103642479; forceNewPlan=false, retain=false 2023-03-06 11:55:15,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-03-06 11:55:15,104 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=1ea5b692133196fdda0700a7028a36a1, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:15,104 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1678103715104"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678103715104"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678103715104"}]},"ts":"1678103715104"} 2023-03-06 11:55:15,106 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=57, ppid=56, state=RUNNABLE; OpenRegionProcedure 1ea5b692133196fdda0700a7028a36a1, server=jenkins-hbase5.apache.org,42547,1678103642479}] 2023-03-06 11:55:15,262 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1. 2023-03-06 11:55:15,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1ea5b692133196fdda0700a7028a36a1, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1.', STARTKEY => '', ENDKEY => ''} 2023-03-06 11:55:15,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 1ea5b692133196fdda0700a7028a36a1 2023-03-06 11:55:15,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-06 11:55:15,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 1ea5b692133196fdda0700a7028a36a1 2023-03-06 11:55:15,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 1ea5b692133196fdda0700a7028a36a1 2023-03-06 11:55:15,264 INFO [StoreOpener-1ea5b692133196fdda0700a7028a36a1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 1ea5b692133196fdda0700a7028a36a1 2023-03-06 11:55:15,265 DEBUG [StoreOpener-1ea5b692133196fdda0700a7028a36a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1 2023-03-06 11:55:15,265 DEBUG [StoreOpener-1ea5b692133196fdda0700a7028a36a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1 2023-03-06 11:55:15,265 INFO [StoreOpener-1ea5b692133196fdda0700a7028a36a1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1ea5b692133196fdda0700a7028a36a1 columnFamilyName family1 2023-03-06 11:55:15,267 INFO [StoreOpener-1ea5b692133196fdda0700a7028a36a1-1] regionserver.HStore(310): Store=1ea5b692133196fdda0700a7028a36a1/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-06 11:55:15,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1 2023-03-06 11:55:15,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1 2023-03-06 11:55:15,270 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 1ea5b692133196fdda0700a7028a36a1 2023-03-06 11:55:15,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-06 11:55:15,273 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 1ea5b692133196fdda0700a7028a36a1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59450922, jitterRate=-0.11411222815513611}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-06 11:55:15,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 1ea5b692133196fdda0700a7028a36a1: 2023-03-06 11:55:15,274 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1., pid=57, masterSystemTime=1678103715258 2023-03-06 11:55:15,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1. 2023-03-06 11:55:15,275 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1. 2023-03-06 11:55:15,275 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=1ea5b692133196fdda0700a7028a36a1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:15,276 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1678103715275"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678103715275"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678103715275"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678103715275"}]},"ts":"1678103715275"} 2023-03-06 11:55:15,278 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=57, resume processing ppid=56 2023-03-06 11:55:15,278 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=57, ppid=56, state=SUCCESS; OpenRegionProcedure 1ea5b692133196fdda0700a7028a36a1, server=jenkins-hbase5.apache.org,42547,1678103642479 in 171 msec 2023-03-06 11:55:15,279 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=56, resume processing ppid=55 2023-03-06 11:55:15,279 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=56, ppid=55, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=1ea5b692133196fdda0700a7028a36a1, ASSIGN in 327 msec 2023-03-06 11:55:15,280 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-06 11:55:15,280 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678103715280"}]},"ts":"1678103715280"} 2023-03-06 11:55:15,281 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLED in hbase:meta 2023-03-06 11:55:15,284 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_POST_OPERATION 2023-03-06 11:55:15,285 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=55, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 819 msec 2023-03-06 11:55:15,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-03-06 11:55:15,577 INFO [Listener at localhost/46717] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, procId: 55 completed 2023-03-06 11:55:15,596 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:55:15,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:15,598 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-06 11:55:15,598 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:55:15,598 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-06 11:55:15,598 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-06 11:55:15,599 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:15,599 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:15,600 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:15,600 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:55:15,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:55:15,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:55:15,600 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:15,600 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:55:15,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:15,601 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:15,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:55:15,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:15,601 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:15,601 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:15,601 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-06 11:55:15,601 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:55:15,601 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-06 11:55:15,602 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-06 11:55:15,602 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:55:15,602 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1. 2023-03-06 11:55:15,602 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1. started... 2023-03-06 11:55:15,603 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1ea5b692133196fdda0700a7028a36a1 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-06 11:55:16,023 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511301029e690bf124d5794cc5fb7384d963f to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511301029e690bf124d5794cc5fb7384d963f 2023-03-06 11:55:16,153 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-06 11:55:16,428 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/.tmp/family1/a60901e5e15f4c83b08956f20bd8f9a3 2023-03-06 11:55:16,432 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/.tmp/family1/a60901e5e15f4c83b08956f20bd8f9a3 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/a60901e5e15f4c83b08956f20bd8f9a3 2023-03-06 11:55:16,435 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/a60901e5e15f4c83b08956f20bd8f9a3, entries=1000, sequenceid=5, filesize=190.5 K 2023-03-06 11:55:16,436 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 1ea5b692133196fdda0700a7028a36a1 in 834ms, sequenceid=5, compaction requested=false 2023-03-06 11:55:16,437 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1ea5b692133196fdda0700a7028a36a1: 2023-03-06 11:55:16,437 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1. 2023-03-06 11:55:16,437 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-06 11:55:16,437 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-06 11:55:16,437 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:16,437 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-06 11:55:16,437 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-06 11:55:16,438 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:16,439 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:16,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:16,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:16,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:16,439 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:16,439 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:55:16,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:16,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:16,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:16,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:16,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:16,440 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-06 11:55:16,440 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5302defd[Count = 0] remaining members to acquire global barrier 2023-03-06 11:55:16,440 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-06 11:55:16,440 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:16,443 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:16,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:16,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:16,443 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-06 11:55:16,443 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-06 11:55:16,443 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:55:16,443 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:16,443 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:55:16,444 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-06 11:55:16,444 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:16,444 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:55:16,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:16,444 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-06 11:55:16,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:16,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:16,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:16,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:16,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:16,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:16,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:16,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:16,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:16,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:55:16,447 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-06 11:55:16,447 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-06 11:55:16,447 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:55:16,447 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:55:16,447 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:16,447 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:55:16,448 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:16,448 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:16,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:16,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:16,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:16,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:16,448 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:55:16,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:16,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:16,449 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:16,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:55:16,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:55:16,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:16,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:16,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:16,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:16,450 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:16,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:16,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:16,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:16,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:16,455 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:16,455 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:55:16,455 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:16,455 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:55:16,455 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-06 11:55:16,455 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:55:16,455 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:55:16,455 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:16,455 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:55:16,456 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:16,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:55:16,456 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:16,456 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:16,456 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-06 11:55:16,456 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:55:16,456 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:16,456 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:55:16,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:55:16,556 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:55:16,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:55:16,561 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:55:16,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-06 11:55:16,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:16,562 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-06 11:55:16,562 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:55:16,562 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-06 11:55:16,562 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-06 11:55:16,563 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:16,563 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:16,564 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:55:16,564 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:16,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:55:16,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:55:16,564 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:16,564 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:55:16,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:16,565 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:16,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:55:16,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:16,565 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:16,565 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-06 11:55:16,565 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:16,565 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-06 11:55:16,565 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:55:16,565 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-06 11:55:16,566 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-06 11:55:16,566 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:55:16,566 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1. 2023-03-06 11:55:16,566 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1. started... 2023-03-06 11:55:16,566 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1ea5b692133196fdda0700a7028a36a1 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-06 11:55:16,977 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128706d4d376f2e4f06b20685810af25108 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128706d4d376f2e4f06b20685810af25108 2023-03-06 11:55:17,383 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/.tmp/family1/312dd6fb3b1b4158921dd768987dd481 2023-03-06 11:55:17,387 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/.tmp/family1/312dd6fb3b1b4158921dd768987dd481 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/312dd6fb3b1b4158921dd768987dd481 2023-03-06 11:55:17,390 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/312dd6fb3b1b4158921dd768987dd481, entries=1, sequenceid=9, filesize=5.0 K 2023-03-06 11:55:17,391 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 1ea5b692133196fdda0700a7028a36a1 in 825ms, sequenceid=9, compaction requested=false 2023-03-06 11:55:17,391 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1ea5b692133196fdda0700a7028a36a1: 2023-03-06 11:55:17,391 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1. 2023-03-06 11:55:17,391 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-06 11:55:17,391 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-06 11:55:17,391 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:17,391 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-06 11:55:17,391 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-06 11:55:17,393 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:17,393 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:17,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:17,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:17,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:17,393 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:17,393 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:55:17,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:17,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:17,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:17,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:17,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:17,394 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-06 11:55:17,394 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@585406ee[Count = 0] remaining members to acquire global barrier 2023-03-06 11:55:17,394 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-06 11:55:17,394 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:17,395 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:17,395 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:17,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:17,395 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-06 11:55:17,395 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-06 11:55:17,395 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:55:17,395 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:17,395 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:55:17,397 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-06 11:55:17,398 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:55:17,397 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:17,398 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-06 11:55:17,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:17,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:17,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:17,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:17,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:17,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:17,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:17,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:17,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:17,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:17,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:55:17,400 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-06 11:55:17,400 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-06 11:55:17,400 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:55:17,400 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:55:17,400 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:17,400 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:55:17,401 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:17,401 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:17,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:17,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:17,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:17,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:17,401 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:55:17,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:17,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:17,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:55:17,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:55:17,401 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:17,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:17,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:17,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:17,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:17,402 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:17,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:17,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:17,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:17,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:17,404 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:55:17,404 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:17,404 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:55:17,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:55:17,404 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:17,405 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:55:17,405 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-06 11:55:17,405 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-06 11:55:17,405 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:55:17,405 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:17,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:55:17,405 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:17,405 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:17,405 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:17,405 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:17,405 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-06 11:55:17,405 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:55:17,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:55:17,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:55:17,505 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:55:17,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:55:17,510 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:55:17,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-06 11:55:17,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:17,511 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-06 11:55:17,511 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:55:17,511 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-06 11:55:17,511 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-06 11:55:17,512 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:17,512 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:17,513 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:55:17,513 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:17,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:55:17,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:55:17,513 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:17,513 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:55:17,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:17,513 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:17,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:55:17,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:17,514 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:17,514 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-06 11:55:17,514 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:17,514 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-06 11:55:17,514 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:55:17,514 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-06 11:55:17,514 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-06 11:55:17,514 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:55:17,514 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1. 2023-03-06 11:55:17,514 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1. started... 2023-03-06 11:55:17,514 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1ea5b692133196fdda0700a7028a36a1 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-06 11:55:17,667 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-06 11:55:17,926 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120117bebd036df14837be576fc674633840 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120117bebd036df14837be576fc674633840 2023-03-06 11:55:18,331 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/.tmp/family1/033ad83f4a2946fcb8969965fd2155aa 2023-03-06 11:55:18,336 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/.tmp/family1/033ad83f4a2946fcb8969965fd2155aa as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/033ad83f4a2946fcb8969965fd2155aa 2023-03-06 11:55:18,339 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/033ad83f4a2946fcb8969965fd2155aa, entries=1, sequenceid=13, filesize=5.0 K 2023-03-06 11:55:18,340 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1ea5b692133196fdda0700a7028a36a1 in 826ms, sequenceid=13, compaction requested=true 2023-03-06 11:55:18,340 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1ea5b692133196fdda0700a7028a36a1: 2023-03-06 11:55:18,340 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1. 2023-03-06 11:55:18,340 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-06 11:55:18,340 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-06 11:55:18,340 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:18,340 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-06 11:55:18,340 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-06 11:55:18,342 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:18,342 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:18,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:18,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:18,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:18,342 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:18,342 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:55:18,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:18,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:18,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:18,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:18,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:18,344 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-06 11:55:18,344 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3eb92047[Count = 0] remaining members to acquire global barrier 2023-03-06 11:55:18,344 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-06 11:55:18,344 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:18,345 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:18,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:18,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:18,345 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-06 11:55:18,345 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-06 11:55:18,345 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:55:18,345 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:18,345 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:55:18,347 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-06 11:55:18,347 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:18,347 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:55:18,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:18,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:18,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:18,347 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-06 11:55:18,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:18,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:18,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:18,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:18,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:18,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:18,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:18,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:55:18,349 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-06 11:55:18,349 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-06 11:55:18,349 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:55:18,349 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:55:18,349 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:18,349 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:55:18,350 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:18,350 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:18,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:18,351 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:55:18,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:18,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:18,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:18,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:18,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:18,351 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:18,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:55:18,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:55:18,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:18,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:18,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:18,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:18,352 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:18,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:18,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:18,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:18,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:18,355 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:18,355 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:55:18,355 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:18,355 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:55:18,355 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:18,356 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:18,356 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:18,355 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-06 11:55:18,356 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:55:18,355 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:55:18,355 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:55:18,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:55:18,356 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-06 11:55:18,356 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:18,356 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-06 11:55:18,356 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:55:18,356 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:18,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:55:18,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:55:18,456 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:55:18,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:55:18,461 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:55:18,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-06 11:55:18,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:18,462 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-06 11:55:18,462 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:55:18,462 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-06 11:55:18,463 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-06 11:55:18,463 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:18,463 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:18,464 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:55:18,464 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:18,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:55:18,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:55:18,464 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:18,464 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:55:18,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:18,465 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:18,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:55:18,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:18,465 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:18,465 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-06 11:55:18,465 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:18,465 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-06 11:55:18,465 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:55:18,466 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-06 11:55:18,466 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-06 11:55:18,466 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:55:18,466 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1. 2023-03-06 11:55:18,466 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1. started... 2023-03-06 11:55:18,466 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1ea5b692133196fdda0700a7028a36a1 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-06 11:55:18,881 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120540a79d85010e4eff89bb408feabf38bd to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120540a79d85010e4eff89bb408feabf38bd 2023-03-06 11:55:19,286 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/.tmp/family1/f4a01700aafa4d66b647a0026e71583c 2023-03-06 11:55:19,291 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/.tmp/family1/f4a01700aafa4d66b647a0026e71583c as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/f4a01700aafa4d66b647a0026e71583c 2023-03-06 11:55:19,294 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/f4a01700aafa4d66b647a0026e71583c, entries=1, sequenceid=17, filesize=5.0 K 2023-03-06 11:55:19,295 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1ea5b692133196fdda0700a7028a36a1 in 829ms, sequenceid=17, compaction requested=true 2023-03-06 11:55:19,295 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1ea5b692133196fdda0700a7028a36a1: 2023-03-06 11:55:19,295 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1. 2023-03-06 11:55:19,295 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-06 11:55:19,295 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-06 11:55:19,295 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:19,295 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-06 11:55:19,295 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-06 11:55:19,297 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:19,297 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:19,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:19,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:19,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:19,297 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:19,297 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:55:19,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:19,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:19,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:19,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:19,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:19,298 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-06 11:55:19,298 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@529f7b5d[Count = 0] remaining members to acquire global barrier 2023-03-06 11:55:19,298 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-06 11:55:19,298 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:19,304 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:19,304 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:19,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:19,304 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:19,304 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:55:19,304 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-06 11:55:19,304 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-06 11:55:19,304 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:55:19,306 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-06 11:55:19,306 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:55:19,306 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:19,306 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-06 11:55:19,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:19,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:19,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:19,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:19,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:19,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:19,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:19,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:19,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:19,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:19,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:55:19,308 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-06 11:55:19,308 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-06 11:55:19,308 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:55:19,308 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:55:19,308 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:19,308 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:55:19,310 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:19,310 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:19,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:19,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:19,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:19,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:19,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:19,310 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:55:19,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:19,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:55:19,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:55:19,311 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:19,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:19,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:19,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:19,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:19,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:19,312 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:19,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:19,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:19,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:19,314 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:19,314 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:55:19,314 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:19,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:55:19,314 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-06 11:55:19,314 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:55:19,314 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:55:19,314 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:19,314 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:55:19,314 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:19,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:55:19,314 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:19,314 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:19,314 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:19,314 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-06 11:55:19,315 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:55:19,315 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:55:19,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:55:19,415 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:55:19,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:55:19,419 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:55:19,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-06 11:55:19,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:19,421 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-06 11:55:19,421 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:55:19,421 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-06 11:55:19,421 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-06 11:55:19,421 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:19,421 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:19,425 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:55:19,425 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:19,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:55:19,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:55:19,425 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:19,425 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:55:19,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:19,426 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:19,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:55:19,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:19,426 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:19,426 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-06 11:55:19,426 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:19,426 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-06 11:55:19,426 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:55:19,426 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-06 11:55:19,427 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-06 11:55:19,427 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:55:19,427 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1. 2023-03-06 11:55:19,427 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1. started... 2023-03-06 11:55:19,427 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1ea5b692133196fdda0700a7028a36a1 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-06 11:55:19,838 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228d68a80373d7e46bf9f8ede361ce63f4c to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228d68a80373d7e46bf9f8ede361ce63f4c 2023-03-06 11:55:20,245 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/.tmp/family1/74e9cd47ff974e7eb5cbdcac4873f758 2023-03-06 11:55:20,249 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/.tmp/family1/74e9cd47ff974e7eb5cbdcac4873f758 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/74e9cd47ff974e7eb5cbdcac4873f758 2023-03-06 11:55:20,252 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/74e9cd47ff974e7eb5cbdcac4873f758, entries=1, sequenceid=21, filesize=5.0 K 2023-03-06 11:55:20,252 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1ea5b692133196fdda0700a7028a36a1 in 825ms, sequenceid=21, compaction requested=true 2023-03-06 11:55:20,253 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1ea5b692133196fdda0700a7028a36a1: 2023-03-06 11:55:20,253 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1. 2023-03-06 11:55:20,253 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-06 11:55:20,253 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-06 11:55:20,253 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:20,253 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-06 11:55:20,253 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-06 11:55:20,254 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:20,254 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:20,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:20,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:20,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:20,254 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:20,254 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:55:20,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:20,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:20,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:20,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:20,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:20,256 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-06 11:55:20,256 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@17afa2c5[Count = 0] remaining members to acquire global barrier 2023-03-06 11:55:20,256 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-06 11:55:20,256 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:20,257 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:20,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:20,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:20,257 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-06 11:55:20,257 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-06 11:55:20,257 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:55:20,257 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:20,257 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:55:20,258 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-06 11:55:20,258 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:55:20,258 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:20,258 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-06 11:55:20,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:20,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:20,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:20,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:20,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:20,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:20,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:20,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:20,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:20,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:20,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:55:20,260 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-06 11:55:20,260 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-06 11:55:20,260 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:55:20,260 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:55:20,260 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:20,260 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:55:20,263 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:20,263 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:20,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:20,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:20,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:20,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:20,263 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:55:20,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:20,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:20,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:55:20,263 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:20,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:55:20,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:20,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:20,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:20,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:20,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:20,264 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:20,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:20,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:20,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:20,266 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:20,266 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:55:20,266 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:20,266 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-06 11:55:20,266 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:55:20,266 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:20,266 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:55:20,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:55:20,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:55:20,266 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:55:20,267 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-06 11:55:20,267 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-06 11:55:20,267 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:20,267 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:55:20,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:55:20,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:55:20,267 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:20,267 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:20,267 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:20,367 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:55:20,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:55:20,371 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:55:20,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-06 11:55:20,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:20,373 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-06 11:55:20,373 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:55:20,373 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-06 11:55:20,373 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-06 11:55:20,373 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:20,373 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:20,374 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:55:20,374 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:20,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:55:20,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:55:20,375 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:20,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:20,375 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:55:20,375 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:20,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:55:20,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:20,375 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:20,376 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-06 11:55:20,376 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:20,376 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-06 11:55:20,376 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:55:20,376 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-06 11:55:20,376 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-06 11:55:20,376 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:55:20,376 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1. 2023-03-06 11:55:20,376 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1. started... 2023-03-06 11:55:20,376 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1ea5b692133196fdda0700a7028a36a1 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-06 11:55:20,789 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231373b19b43dc64b26b61f91c67aae80f6 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231373b19b43dc64b26b61f91c67aae80f6 2023-03-06 11:55:21,194 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/.tmp/family1/651677981c0349b5852afda7431091e1 2023-03-06 11:55:21,198 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/.tmp/family1/651677981c0349b5852afda7431091e1 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/651677981c0349b5852afda7431091e1 2023-03-06 11:55:21,201 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/651677981c0349b5852afda7431091e1, entries=1, sequenceid=25, filesize=5.0 K 2023-03-06 11:55:21,202 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1ea5b692133196fdda0700a7028a36a1 in 826ms, sequenceid=25, compaction requested=true 2023-03-06 11:55:21,202 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1ea5b692133196fdda0700a7028a36a1: 2023-03-06 11:55:21,202 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1. 2023-03-06 11:55:21,202 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-06 11:55:21,202 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-06 11:55:21,202 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:21,203 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-06 11:55:21,203 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-06 11:55:21,204 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:21,204 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:21,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:21,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:21,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:21,204 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:21,204 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:55:21,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:21,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:21,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:21,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:21,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:21,206 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-06 11:55:21,206 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6f34b5a8[Count = 0] remaining members to acquire global barrier 2023-03-06 11:55:21,206 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-06 11:55:21,206 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:21,208 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:21,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:21,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:21,208 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-06 11:55:21,208 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-06 11:55:21,208 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:21,208 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:55:21,208 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:55:21,209 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:21,209 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-06 11:55:21,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:21,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:21,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:21,209 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:55:21,209 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-06 11:55:21,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:21,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:21,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:21,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:21,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:21,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:21,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:21,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:55:21,211 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-06 11:55:21,211 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-06 11:55:21,211 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:55:21,211 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:55:21,211 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:21,211 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:55:21,213 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:21,213 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:21,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:21,213 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:55:21,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:21,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:21,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:21,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:21,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:55:21,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:55:21,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:21,213 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:21,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:21,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:21,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:21,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:21,214 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:21,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:21,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:21,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:21,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:21,223 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:55:21,223 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:21,223 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:55:21,223 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:21,223 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-06 11:55:21,224 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:55:21,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:55:21,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:55:21,224 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-06 11:55:21,223 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:55:21,224 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:21,224 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-06 11:55:21,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:55:21,224 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:55:21,224 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:21,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:55:21,224 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:21,224 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:21,224 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:21,324 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:55:21,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:55:21,328 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:55:21,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-06 11:55:21,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:21,330 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-06 11:55:21,330 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:55:21,330 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-06 11:55:21,330 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-06 11:55:21,330 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:21,331 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:21,334 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:55:21,334 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:21,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:55:21,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:55:21,335 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:21,335 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:55:21,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:21,335 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:21,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:55:21,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:21,335 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:21,336 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-06 11:55:21,336 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:21,336 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-06 11:55:21,336 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:55:21,336 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-06 11:55:21,336 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-06 11:55:21,336 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:55:21,336 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1. 2023-03-06 11:55:21,336 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1. started... 2023-03-06 11:55:21,336 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1ea5b692133196fdda0700a7028a36a1 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-06 11:55:21,748 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601014dc7f3300a2540bebf301dd55aa9a7a9 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601014dc7f3300a2540bebf301dd55aa9a7a9 2023-03-06 11:55:22,153 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/.tmp/family1/3e1f54441ccd4970a1deb6a2cc57004d 2023-03-06 11:55:22,159 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/.tmp/family1/3e1f54441ccd4970a1deb6a2cc57004d as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/3e1f54441ccd4970a1deb6a2cc57004d 2023-03-06 11:55:22,163 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/3e1f54441ccd4970a1deb6a2cc57004d, entries=1, sequenceid=29, filesize=5.0 K 2023-03-06 11:55:22,164 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1ea5b692133196fdda0700a7028a36a1 in 828ms, sequenceid=29, compaction requested=true 2023-03-06 11:55:22,164 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1ea5b692133196fdda0700a7028a36a1: 2023-03-06 11:55:22,164 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1. 2023-03-06 11:55:22,164 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-06 11:55:22,164 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-06 11:55:22,164 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:22,164 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-06 11:55:22,164 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-06 11:55:22,165 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:22,165 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:22,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:22,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:22,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:22,166 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:22,166 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:55:22,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:22,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:22,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:22,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:22,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:22,167 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-06 11:55:22,167 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@18f80b11[Count = 0] remaining members to acquire global barrier 2023-03-06 11:55:22,167 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-06 11:55:22,167 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:22,168 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:22,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:22,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:22,168 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-06 11:55:22,168 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-06 11:55:22,168 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:55:22,168 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:22,168 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:55:22,169 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:22,169 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-06 11:55:22,169 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:55:22,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:22,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:22,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:22,169 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-06 11:55:22,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:22,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:22,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:22,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:22,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:22,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:22,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:22,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:55:22,171 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-06 11:55:22,171 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-06 11:55:22,171 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:55:22,171 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:55:22,171 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:22,171 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:55:22,174 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:22,174 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:22,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:22,174 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:55:22,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:22,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:22,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:22,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:22,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:55:22,174 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:22,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:22,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:55:22,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:22,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:22,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:22,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:22,175 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:22,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:22,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:22,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:22,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:22,177 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:22,177 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:55:22,177 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:22,177 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:55:22,177 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-06 11:55:22,177 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:55:22,177 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:22,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:55:22,177 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:55:22,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:55:22,177 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-06 11:55:22,177 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:22,177 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:22,177 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-06 11:55:22,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:55:22,178 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:55:22,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:55:22,177 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:22,178 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:22,278 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:55:22,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:55:22,283 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:55:22,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-06 11:55:22,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:22,285 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-06 11:55:22,285 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:55:22,285 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-06 11:55:22,285 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-06 11:55:22,285 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:22,285 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:22,286 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:55:22,286 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:22,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:55:22,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:55:22,287 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:22,287 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:55:22,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:22,287 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:22,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:55:22,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:22,288 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:22,288 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-06 11:55:22,288 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:22,288 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-06 11:55:22,288 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:55:22,288 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-06 11:55:22,288 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-06 11:55:22,288 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:55:22,288 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1. 2023-03-06 11:55:22,288 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1. started... 2023-03-06 11:55:22,288 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1ea5b692133196fdda0700a7028a36a1 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-06 11:55:22,706 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103b5fc7ac720d64cd8960cd5aea179e82b to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103b5fc7ac720d64cd8960cd5aea179e82b 2023-03-06 11:55:23,112 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/.tmp/family1/818d99b9724d4567840f4ddc2a848586 2023-03-06 11:55:23,116 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/.tmp/family1/818d99b9724d4567840f4ddc2a848586 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/818d99b9724d4567840f4ddc2a848586 2023-03-06 11:55:23,120 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/818d99b9724d4567840f4ddc2a848586, entries=1, sequenceid=33, filesize=5.0 K 2023-03-06 11:55:23,121 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1ea5b692133196fdda0700a7028a36a1 in 832ms, sequenceid=33, compaction requested=true 2023-03-06 11:55:23,121 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1ea5b692133196fdda0700a7028a36a1: 2023-03-06 11:55:23,121 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1. 2023-03-06 11:55:23,121 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-06 11:55:23,121 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-06 11:55:23,121 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:23,121 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-06 11:55:23,121 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-06 11:55:23,122 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:23,122 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:23,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:23,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:23,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:23,123 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:23,123 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:55:23,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:23,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:23,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:23,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:23,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:23,124 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-06 11:55:23,124 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3194cec0[Count = 0] remaining members to acquire global barrier 2023-03-06 11:55:23,124 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-06 11:55:23,124 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:23,126 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:23,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:23,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:23,127 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-06 11:55:23,127 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-06 11:55:23,127 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:23,127 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:55:23,127 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:55:23,128 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:23,128 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-06 11:55:23,128 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:55:23,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:23,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:23,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:23,128 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-06 11:55:23,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:23,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:23,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:23,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:23,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:23,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:23,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:23,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:55:23,130 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-06 11:55:23,130 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-06 11:55:23,130 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:55:23,130 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:55:23,130 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:23,130 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:55:23,131 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:23,131 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:23,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:23,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:23,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:23,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:23,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:23,131 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:55:23,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:23,132 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:23,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:55:23,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:55:23,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:23,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:23,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:23,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:23,133 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:23,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:23,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:23,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:23,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:23,135 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:23,135 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:55:23,135 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:23,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:55:23,135 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-06 11:55:23,135 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:55:23,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:55:23,135 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:23,135 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:55:23,135 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:55:23,135 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:23,135 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:23,135 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-06 11:55:23,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:55:23,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:55:23,135 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:23,135 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:55:23,135 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:23,235 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:55:23,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:55:23,240 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:55:23,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-06 11:55:23,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:23,241 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-06 11:55:23,241 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:55:23,241 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-06 11:55:23,241 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-06 11:55:23,242 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:23,242 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:23,247 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:23,247 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:55:23,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:55:23,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:55:23,247 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:23,247 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:55:23,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:23,248 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:23,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:55:23,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:23,248 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:23,248 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-06 11:55:23,248 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:23,248 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-06 11:55:23,248 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:55:23,248 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-06 11:55:23,249 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-06 11:55:23,249 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:55:23,249 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1. 2023-03-06 11:55:23,249 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1. started... 2023-03-06 11:55:23,249 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1ea5b692133196fdda0700a7028a36a1 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-06 11:55:23,662 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907ce283e30b77443b3a080e1a01a90ad34 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20150907ce283e30b77443b3a080e1a01a90ad34 2023-03-06 11:55:24,067 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/.tmp/family1/a804f06f144f40c38199d9f3b4fd73b9 2023-03-06 11:55:24,071 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/.tmp/family1/a804f06f144f40c38199d9f3b4fd73b9 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/a804f06f144f40c38199d9f3b4fd73b9 2023-03-06 11:55:24,075 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/a804f06f144f40c38199d9f3b4fd73b9, entries=1, sequenceid=37, filesize=5.0 K 2023-03-06 11:55:24,076 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1ea5b692133196fdda0700a7028a36a1 in 826ms, sequenceid=37, compaction requested=true 2023-03-06 11:55:24,076 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1ea5b692133196fdda0700a7028a36a1: 2023-03-06 11:55:24,076 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1. 2023-03-06 11:55:24,076 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-06 11:55:24,076 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-06 11:55:24,076 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:24,076 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-06 11:55:24,076 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-06 11:55:24,077 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:24,077 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:24,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:24,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:24,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:24,078 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:24,078 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:55:24,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:24,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:24,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:24,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:24,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:24,079 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-06 11:55:24,079 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5b47ebbd[Count = 0] remaining members to acquire global barrier 2023-03-06 11:55:24,079 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-06 11:55:24,079 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:24,080 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:24,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:24,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:24,080 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-06 11:55:24,080 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:24,080 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:55:24,080 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-06 11:55:24,080 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:55:24,081 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:24,081 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-06 11:55:24,082 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:55:24,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:24,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:24,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:24,082 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-06 11:55:24,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:24,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:24,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:24,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:24,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:24,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:24,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:24,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:55:24,083 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-06 11:55:24,083 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-06 11:55:24,083 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:55:24,083 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:55:24,084 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:24,084 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:55:24,086 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:24,086 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:24,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:24,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:24,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:24,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:24,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:24,086 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:55:24,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:24,086 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:24,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:55:24,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:55:24,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:24,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:24,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:24,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:24,087 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:24,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:24,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:24,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:24,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:24,089 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:24,089 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:55:24,089 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:24,089 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-06 11:55:24,089 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:55:24,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:55:24,089 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:24,089 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:55:24,089 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:55:24,090 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:24,090 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-06 11:55:24,090 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:55:24,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:55:24,090 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:24,090 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:24,090 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:24,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:55:24,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:55:24,190 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:55:24,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:55:24,194 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:55:24,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-06 11:55:24,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:24,195 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-06 11:55:24,196 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:55:24,196 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-06 11:55:24,196 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-06 11:55:24,196 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:24,196 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:24,197 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:24,197 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:55:24,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:55:24,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:55:24,197 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:24,197 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:55:24,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:24,198 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:24,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:55:24,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:24,198 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:24,198 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-06 11:55:24,199 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:24,199 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-06 11:55:24,199 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:55:24,199 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-06 11:55:24,199 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-06 11:55:24,199 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:55:24,199 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1. 2023-03-06 11:55:24,199 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1. started... 2023-03-06 11:55:24,199 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1ea5b692133196fdda0700a7028a36a1 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-06 11:55:24,610 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112049545e64858540a2858747c71946c585 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112049545e64858540a2858747c71946c585 2023-03-06 11:55:25,015 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/.tmp/family1/f30e4bac66ae4743be29e5f69a250443 2023-03-06 11:55:25,020 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/.tmp/family1/f30e4bac66ae4743be29e5f69a250443 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/f30e4bac66ae4743be29e5f69a250443 2023-03-06 11:55:25,023 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/f30e4bac66ae4743be29e5f69a250443, entries=1, sequenceid=41, filesize=5.0 K 2023-03-06 11:55:25,024 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1ea5b692133196fdda0700a7028a36a1 in 825ms, sequenceid=41, compaction requested=true 2023-03-06 11:55:25,024 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1ea5b692133196fdda0700a7028a36a1: 2023-03-06 11:55:25,024 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1. 2023-03-06 11:55:25,024 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-06 11:55:25,024 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-06 11:55:25,024 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:25,025 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-06 11:55:25,025 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-06 11:55:25,026 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:25,026 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:25,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:25,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:25,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:25,026 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:25,026 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:55:25,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:25,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:25,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:25,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:25,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:25,027 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-06 11:55:25,027 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@11949c88[Count = 0] remaining members to acquire global barrier 2023-03-06 11:55:25,027 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-06 11:55:25,027 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:25,030 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:25,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:25,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:25,030 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-06 11:55:25,030 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-06 11:55:25,030 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:55:25,030 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:25,030 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:55:25,031 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-06 11:55:25,031 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:55:25,031 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:25,031 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-06 11:55:25,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:25,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:25,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:25,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:25,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:25,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:25,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:25,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:25,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:25,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:25,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:55:25,033 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-06 11:55:25,033 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-06 11:55:25,033 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:55:25,033 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:55:25,033 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:25,033 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:55:25,035 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:25,035 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:25,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:25,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:25,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:25,035 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:55:25,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:25,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:25,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:25,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:55:25,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:55:25,035 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:25,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:25,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:25,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:25,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:25,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:25,036 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:25,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:25,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:25,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:25,038 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:25,038 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:55:25,038 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:25,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:55:25,038 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-06 11:55:25,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:55:25,038 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:25,038 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-06 11:55:25,038 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:55:25,038 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:55:25,038 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:55:25,038 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:25,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:55:25,038 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:25,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:55:25,038 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:25,038 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-06 11:55:25,039 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:55:25,038 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:25,139 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:55:25,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:55:25,141 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=36301] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:25,142 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] procedure2.ProcedureExecutor(1029): Stored pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-06 11:55:25,143 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-06 11:55:25,143 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-06 11:55:25,143 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=58, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678104325143 2023-03-06 11:55:25,146 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-06 11:55:25,147 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-03-06 11:55:25,147 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-06 11:55:25,148 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] zookeeper.ReadOnlyZKClient(139): Connect 0x2b1a2c0d to 127.0.0.1:62659 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-06 11:55:25,153 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@47aaad68, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-06 11:55:25,153 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-06 11:55:25,606 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010312be68f783494d799904d5cea6e87503 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010312be68f783494d799904d5cea6e87503 2023-03-06 11:55:25,607 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-06 11:55:25,619 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-06 11:55:25,620 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:44210, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-06 11:55:25,626 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-06 11:55:25,627 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:57750, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-06 11:55:25,635 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/cf3d09059f3349d4b2edcae6302406d5 first=Optional[r3] last=Optional[r6] 2023-03-06 11:55:25,635 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1., hostname=jenkins-hbase5.apache.org,42547,1678103642479, seqNum=2 for row with hfile group [{family1,hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/cf3d09059f3349d4b2edcae6302406d5}] 2023-03-06 11:55:25,639 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(763): Validating hfile at hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/cf3d09059f3349d4b2edcae6302406d5 for inclusion in 1ea5b692133196fdda0700a7028a36a1/family1 2023-03-06 11:55:25,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-03-06 11:55:25,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(777): Region bounds: first= last= 2023-03-06 11:55:25,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegion(2446): Flush status journal for 1ea5b692133196fdda0700a7028a36a1: 2023-03-06 11:55:25,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/cf3d09059f3349d4b2edcae6302406d5 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__kp2egebui0ugdor7uesocjg711r2qd2fk2omust74aj4rcf144f3cc9hr2an93t/family1/cf3d09059f3349d4b2edcae6302406d5 2023-03-06 11:55:25,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__kp2egebui0ugdor7uesocjg711r2qd2fk2omust74aj4rcf144f3cc9hr2an93t/family1/cf3d09059f3349d4b2edcae6302406d5 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/e28dd52d9ab746d99b95270e71f72ae8_SeqId_44_ 2023-03-06 11:55:25,645 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(849): Loaded HFile hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__kp2egebui0ugdor7uesocjg711r2qd2fk2omust74aj4rcf144f3cc9hr2an93t/family1/cf3d09059f3349d4b2edcae6302406d5 into 1ea5b692133196fdda0700a7028a36a1/family1 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/e28dd52d9ab746d99b95270e71f72ae8_SeqId_44_ - updating store file list. 2023-03-06 11:55:25,648 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(882): Loaded HFile hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/e28dd52d9ab746d99b95270e71f72ae8_SeqId_44_ into 1ea5b692133196fdda0700a7028a36a1/family1 2023-03-06 11:55:25,648 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(855): Successfully loaded hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__kp2egebui0ugdor7uesocjg711r2qd2fk2omust74aj4rcf144f3cc9hr2an93t/family1/cf3d09059f3349d4b2edcae6302406d5 into 1ea5b692133196fdda0700a7028a36a1/family1 (new location: hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/e28dd52d9ab746d99b95270e71f72ae8_SeqId_44_) 2023-03-06 11:55:25,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__kp2egebui0ugdor7uesocjg711r2qd2fk2omust74aj4rcf144f3cc9hr2an93t/family1/cf3d09059f3349d4b2edcae6302406d5 2023-03-06 11:55:25,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-06 11:55:25,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51552 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-06 11:55:25,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(1912): 1ea5b692133196fdda0700a7028a36a1/family1 is initiating minor compaction 2023-03-06 11:55:25,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@545ac3fa; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-06 11:55:25,651 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 1ea5b692133196fdda0700a7028a36a1/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1. 2023-03-06 11:55:25,651 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/312dd6fb3b1b4158921dd768987dd481, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/033ad83f4a2946fcb8969965fd2155aa, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/f4a01700aafa4d66b647a0026e71583c, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/74e9cd47ff974e7eb5cbdcac4873f758, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/651677981c0349b5852afda7431091e1, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/3e1f54441ccd4970a1deb6a2cc57004d, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/818d99b9724d4567840f4ddc2a848586, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/a804f06f144f40c38199d9f3b4fd73b9, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/f30e4bac66ae4743be29e5f69a250443, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/e28dd52d9ab746d99b95270e71f72ae8_SeqId_44_] into tmpdir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/.tmp, totalSize=50.3 K 2023-03-06 11:55:25,651 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting 312dd6fb3b1b4158921dd768987dd481, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-06 11:55:25,651 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting 033ad83f4a2946fcb8969965fd2155aa, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-06 11:55:25,651 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting f4a01700aafa4d66b647a0026e71583c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-06 11:55:25,651 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting 74e9cd47ff974e7eb5cbdcac4873f758, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-06 11:55:25,651 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting 651677981c0349b5852afda7431091e1, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-06 11:55:25,651 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting 3e1f54441ccd4970a1deb6a2cc57004d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-06 11:55:25,651 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting 818d99b9724d4567840f4ddc2a848586, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-06 11:55:25,651 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting a804f06f144f40c38199d9f3b4fd73b9, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-06 11:55:25,651 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting f30e4bac66ae4743be29e5f69a250443, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-06 11:55:25,651 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting e28dd52d9ab746d99b95270e71f72ae8_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-06 11:55:25,652 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-06 11:55:25,653 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:55:25,655 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228d68a80373d7e46bf9f8ede361ce63f4c to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228d68a80373d7e46bf9f8ede361ce63f4c 2023-03-06 11:55:25,656 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231373b19b43dc64b26b61f91c67aae80f6 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231373b19b43dc64b26b61f91c67aae80f6 2023-03-06 11:55:25,657 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601014dc7f3300a2540bebf301dd55aa9a7a9 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601014dc7f3300a2540bebf301dd55aa9a7a9 2023-03-06 11:55:25,658 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103b5fc7ac720d64cd8960cd5aea179e82b to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103b5fc7ac720d64cd8960cd5aea179e82b 2023-03-06 11:55:25,658 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 4 expired mob files are deleted 2023-03-06 11:55:25,658 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-03-06 11:55:25,658 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-06 11:55:25,658 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-06 11:55:25,658 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-06 11:55:25,658 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-06 11:55:25,658 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-06 11:55:25,658 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-06 11:55:25,658 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-06 11:55:25,658 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-06 11:55:25,680 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] throttle.PressureAwareThroughputController(145): 1ea5b692133196fdda0700a7028a36a1#family1#compaction#72 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-06 11:55:26,495 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/.tmp/family1/feecbae453224f7fa134715392d7678c as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/feecbae453224f7fa134715392d7678c 2023-03-06 11:55:26,499 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512057d892a01525c410890e3fedd3b6dc1e8 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512057d892a01525c410890e3fedd3b6dc1e8 2023-03-06 11:55:26,500 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-06 11:55:26,500 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 1ea5b692133196fdda0700a7028a36a1/family1 of 1ea5b692133196fdda0700a7028a36a1 into feecbae453224f7fa134715392d7678c(size=6.8 K), total size for store is 197.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-06 11:55:26,500 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 1ea5b692133196fdda0700a7028a36a1: 2023-03-06 11:55:26,500 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1., storeName=family1, fileCount=10, fileSize=50.3 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1678103725651; duration=0sec 2023-03-06 11:55:26,500 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-06 11:55:26,515 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/312dd6fb3b1b4158921dd768987dd481, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/033ad83f4a2946fcb8969965fd2155aa, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/f4a01700aafa4d66b647a0026e71583c, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/74e9cd47ff974e7eb5cbdcac4873f758, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/651677981c0349b5852afda7431091e1, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/3e1f54441ccd4970a1deb6a2cc57004d, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/818d99b9724d4567840f4ddc2a848586, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/a804f06f144f40c38199d9f3b4fd73b9, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/f30e4bac66ae4743be29e5f69a250443, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/e28dd52d9ab746d99b95270e71f72ae8_SeqId_44_] to archive 2023-03-06 11:55:26,515 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:55:26,517 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/312dd6fb3b1b4158921dd768987dd481 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/312dd6fb3b1b4158921dd768987dd481 2023-03-06 11:55:26,518 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/033ad83f4a2946fcb8969965fd2155aa to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/033ad83f4a2946fcb8969965fd2155aa 2023-03-06 11:55:26,519 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/f4a01700aafa4d66b647a0026e71583c to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/f4a01700aafa4d66b647a0026e71583c 2023-03-06 11:55:26,521 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/74e9cd47ff974e7eb5cbdcac4873f758 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/74e9cd47ff974e7eb5cbdcac4873f758 2023-03-06 11:55:26,522 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/651677981c0349b5852afda7431091e1 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/651677981c0349b5852afda7431091e1 2023-03-06 11:55:26,523 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/3e1f54441ccd4970a1deb6a2cc57004d to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/3e1f54441ccd4970a1deb6a2cc57004d 2023-03-06 11:55:26,524 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/818d99b9724d4567840f4ddc2a848586 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/818d99b9724d4567840f4ddc2a848586 2023-03-06 11:55:26,526 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/a804f06f144f40c38199d9f3b4fd73b9 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/a804f06f144f40c38199d9f3b4fd73b9 2023-03-06 11:55:26,527 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/f30e4bac66ae4743be29e5f69a250443 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/f30e4bac66ae4743be29e5f69a250443 2023-03-06 11:55:26,529 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/e28dd52d9ab746d99b95270e71f72ae8_SeqId_44_ to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/e28dd52d9ab746d99b95270e71f72ae8_SeqId_44_ 2023-03-06 11:55:26,531 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f2420ebc4b09499581eb9f772b094f84 first=Optional[r00] last=Optional[r2] 2023-03-06 11:55:26,532 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1., hostname=jenkins-hbase5.apache.org,42547,1678103642479, seqNum=2 for row with hfile group [{family1,hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f2420ebc4b09499581eb9f772b094f84}] 2023-03-06 11:55:26,534 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(763): Validating hfile at hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f2420ebc4b09499581eb9f772b094f84 for inclusion in 1ea5b692133196fdda0700a7028a36a1/family1 2023-03-06 11:55:26,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-03-06 11:55:26,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(777): Region bounds: first= last= 2023-03-06 11:55:26,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegion(2446): Flush status journal for 1ea5b692133196fdda0700a7028a36a1: 2023-03-06 11:55:26,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f2420ebc4b09499581eb9f772b094f84 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__6sj2cusag0sn2pgk8uicqic5bto2l6thdo721ed50ba1feuv3fp3ndrml1348d7u/family1/f2420ebc4b09499581eb9f772b094f84 2023-03-06 11:55:26,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__6sj2cusag0sn2pgk8uicqic5bto2l6thdo721ed50ba1feuv3fp3ndrml1348d7u/family1/f2420ebc4b09499581eb9f772b094f84 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/64bf699bfc814f51af223f941e8d53ce_SeqId_47_ 2023-03-06 11:55:26,540 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(849): Loaded HFile hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__6sj2cusag0sn2pgk8uicqic5bto2l6thdo721ed50ba1feuv3fp3ndrml1348d7u/family1/f2420ebc4b09499581eb9f772b094f84 into 1ea5b692133196fdda0700a7028a36a1/family1 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/64bf699bfc814f51af223f941e8d53ce_SeqId_47_ - updating store file list. 2023-03-06 11:55:26,544 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(882): Loaded HFile hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/64bf699bfc814f51af223f941e8d53ce_SeqId_47_ into 1ea5b692133196fdda0700a7028a36a1/family1 2023-03-06 11:55:26,544 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(855): Successfully loaded hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__6sj2cusag0sn2pgk8uicqic5bto2l6thdo721ed50ba1feuv3fp3ndrml1348d7u/family1/f2420ebc4b09499581eb9f772b094f84 into 1ea5b692133196fdda0700a7028a36a1/family1 (new location: hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/64bf699bfc814f51af223f941e8d53ce_SeqId_47_) 2023-03-06 11:55:26,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__6sj2cusag0sn2pgk8uicqic5bto2l6thdo721ed50ba1feuv3fp3ndrml1348d7u/family1/f2420ebc4b09499581eb9f772b094f84 2023-03-06 11:55:26,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-06 11:55:26,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 397422 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-06 11:55:26,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(1912): 1ea5b692133196fdda0700a7028a36a1/family1 is initiating minor compaction (all files) 2023-03-06 11:55:26,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7f159d79; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-06 11:55:26,545 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 1ea5b692133196fdda0700a7028a36a1/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1. 2023-03-06 11:55:26,546 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/a60901e5e15f4c83b08956f20bd8f9a3, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/feecbae453224f7fa134715392d7678c, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/64bf699bfc814f51af223f941e8d53ce_SeqId_47_] into tmpdir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/.tmp, totalSize=388.1 K 2023-03-06 11:55:26,546 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting a60901e5e15f4c83b08956f20bd8f9a3, keycount=1000, bloomtype=ROW, size=190.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878806372 2023-03-06 11:55:26,546 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting feecbae453224f7fa134715392d7678c, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621206372 2023-03-06 11:55:26,547 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting 64bf699bfc814f51af223f941e8d53ce_SeqId_47_, keycount=1002, bloomtype=ROW, size=190.9 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878806372 2023-03-06 11:55:26,547 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-06 11:55:26,548 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:55:26,549 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511301029e690bf124d5794cc5fb7384d963f to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511301029e690bf124d5794cc5fb7384d963f 2023-03-06 11:55:26,550 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120117bebd036df14837be576fc674633840 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120117bebd036df14837be576fc674633840 2023-03-06 11:55:26,551 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120540a79d85010e4eff89bb408feabf38bd to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120540a79d85010e4eff89bb408feabf38bd 2023-03-06 11:55:26,551 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 3 expired mob files are deleted 2023-03-06 11:55:26,551 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-03-06 11:55:26,552 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-06 11:55:26,552 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-06 11:55:26,552 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-06 11:55:26,556 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=58, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-06 11:55:26,557 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=58, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 1.4150 sec 2023-03-06 11:55:26,565 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] throttle.PressureAwareThroughputController(145): 1ea5b692133196fdda0700a7028a36a1#family1#compaction#73 average throughput is 29.94 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-06 11:55:26,630 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.HMaster$12(2454): Client=jenkins//172.31.10.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-03-06 11:55:26,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure2.ProcedureExecutor(1029): Stored pid=59, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:27,039 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-03-06 11:55:27,040 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-03-06 11:55:27,040 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-03-06 11:55:27,042 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-03-06 11:55:27,044 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=1ea5b692133196fdda0700a7028a36a1, REOPEN/MOVE}] 2023-03-06 11:55:27,045 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=1ea5b692133196fdda0700a7028a36a1, REOPEN/MOVE 2023-03-06 11:55:27,046 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=1ea5b692133196fdda0700a7028a36a1, regionState=CLOSING, regionLocation=jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:27,046 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1678103727046"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678103727046"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678103727046"}]},"ts":"1678103727046"} 2023-03-06 11:55:27,047 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=62, ppid=61, state=RUNNABLE; CloseRegionProcedure 1ea5b692133196fdda0700a7028a36a1, server=jenkins-hbase5.apache.org,42547,1678103642479}] 2023-03-06 11:55:27,198 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(109): Close 1ea5b692133196fdda0700a7028a36a1 2023-03-06 11:55:27,199 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 1ea5b692133196fdda0700a7028a36a1, disabling compactions & flushes 2023-03-06 11:55:27,199 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1. 2023-03-06 11:55:27,781 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/.tmp/family1/53f967fc87b44ddb83b083a3d533304c as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/53f967fc87b44ddb83b083a3d533304c 2023-03-06 11:55:27,785 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 1ea5b692133196fdda0700a7028a36a1/family1 of 1ea5b692133196fdda0700a7028a36a1 into 53f967fc87b44ddb83b083a3d533304c(size=192.0 K), total size for store is 192.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-06 11:55:27,785 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 1ea5b692133196fdda0700a7028a36a1: 2023-03-06 11:55:27,785 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1. 2023-03-06 11:55:27,785 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1., storeName=family1, fileCount=3, fileSize=388.1 K (190.5 K, 6.8 K, 190.9 K), priority=2, time=1678103726545; duration=1sec 2023-03-06 11:55:27,785 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1. 2023-03-06 11:55:27,785 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-06 11:55:27,785 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1. after waiting 0 ms 2023-03-06 11:55:27,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1. 2023-03-06 11:55:27,789 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/a60901e5e15f4c83b08956f20bd8f9a3, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/feecbae453224f7fa134715392d7678c, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/64bf699bfc814f51af223f941e8d53ce_SeqId_47_] to archive 2023-03-06 11:55:27,789 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:55:27,791 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/a60901e5e15f4c83b08956f20bd8f9a3 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/a60901e5e15f4c83b08956f20bd8f9a3 2023-03-06 11:55:27,791 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/feecbae453224f7fa134715392d7678c to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/feecbae453224f7fa134715392d7678c 2023-03-06 11:55:27,792 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/64bf699bfc814f51af223f941e8d53ce_SeqId_47_ to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/64bf699bfc814f51af223f941e8d53ce_SeqId_47_ 2023-03-06 11:55:27,796 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-03-06 11:55:27,797 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1. 2023-03-06 11:55:27,797 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 1ea5b692133196fdda0700a7028a36a1: 2023-03-06 11:55:27,797 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 1ea5b692133196fdda0700a7028a36a1 to self. 2023-03-06 11:55:27,798 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(147): Closed 1ea5b692133196fdda0700a7028a36a1 2023-03-06 11:55:27,799 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=1ea5b692133196fdda0700a7028a36a1, regionState=CLOSED 2023-03-06 11:55:27,799 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1678103727799"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678103727799"}]},"ts":"1678103727799"} 2023-03-06 11:55:27,801 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=62, resume processing ppid=61 2023-03-06 11:55:27,801 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=62, ppid=61, state=SUCCESS; CloseRegionProcedure 1ea5b692133196fdda0700a7028a36a1, server=jenkins-hbase5.apache.org,42547,1678103642479 in 753 msec 2023-03-06 11:55:27,801 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=1ea5b692133196fdda0700a7028a36a1, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase5.apache.org,42547,1678103642479; forceNewPlan=false, retain=true 2023-03-06 11:55:27,952 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=1ea5b692133196fdda0700a7028a36a1, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:27,952 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1678103727952"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678103727952"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678103727952"}]},"ts":"1678103727952"} 2023-03-06 11:55:27,953 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=63, ppid=61, state=RUNNABLE; OpenRegionProcedure 1ea5b692133196fdda0700a7028a36a1, server=jenkins-hbase5.apache.org,42547,1678103642479}] 2023-03-06 11:55:28,107 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1. 2023-03-06 11:55:28,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1ea5b692133196fdda0700a7028a36a1, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1.', STARTKEY => '', ENDKEY => ''} 2023-03-06 11:55:28,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 1ea5b692133196fdda0700a7028a36a1 2023-03-06 11:55:28,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-06 11:55:28,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 1ea5b692133196fdda0700a7028a36a1 2023-03-06 11:55:28,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 1ea5b692133196fdda0700a7028a36a1 2023-03-06 11:55:28,109 INFO [StoreOpener-1ea5b692133196fdda0700a7028a36a1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 1ea5b692133196fdda0700a7028a36a1 2023-03-06 11:55:28,110 DEBUG [StoreOpener-1ea5b692133196fdda0700a7028a36a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1 2023-03-06 11:55:28,110 DEBUG [StoreOpener-1ea5b692133196fdda0700a7028a36a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1 2023-03-06 11:55:28,110 INFO [StoreOpener-1ea5b692133196fdda0700a7028a36a1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1ea5b692133196fdda0700a7028a36a1 columnFamilyName family1 2023-03-06 11:55:28,114 DEBUG [StoreOpener-1ea5b692133196fdda0700a7028a36a1-1] regionserver.HStore(539): loaded hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/53f967fc87b44ddb83b083a3d533304c 2023-03-06 11:55:28,114 INFO [StoreOpener-1ea5b692133196fdda0700a7028a36a1-1] regionserver.HStore(310): Store=1ea5b692133196fdda0700a7028a36a1/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-06 11:55:28,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1 2023-03-06 11:55:28,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1 2023-03-06 11:55:28,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 1ea5b692133196fdda0700a7028a36a1 2023-03-06 11:55:28,119 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 1ea5b692133196fdda0700a7028a36a1; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71292625, jitterRate=0.062342897057533264}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-06 11:55:28,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 1ea5b692133196fdda0700a7028a36a1: 2023-03-06 11:55:28,120 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1., pid=63, masterSystemTime=1678103728105 2023-03-06 11:55:28,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1. 2023-03-06 11:55:28,121 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1. 2023-03-06 11:55:28,121 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=1ea5b692133196fdda0700a7028a36a1, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:28,121 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1678103728121"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678103728121"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678103728121"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678103728121"}]},"ts":"1678103728121"} 2023-03-06 11:55:28,124 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=63, resume processing ppid=61 2023-03-06 11:55:28,124 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=63, ppid=61, state=SUCCESS; OpenRegionProcedure 1ea5b692133196fdda0700a7028a36a1, server=jenkins-hbase5.apache.org,42547,1678103642479 in 169 msec 2023-03-06 11:55:28,125 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=60 2023-03-06 11:55:28,125 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=60, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=1ea5b692133196fdda0700a7028a36a1, REOPEN/MOVE in 1.0800 sec 2023-03-06 11:55:28,127 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-03-06 11:55:28,127 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.0830 sec 2023-03-06 11:55:28,128 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=59, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.4970 sec 2023-03-06 11:55:28,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=59 2023-03-06 11:55:28,130 INFO [Listener at localhost/46717] compactions.TestMobCompactor(278): alter status finished 2023-03-06 11:55:28,131 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=36301] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:28,132 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-06 11:55:28,132 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-06 11:55:28,133 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-06 11:55:28,133 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678104328133 2023-03-06 11:55:28,133 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-06 11:55:28,134 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-03-06 11:55:28,134 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-06 11:55:28,134 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] zookeeper.ReadOnlyZKClient(139): Connect 0x7a863fbf to 127.0.0.1:62659 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-06 11:55:28,138 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@647cb49b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-06 11:55:28,138 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-06 11:55:28,139 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-06 11:55:28,139 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-06 11:55:28,139 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-06 11:55:28,139 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-06 11:55:28,960 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128e7988cc804f84a03b482615bcc05ee61 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128e7988cc804f84a03b482615bcc05ee61 2023-03-06 11:55:28,961 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-06 11:55:28,974 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-06 11:55:28,975 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:44220, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-06 11:55:28,980 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-06 11:55:28,982 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:57752, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-06 11:55:28,990 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/4d6df2fae4c64a5b8673a543cecd064c first=Optional[r05] last=Optional[r8] 2023-03-06 11:55:28,991 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1., hostname=jenkins-hbase5.apache.org,42547,1678103642479, seqNum=51 for row with hfile group [{family1,hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/4d6df2fae4c64a5b8673a543cecd064c}] 2023-03-06 11:55:28,994 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(763): Validating hfile at hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/4d6df2fae4c64a5b8673a543cecd064c for inclusion in 1ea5b692133196fdda0700a7028a36a1/family1 2023-03-06 11:55:28,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-03-06 11:55:28,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(777): Region bounds: first= last= 2023-03-06 11:55:28,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegion(2446): Flush status journal for 1ea5b692133196fdda0700a7028a36a1: 2023-03-06 11:55:28,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/4d6df2fae4c64a5b8673a543cecd064c to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__4np3mg999qltus7usnl8mkavtb11plk8k6uq5tt7na7rp7djri774nlt4o3qdqkf/family1/4d6df2fae4c64a5b8673a543cecd064c 2023-03-06 11:55:28,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__4np3mg999qltus7usnl8mkavtb11plk8k6uq5tt7na7rp7djri774nlt4o3qdqkf/family1/4d6df2fae4c64a5b8673a543cecd064c as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/38f8f907a24b4a309169f7fb8f15517c_SeqId_53_ 2023-03-06 11:55:29,000 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(849): Loaded HFile hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__4np3mg999qltus7usnl8mkavtb11plk8k6uq5tt7na7rp7djri774nlt4o3qdqkf/family1/4d6df2fae4c64a5b8673a543cecd064c into 1ea5b692133196fdda0700a7028a36a1/family1 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/38f8f907a24b4a309169f7fb8f15517c_SeqId_53_ - updating store file list. 2023-03-06 11:55:29,003 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(882): Loaded HFile hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/38f8f907a24b4a309169f7fb8f15517c_SeqId_53_ into 1ea5b692133196fdda0700a7028a36a1/family1 2023-03-06 11:55:29,003 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(855): Successfully loaded hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__4np3mg999qltus7usnl8mkavtb11plk8k6uq5tt7na7rp7djri774nlt4o3qdqkf/family1/4d6df2fae4c64a5b8673a543cecd064c into 1ea5b692133196fdda0700a7028a36a1/family1 (new location: hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/38f8f907a24b4a309169f7fb8f15517c_SeqId_53_) 2023-03-06 11:55:29,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__4np3mg999qltus7usnl8mkavtb11plk8k6uq5tt7na7rp7djri774nlt4o3qdqkf/family1/4d6df2fae4c64a5b8673a543cecd064c 2023-03-06 11:55:29,005 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-06 11:55:29,005 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:55:29,007 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112049545e64858540a2858747c71946c585 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112049545e64858540a2858747c71946c585 2023-03-06 11:55:29,007 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128706d4d376f2e4f06b20685810af25108 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128706d4d376f2e4f06b20685810af25108 2023-03-06 11:55:29,007 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2 expired mob files are deleted 2023-03-06 11:55:29,007 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-03-06 11:55:29,008 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-06 11:55:29,008 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-06 11:55:29,008 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-06 11:55:29,008 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-06 11:55:29,008 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-06 11:55:29,009 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-06 11:55:29,010 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 878 msec 2023-03-06 11:55:29,054 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.HMaster$12(2454): Client=jenkins//172.31.10.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} 2023-03-06 11:55:29,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:29,463 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-03-06 11:55:29,464 DEBUG [PEWorker-4] util.FSTableDescriptors(519): Deleted hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-03-06 11:55:29,464 INFO [PEWorker-4] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-03-06 11:55:29,465 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=66, ppid=65, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-03-06 11:55:29,467 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=1ea5b692133196fdda0700a7028a36a1, REOPEN/MOVE}] 2023-03-06 11:55:29,468 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=1ea5b692133196fdda0700a7028a36a1, REOPEN/MOVE 2023-03-06 11:55:29,468 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=1ea5b692133196fdda0700a7028a36a1, regionState=CLOSING, regionLocation=jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:29,469 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1678103729468"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678103729468"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678103729468"}]},"ts":"1678103729468"} 2023-03-06 11:55:29,470 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=68, ppid=67, state=RUNNABLE; CloseRegionProcedure 1ea5b692133196fdda0700a7028a36a1, server=jenkins-hbase5.apache.org,42547,1678103642479}] 2023-03-06 11:55:29,622 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(109): Close 1ea5b692133196fdda0700a7028a36a1 2023-03-06 11:55:29,622 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 1ea5b692133196fdda0700a7028a36a1, disabling compactions & flushes 2023-03-06 11:55:29,622 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1. 2023-03-06 11:55:29,622 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1. 2023-03-06 11:55:29,622 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1. after waiting 0 ms 2023-03-06 11:55:29,622 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1. 2023-03-06 11:55:29,627 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-03-06 11:55:29,627 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1. 2023-03-06 11:55:29,628 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 1ea5b692133196fdda0700a7028a36a1: 2023-03-06 11:55:29,628 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 1ea5b692133196fdda0700a7028a36a1 to self. 2023-03-06 11:55:29,629 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(147): Closed 1ea5b692133196fdda0700a7028a36a1 2023-03-06 11:55:29,629 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=1ea5b692133196fdda0700a7028a36a1, regionState=CLOSED 2023-03-06 11:55:29,629 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1678103729629"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678103729629"}]},"ts":"1678103729629"} 2023-03-06 11:55:29,631 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=67 2023-03-06 11:55:29,631 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=67, state=SUCCESS; CloseRegionProcedure 1ea5b692133196fdda0700a7028a36a1, server=jenkins-hbase5.apache.org,42547,1678103642479 in 160 msec 2023-03-06 11:55:29,631 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=1ea5b692133196fdda0700a7028a36a1, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase5.apache.org,42547,1678103642479; forceNewPlan=false, retain=true 2023-03-06 11:55:29,782 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=1ea5b692133196fdda0700a7028a36a1, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:29,782 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1678103729782"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678103729782"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678103729782"}]},"ts":"1678103729782"} 2023-03-06 11:55:29,784 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 1ea5b692133196fdda0700a7028a36a1, server=jenkins-hbase5.apache.org,42547,1678103642479}] 2023-03-06 11:55:29,937 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1. 2023-03-06 11:55:29,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1ea5b692133196fdda0700a7028a36a1, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1.', STARTKEY => '', ENDKEY => ''} 2023-03-06 11:55:29,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 1ea5b692133196fdda0700a7028a36a1 2023-03-06 11:55:29,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-06 11:55:29,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 1ea5b692133196fdda0700a7028a36a1 2023-03-06 11:55:29,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 1ea5b692133196fdda0700a7028a36a1 2023-03-06 11:55:29,939 INFO [StoreOpener-1ea5b692133196fdda0700a7028a36a1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 1ea5b692133196fdda0700a7028a36a1 2023-03-06 11:55:29,940 DEBUG [StoreOpener-1ea5b692133196fdda0700a7028a36a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1 2023-03-06 11:55:29,940 DEBUG [StoreOpener-1ea5b692133196fdda0700a7028a36a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1 2023-03-06 11:55:29,940 INFO [StoreOpener-1ea5b692133196fdda0700a7028a36a1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1ea5b692133196fdda0700a7028a36a1 columnFamilyName family1 2023-03-06 11:55:29,945 DEBUG [StoreOpener-1ea5b692133196fdda0700a7028a36a1-1] regionserver.HStore(539): loaded hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/38f8f907a24b4a309169f7fb8f15517c_SeqId_53_ 2023-03-06 11:55:29,948 DEBUG [StoreOpener-1ea5b692133196fdda0700a7028a36a1-1] regionserver.HStore(539): loaded hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/family1/53f967fc87b44ddb83b083a3d533304c 2023-03-06 11:55:29,948 INFO [StoreOpener-1ea5b692133196fdda0700a7028a36a1-1] regionserver.HStore(310): Store=1ea5b692133196fdda0700a7028a36a1/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-06 11:55:29,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1 2023-03-06 11:55:29,950 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1 2023-03-06 11:55:29,952 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 1ea5b692133196fdda0700a7028a36a1 2023-03-06 11:55:29,952 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 1ea5b692133196fdda0700a7028a36a1; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72226726, jitterRate=0.07626208662986755}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-06 11:55:29,952 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 1ea5b692133196fdda0700a7028a36a1: 2023-03-06 11:55:29,953 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1., pid=69, masterSystemTime=1678103729935 2023-03-06 11:55:29,954 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1. 2023-03-06 11:55:29,954 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1. 2023-03-06 11:55:29,954 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=1ea5b692133196fdda0700a7028a36a1, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:29,955 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1678103729954"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678103729954"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678103729954"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678103729954"}]},"ts":"1678103729954"} 2023-03-06 11:55:29,957 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-03-06 11:55:29,957 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 1ea5b692133196fdda0700a7028a36a1, server=jenkins-hbase5.apache.org,42547,1678103642479 in 172 msec 2023-03-06 11:55:29,958 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-03-06 11:55:29,958 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=1ea5b692133196fdda0700a7028a36a1, REOPEN/MOVE in 490 msec 2023-03-06 11:55:29,959 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=66, resume processing ppid=65 2023-03-06 11:55:29,959 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=66, ppid=65, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 494 msec 2023-03-06 11:55:29,961 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 906 msec 2023-03-06 11:55:29,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=65 2023-03-06 11:55:29,962 INFO [Listener at localhost/46717] compactions.TestMobCompactor(278): alter status finished 2023-03-06 11:55:29,963 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=36301] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-06 11:55:29,964 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] procedure2.ProcedureExecutor(1029): Stored pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-06 11:55:29,965 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-06 11:55:29,965 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-06 11:55:29,965 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=70, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678104329965 2023-03-06 11:55:29,966 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-06 11:55:29,966 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-03-06 11:55:29,967 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-06 11:55:29,967 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] zookeeper.ReadOnlyZKClient(139): Connect 0x226530fc to 127.0.0.1:62659 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-06 11:55:29,971 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1093de3d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-06 11:55:29,971 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-06 11:55:29,972 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-06 11:55:29,972 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-06 11:55:29,972 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-06 11:55:29,972 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-06 11:55:29,972 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-06 11:55:29,972 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-06 11:55:29,972 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-06 11:55:29,972 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-06 11:55:29,972 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-06 11:55:29,973 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=70, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-06 11:55:29,974 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=70, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 9 msec 2023-03-06 11:55:30,016 INFO [Listener at localhost/46717] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=249 (was 243) - Thread LEAK? -, OpenFileDescriptor=640 (was 612) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=198 (was 244), ProcessCount=160 (was 160), AvailableMemoryMB=9696 (was 9708) 2023-03-06 11:55:30,027 INFO [Listener at localhost/46717] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=249, OpenFileDescriptor=640, MaxFileDescriptor=60000, SystemLoadAverage=198, ProcessCount=160, AvailableMemoryMB=9696 2023-03-06 11:55:30,030 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.HMaster$4(2112): Client=jenkins//172.31.10.131 create 'testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-03-06 11:55:30,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testGetAfterCompaction 2023-03-06 11:55:30,032 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-03-06 11:55:30,032 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(697): Client=jenkins//172.31.10.131 procedure request for creating table: namespace: "default" qualifier: "testGetAfterCompaction" procId is: 71 2023-03-06 11:55:30,033 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-06 11:55:30,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-03-06 11:55:30,034 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb 2023-03-06 11:55:30,034 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb empty. 2023-03-06 11:55:30,034 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb 2023-03-06 11:55:30,034 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-03-06 11:55:30,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-03-06 11:55:30,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-03-06 11:55:30,442 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/default/testGetAfterCompaction/.tabledesc/.tableinfo.0000000001 2023-03-06 11:55:30,443 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1317a85e18b10578652d1a56a5364ecb, NAME => 'testGetAfterCompaction,,1678103730030.1317a85e18b10578652d1a56a5364ecb.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp 2023-03-06 11:55:30,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-03-06 11:55:30,849 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1678103730030.1317a85e18b10578652d1a56a5364ecb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-06 11:55:30,849 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1604): Closing 1317a85e18b10578652d1a56a5364ecb, disabling compactions & flushes 2023-03-06 11:55:30,849 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1678103730030.1317a85e18b10578652d1a56a5364ecb. 2023-03-06 11:55:30,849 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1678103730030.1317a85e18b10578652d1a56a5364ecb. 2023-03-06 11:55:30,849 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1678103730030.1317a85e18b10578652d1a56a5364ecb. after waiting 0 ms 2023-03-06 11:55:30,849 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1678103730030.1317a85e18b10578652d1a56a5364ecb. 2023-03-06 11:55:30,849 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1678103730030.1317a85e18b10578652d1a56a5364ecb. 2023-03-06 11:55:30,849 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1558): Region close journal for 1317a85e18b10578652d1a56a5364ecb: 2023-03-06 11:55:30,851 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-03-06 11:55:30,852 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1678103730030.1317a85e18b10578652d1a56a5364ecb.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1678103730852"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678103730852"}]},"ts":"1678103730852"} 2023-03-06 11:55:30,853 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-06 11:55:30,854 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-06 11:55:30,854 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678103730854"}]},"ts":"1678103730854"} 2023-03-06 11:55:30,855 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLING in hbase:meta 2023-03-06 11:55:30,859 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=1317a85e18b10578652d1a56a5364ecb, ASSIGN}] 2023-03-06 11:55:30,860 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=1317a85e18b10578652d1a56a5364ecb, ASSIGN 2023-03-06 11:55:30,860 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testGetAfterCompaction, region=1317a85e18b10578652d1a56a5364ecb, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,42547,1678103642479; forceNewPlan=false, retain=false 2023-03-06 11:55:31,011 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=1317a85e18b10578652d1a56a5364ecb, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:31,012 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1678103730030.1317a85e18b10578652d1a56a5364ecb.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1678103731011"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678103731011"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678103731011"}]},"ts":"1678103731011"} 2023-03-06 11:55:31,013 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=73, ppid=72, state=RUNNABLE; OpenRegionProcedure 1317a85e18b10578652d1a56a5364ecb, server=jenkins-hbase5.apache.org,42547,1678103642479}] 2023-03-06 11:55:31,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-03-06 11:55:31,167 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(128): Open testGetAfterCompaction,,1678103730030.1317a85e18b10578652d1a56a5364ecb. 2023-03-06 11:55:31,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1317a85e18b10578652d1a56a5364ecb, NAME => 'testGetAfterCompaction,,1678103730030.1317a85e18b10578652d1a56a5364ecb.', STARTKEY => '', ENDKEY => ''} 2023-03-06 11:55:31,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro with path null and priority 1073741823 2023-03-06 11:55:31,169 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro from HTD of testGetAfterCompaction successfully. 2023-03-06 11:55:31,169 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testGetAfterCompaction 1317a85e18b10578652d1a56a5364ecb 2023-03-06 11:55:31,169 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1678103730030.1317a85e18b10578652d1a56a5364ecb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-06 11:55:31,169 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 1317a85e18b10578652d1a56a5364ecb 2023-03-06 11:55:31,169 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 1317a85e18b10578652d1a56a5364ecb 2023-03-06 11:55:31,170 INFO [StoreOpener-1317a85e18b10578652d1a56a5364ecb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1317a85e18b10578652d1a56a5364ecb 2023-03-06 11:55:31,171 DEBUG [StoreOpener-1317a85e18b10578652d1a56a5364ecb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1 2023-03-06 11:55:31,171 DEBUG [StoreOpener-1317a85e18b10578652d1a56a5364ecb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1 2023-03-06 11:55:31,172 INFO [StoreOpener-1317a85e18b10578652d1a56a5364ecb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1317a85e18b10578652d1a56a5364ecb columnFamilyName f1 2023-03-06 11:55:31,173 INFO [StoreOpener-1317a85e18b10578652d1a56a5364ecb-1] regionserver.HStore(310): Store=1317a85e18b10578652d1a56a5364ecb/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-06 11:55:31,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb 2023-03-06 11:55:31,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb 2023-03-06 11:55:31,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 1317a85e18b10578652d1a56a5364ecb 2023-03-06 11:55:31,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-06 11:55:31,178 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 1317a85e18b10578652d1a56a5364ecb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68093928, jitterRate=0.014678597450256348}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-06 11:55:31,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 1317a85e18b10578652d1a56a5364ecb: 2023-03-06 11:55:31,179 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testGetAfterCompaction,,1678103730030.1317a85e18b10578652d1a56a5364ecb., pid=73, masterSystemTime=1678103731164 2023-03-06 11:55:31,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testGetAfterCompaction,,1678103730030.1317a85e18b10578652d1a56a5364ecb. 2023-03-06 11:55:31,180 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(156): Opened testGetAfterCompaction,,1678103730030.1317a85e18b10578652d1a56a5364ecb. 2023-03-06 11:55:31,181 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=1317a85e18b10578652d1a56a5364ecb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:31,181 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testGetAfterCompaction,,1678103730030.1317a85e18b10578652d1a56a5364ecb.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1678103731181"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678103731181"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678103731181"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678103731181"}]},"ts":"1678103731181"} 2023-03-06 11:55:31,183 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=72 2023-03-06 11:55:31,183 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=72, state=SUCCESS; OpenRegionProcedure 1317a85e18b10578652d1a56a5364ecb, server=jenkins-hbase5.apache.org,42547,1678103642479 in 169 msec 2023-03-06 11:55:31,184 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-03-06 11:55:31,184 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=1317a85e18b10578652d1a56a5364ecb, ASSIGN in 324 msec 2023-03-06 11:55:31,185 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-06 11:55:31,185 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678103731185"}]},"ts":"1678103731185"} 2023-03-06 11:55:31,186 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLED in hbase:meta 2023-03-06 11:55:31,188 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-03-06 11:55:31,189 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; CreateTableProcedure table=testGetAfterCompaction in 1.1580 sec 2023-03-06 11:55:31,427 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-03-06 11:55:31,427 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro Metrics about HBase RegionObservers 2023-03-06 11:55:32,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-03-06 11:55:32,138 INFO [Listener at localhost/46717] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testGetAfterCompaction, procId: 71 completed 2023-03-06 11:55:32,138 DEBUG [Listener at localhost/46717] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testGetAfterCompaction get assigned. Timeout = 60000ms 2023-03-06 11:55:32,140 INFO [Listener at localhost/46717] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-03-06 11:55:32,143 INFO [Listener at localhost/46717] hbase.HBaseTestingUtility(3484): All regions for table testGetAfterCompaction assigned to meta. Checking AM states. 2023-03-06 11:55:32,143 INFO [Listener at localhost/46717] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-03-06 11:55:32,144 INFO [Listener at localhost/46717] hbase.HBaseTestingUtility(3504): All regions for table testGetAfterCompaction assigned. 2023-03-06 11:55:32,147 INFO [Listener at localhost/46717] regionserver.HRegion(2745): Flushing 1317a85e18b10578652d1a56a5364ecb 1/1 column families, dataSize=37 B heapSize=368 B 2023-03-06 11:55:32,558 INFO [Listener at localhost/46717] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303068cc3a724ab8f4417ac24e96d6f4ee045 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202303068cc3a724ab8f4417ac24e96d6f4ee045 2023-03-06 11:55:32,964 INFO [Listener at localhost/46717] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/.tmp/f1/6918fde6279841bcb6d8287d2b651a5b 2023-03-06 11:55:32,968 DEBUG [Listener at localhost/46717] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/.tmp/f1/6918fde6279841bcb6d8287d2b651a5b as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6918fde6279841bcb6d8287d2b651a5b 2023-03-06 11:55:32,972 INFO [Listener at localhost/46717] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6918fde6279841bcb6d8287d2b651a5b, entries=1, sequenceid=5, filesize=4.9 K 2023-03-06 11:55:32,973 INFO [Listener at localhost/46717] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 1317a85e18b10578652d1a56a5364ecb in 826ms, sequenceid=5, compaction requested=false 2023-03-06 11:55:32,973 DEBUG [Listener at localhost/46717] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testGetAfterCompaction' 2023-03-06 11:55:32,973 DEBUG [Listener at localhost/46717] regionserver.HRegion(2446): Flush status journal for 1317a85e18b10578652d1a56a5364ecb: 2023-03-06 11:55:32,975 INFO [Listener at localhost/46717] regionserver.HRegion(2745): Flushing 1317a85e18b10578652d1a56a5364ecb 1/1 column families, dataSize=37 B heapSize=368 B 2023-03-06 11:55:33,335 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-06 11:55:33,387 INFO [Listener at localhost/46717] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230306762f1012b70847a98b2590e8ec27b3d4 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230306762f1012b70847a98b2590e8ec27b3d4 2023-03-06 11:55:33,399 INFO [Listener at localhost/46717] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/.tmp/f1/6346fe5d0ba949cf993c79712efadf34 2023-03-06 11:55:33,403 DEBUG [Listener at localhost/46717] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/.tmp/f1/6346fe5d0ba949cf993c79712efadf34 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6346fe5d0ba949cf993c79712efadf34 2023-03-06 11:55:33,407 INFO [Listener at localhost/46717] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6346fe5d0ba949cf993c79712efadf34, entries=1, sequenceid=9, filesize=4.9 K 2023-03-06 11:55:33,408 INFO [Listener at localhost/46717] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 1317a85e18b10578652d1a56a5364ecb in 433ms, sequenceid=9, compaction requested=false 2023-03-06 11:55:33,408 DEBUG [Listener at localhost/46717] regionserver.HRegion(2446): Flush status journal for 1317a85e18b10578652d1a56a5364ecb: 2023-03-06 11:55:33,410 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=36301] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testGetAfterCompaction 2023-03-06 11:55:33,411 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] procedure2.ProcedureExecutor(1029): Stored pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-03-06 11:55:33,412 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-03-06 11:55:33,412 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] mob.MobUtils(833): start MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-06 11:55:33,412 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=74, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678104333412 2023-03-06 11:55:33,413 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-06 11:55:33,413 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testGetAfterCompaction' and column 'f1' 2023-03-06 11:55:33,413 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testGetAfterCompaction' column='f1' 2023-03-06 11:55:33,413 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] zookeeper.ReadOnlyZKClient(139): Connect 0x571759b9 to 127.0.0.1:62659 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-06 11:55:33,417 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@597b1750, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-06 11:55:33,418 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230306 for table='testGetAfterCompaction' and column='f1' 2023-03-06 11:55:33,461 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6346fe5d0ba949cf993c79712efadf34; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103733398; access_time=1678103732977; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:33,461 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6918fde6279841bcb6d8287d2b651a5b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103732963; access_time=1678103732150; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:33,512 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6346fe5d0ba949cf993c79712efadf34; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103733398; access_time=1678103732977; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:33,512 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6918fde6279841bcb6d8287d2b651a5b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103732963; access_time=1678103732150; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:33,563 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6346fe5d0ba949cf993c79712efadf34; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103733398; access_time=1678103732977; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:33,563 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6918fde6279841bcb6d8287d2b651a5b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103732963; access_time=1678103732150; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:33,614 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6346fe5d0ba949cf993c79712efadf34; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103733398; access_time=1678103732977; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:33,614 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6918fde6279841bcb6d8287d2b651a5b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103732963; access_time=1678103732150; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:33,665 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6346fe5d0ba949cf993c79712efadf34; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103733398; access_time=1678103732977; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:33,665 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6918fde6279841bcb6d8287d2b651a5b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103732963; access_time=1678103732150; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:33,715 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6346fe5d0ba949cf993c79712efadf34; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103733398; access_time=1678103732977; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:33,715 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6918fde6279841bcb6d8287d2b651a5b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103732963; access_time=1678103732150; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:33,766 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6346fe5d0ba949cf993c79712efadf34; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103733398; access_time=1678103732977; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:33,766 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6918fde6279841bcb6d8287d2b651a5b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103732963; access_time=1678103732150; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:33,817 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6346fe5d0ba949cf993c79712efadf34; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103733398; access_time=1678103732977; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:33,817 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6918fde6279841bcb6d8287d2b651a5b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103732963; access_time=1678103732150; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:33,868 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6346fe5d0ba949cf993c79712efadf34; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103733398; access_time=1678103732977; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:33,868 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6918fde6279841bcb6d8287d2b651a5b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103732963; access_time=1678103732150; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:33,919 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6346fe5d0ba949cf993c79712efadf34; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103733398; access_time=1678103732977; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:33,919 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6918fde6279841bcb6d8287d2b651a5b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103732963; access_time=1678103732150; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:33,970 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6346fe5d0ba949cf993c79712efadf34; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103733398; access_time=1678103732977; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:33,970 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6918fde6279841bcb6d8287d2b651a5b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103732963; access_time=1678103732150; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:34,021 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6346fe5d0ba949cf993c79712efadf34; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103733398; access_time=1678103732977; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:34,021 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6918fde6279841bcb6d8287d2b651a5b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103732963; access_time=1678103732150; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:34,072 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6346fe5d0ba949cf993c79712efadf34; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103733398; access_time=1678103732977; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:34,072 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6918fde6279841bcb6d8287d2b651a5b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103732963; access_time=1678103732150; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:34,123 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6346fe5d0ba949cf993c79712efadf34; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103733398; access_time=1678103732977; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:34,123 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6918fde6279841bcb6d8287d2b651a5b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103732963; access_time=1678103732150; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:34,174 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6346fe5d0ba949cf993c79712efadf34; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103733398; access_time=1678103732977; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:34,174 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6918fde6279841bcb6d8287d2b651a5b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103732963; access_time=1678103732150; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:34,224 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6346fe5d0ba949cf993c79712efadf34; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103733398; access_time=1678103732977; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:34,225 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6918fde6279841bcb6d8287d2b651a5b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103732963; access_time=1678103732150; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:34,243 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303061a435fbf84a34f94b1e77d06cad33734 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202303061a435fbf84a34f94b1e77d06cad33734 2023-03-06 11:55:34,244 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230306 table='testGetAfterCompaction' column='f1' 2023-03-06 11:55:34,257 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-06 11:55:34,258 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:41676, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-06 11:55:34,264 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-06 11:55:34,265 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:38012, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-06 11:55:34,273 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230306/f1/38a4e4898db84678b37d338f6cf91874 first=Optional[r1] last=Optional[r2] 2023-03-06 11:55:34,273 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testGetAfterCompaction,,1678103730030.1317a85e18b10578652d1a56a5364ecb., hostname=jenkins-hbase5.apache.org,42547,1678103642479, seqNum=2 for row with hfile group [{f1,hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230306/f1/38a4e4898db84678b37d338f6cf91874}] 2023-03-06 11:55:34,275 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6346fe5d0ba949cf993c79712efadf34; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103733398; access_time=1678103732977; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:34,276 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6918fde6279841bcb6d8287d2b651a5b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103732963; access_time=1678103732150; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:34,277 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(763): Validating hfile at hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230306/f1/38a4e4898db84678b37d338f6cf91874 for inclusion in 1317a85e18b10578652d1a56a5364ecb/f1 2023-03-06 11:55:34,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-03-06 11:55:34,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(777): Region bounds: first= last= 2023-03-06 11:55:34,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegion(2446): Flush status journal for 1317a85e18b10578652d1a56a5364ecb: 2023-03-06 11:55:34,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230306/f1/38a4e4898db84678b37d338f6cf91874 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testGetAfterCompaction__tt080t7gk9k50029jdfum5uteg3jccp6iqfo4ntp3t7tb28df7jassqkmnh2r0ed/f1/38a4e4898db84678b37d338f6cf91874 2023-03-06 11:55:34,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testGetAfterCompaction__tt080t7gk9k50029jdfum5uteg3jccp6iqfo4ntp3t7tb28df7jassqkmnh2r0ed/f1/38a4e4898db84678b37d338f6cf91874 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/223c1736155b488f8d9ed643fdb959d2_SeqId_12_ 2023-03-06 11:55:34,282 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(849): Loaded HFile hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testGetAfterCompaction__tt080t7gk9k50029jdfum5uteg3jccp6iqfo4ntp3t7tb28df7jassqkmnh2r0ed/f1/38a4e4898db84678b37d338f6cf91874 into 1317a85e18b10578652d1a56a5364ecb/f1 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/223c1736155b488f8d9ed643fdb959d2_SeqId_12_ - updating store file list. 2023-03-06 11:55:34,285 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(882): Loaded HFile hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/223c1736155b488f8d9ed643fdb959d2_SeqId_12_ into 1317a85e18b10578652d1a56a5364ecb/f1 2023-03-06 11:55:34,286 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(855): Successfully loaded hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testGetAfterCompaction__tt080t7gk9k50029jdfum5uteg3jccp6iqfo4ntp3t7tb28df7jassqkmnh2r0ed/f1/38a4e4898db84678b37d338f6cf91874 into 1317a85e18b10578652d1a56a5364ecb/f1 (new location: hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/223c1736155b488f8d9ed643fdb959d2_SeqId_12_) 2023-03-06 11:55:34,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testGetAfterCompaction__tt080t7gk9k50029jdfum5uteg3jccp6iqfo4ntp3t7tb28df7jassqkmnh2r0ed/f1/38a4e4898db84678b37d338f6cf91874 2023-03-06 11:55:34,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(1912): 1317a85e18b10578652d1a56a5364ecb/f1 is initiating minor compaction 2023-03-06 11:55:34,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@150a29c; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-06 11:55:34,286 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 1317a85e18b10578652d1a56a5364ecb/f1 in testGetAfterCompaction,,1678103730030.1317a85e18b10578652d1a56a5364ecb. 2023-03-06 11:55:34,287 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6346fe5d0ba949cf993c79712efadf34, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/223c1736155b488f8d9ed643fdb959d2_SeqId_12_] into tmpdir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/.tmp, totalSize=10.0 K 2023-03-06 11:55:34,287 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting 6346fe5d0ba949cf993c79712efadf34, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-06 11:55:34,287 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting 223c1736155b488f8d9ed643fdb959d2_SeqId_12_, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-06 11:55:34,288 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230306 table='testGetAfterCompaction' column='f1' 2023-03-06 11:55:34,289 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:55:34,290 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230306762f1012b70847a98b2590e8ec27b3d4 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230306762f1012b70847a98b2590e8ec27b3d4 2023-03-06 11:55:34,292 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202303068cc3a724ab8f4417ac24e96d6f4ee045 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202303068cc3a724ab8f4417ac24e96d6f4ee045 2023-03-06 11:55:34,292 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testGetAfterCompaction 2 expired mob files are deleted 2023-03-06 11:55:34,292 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230306' 2023-03-06 11:55:34,292 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230306 for table='testGetAfterCompaction' and column='f1' 2023-03-06 11:55:34,292 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testGetAfterCompaction' column='f1' 2023-03-06 11:55:34,292 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] mob.MobUtils(840): end MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-06 11:55:34,293 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=74, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-03-06 11:55:34,295 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=74, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE in 883 msec 2023-03-06 11:55:34,312 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] throttle.PressureAwareThroughputController(145): 1317a85e18b10578652d1a56a5364ecb#f1#compaction#76 average throughput is 0.01 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-06 11:55:34,313 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x226530fc to 127.0.0.1:62659 2023-03-06 11:55:34,313 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-06 11:55:34,313 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-06 11:55:34,313 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x571759b9 to 127.0.0.1:62659 2023-03-06 11:55:34,313 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-06 11:55:34,313 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-06 11:55:34,313 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7a863fbf to 127.0.0.1:62659 2023-03-06 11:55:34,313 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-06 11:55:34,313 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-06 11:55:34,313 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2b1a2c0d to 127.0.0.1:62659 2023-03-06 11:55:34,314 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-06 11:55:34,314 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-06 11:55:34,314 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x35e3afca to 127.0.0.1:62659 2023-03-06 11:55:34,314 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-06 11:55:34,314 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2e29745f to 127.0.0.1:62659 2023-03-06 11:55:34,314 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-06 11:55:34,314 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-06 11:55:34,314 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7b445c68 to 127.0.0.1:62659 2023-03-06 11:55:34,314 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-06 11:55:34,326 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/223c1736155b488f8d9ed643fdb959d2_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678103734239; access_time=1678103733428; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-06 11:55:34,327 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6346fe5d0ba949cf993c79712efadf34; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103733398; access_time=1678103732977; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:34,327 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6918fde6279841bcb6d8287d2b651a5b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103732963; access_time=1678103732150; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:34,330 DEBUG [Listener at localhost/46717] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-03-06 11:55:34,333 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:41692, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-03-06 11:55:34,333 INFO [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=42547] regionserver.RSRpcServices(1662): Compacting testGetAfterCompaction,,1678103730030.1317a85e18b10578652d1a56a5364ecb. 2023-03-06 11:55:34,334 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=42547] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 2 compacting, 0 eligible, 16 blocking 2023-03-06 11:55:34,334 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=42547] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-03-06 11:55:34,334 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=42547] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-03-06 11:55:34,334 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=42547] regionserver.CompactSplit(415): Not compacting testGetAfterCompaction,,1678103730030.1317a85e18b10578652d1a56a5364ecb. because compaction request was cancelled 2023-03-06 11:55:34,385 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/223c1736155b488f8d9ed643fdb959d2_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678103734239; access_time=1678103733428; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-06 11:55:34,385 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6346fe5d0ba949cf993c79712efadf34; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103733398; access_time=1678103732977; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:34,385 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6918fde6279841bcb6d8287d2b651a5b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103732963; access_time=1678103732150; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:34,436 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/223c1736155b488f8d9ed643fdb959d2_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678103734239; access_time=1678103733428; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-06 11:55:34,436 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6346fe5d0ba949cf993c79712efadf34; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103733398; access_time=1678103732977; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:34,436 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6918fde6279841bcb6d8287d2b651a5b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103732963; access_time=1678103732150; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:34,487 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/223c1736155b488f8d9ed643fdb959d2_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678103734239; access_time=1678103733428; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-06 11:55:34,487 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6346fe5d0ba949cf993c79712efadf34; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103733398; access_time=1678103732977; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:34,487 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6918fde6279841bcb6d8287d2b651a5b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103732963; access_time=1678103732150; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:34,538 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/223c1736155b488f8d9ed643fdb959d2_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678103734239; access_time=1678103733428; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-06 11:55:34,538 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6346fe5d0ba949cf993c79712efadf34; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103733398; access_time=1678103732977; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:34,538 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6918fde6279841bcb6d8287d2b651a5b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103732963; access_time=1678103732150; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:34,589 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/223c1736155b488f8d9ed643fdb959d2_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678103734239; access_time=1678103733428; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-06 11:55:34,589 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6346fe5d0ba949cf993c79712efadf34; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103733398; access_time=1678103732977; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:34,589 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6918fde6279841bcb6d8287d2b651a5b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103732963; access_time=1678103732150; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:34,640 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/223c1736155b488f8d9ed643fdb959d2_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678103734239; access_time=1678103733428; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-06 11:55:34,640 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6346fe5d0ba949cf993c79712efadf34; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103733398; access_time=1678103732977; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:34,640 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6918fde6279841bcb6d8287d2b651a5b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103732963; access_time=1678103732150; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:34,690 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/223c1736155b488f8d9ed643fdb959d2_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678103734239; access_time=1678103733428; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-06 11:55:34,691 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6346fe5d0ba949cf993c79712efadf34; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103733398; access_time=1678103732977; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:34,691 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6918fde6279841bcb6d8287d2b651a5b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103732963; access_time=1678103732150; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:34,741 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/223c1736155b488f8d9ed643fdb959d2_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678103734239; access_time=1678103733428; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-06 11:55:34,741 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6346fe5d0ba949cf993c79712efadf34; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103733398; access_time=1678103732977; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:34,741 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6918fde6279841bcb6d8287d2b651a5b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103732963; access_time=1678103732150; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:34,792 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/223c1736155b488f8d9ed643fdb959d2_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678103734239; access_time=1678103733428; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-06 11:55:34,792 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6346fe5d0ba949cf993c79712efadf34; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103733398; access_time=1678103732977; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:34,792 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6918fde6279841bcb6d8287d2b651a5b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103732963; access_time=1678103732150; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:34,843 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/223c1736155b488f8d9ed643fdb959d2_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678103734239; access_time=1678103733428; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-06 11:55:34,843 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6346fe5d0ba949cf993c79712efadf34; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103733398; access_time=1678103732977; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:34,843 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6918fde6279841bcb6d8287d2b651a5b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103732963; access_time=1678103732150; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:34,894 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/223c1736155b488f8d9ed643fdb959d2_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678103734239; access_time=1678103733428; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-06 11:55:34,894 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6346fe5d0ba949cf993c79712efadf34; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103733398; access_time=1678103732977; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:34,894 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6918fde6279841bcb6d8287d2b651a5b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103732963; access_time=1678103732150; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:34,945 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/223c1736155b488f8d9ed643fdb959d2_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678103734239; access_time=1678103733428; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-06 11:55:34,945 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6346fe5d0ba949cf993c79712efadf34; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103733398; access_time=1678103732977; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:34,945 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6918fde6279841bcb6d8287d2b651a5b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103732963; access_time=1678103732150; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:34,996 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/223c1736155b488f8d9ed643fdb959d2_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678103734239; access_time=1678103733428; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-06 11:55:34,996 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6346fe5d0ba949cf993c79712efadf34; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103733398; access_time=1678103732977; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:34,996 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6918fde6279841bcb6d8287d2b651a5b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103732963; access_time=1678103732150; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:35,046 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/223c1736155b488f8d9ed643fdb959d2_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678103734239; access_time=1678103733428; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-06 11:55:35,047 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6346fe5d0ba949cf993c79712efadf34; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103733398; access_time=1678103732977; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:35,047 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6918fde6279841bcb6d8287d2b651a5b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103732963; access_time=1678103732150; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:35,097 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/223c1736155b488f8d9ed643fdb959d2_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678103734239; access_time=1678103733428; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-06 11:55:35,097 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6346fe5d0ba949cf993c79712efadf34; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103733398; access_time=1678103732977; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:35,097 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6918fde6279841bcb6d8287d2b651a5b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103732963; access_time=1678103732150; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:35,125 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/.tmp/f1/2599c6f7d3ae41359a463fb2ce3625b8 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/2599c6f7d3ae41359a463fb2ce3625b8 2023-03-06 11:55:35,130 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 2 file(s) in 1317a85e18b10578652d1a56a5364ecb/f1 of 1317a85e18b10578652d1a56a5364ecb into 2599c6f7d3ae41359a463fb2ce3625b8(size=5.1 K), total size for store is 10.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-06 11:55:35,130 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 1317a85e18b10578652d1a56a5364ecb: 2023-03-06 11:55:35,130 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testGetAfterCompaction,,1678103730030.1317a85e18b10578652d1a56a5364ecb., storeName=f1, fileCount=2, fileSize=10.0 K (4.9 K, 5.1 K), priority=2, time=1678103734286; duration=0sec 2023-03-06 11:55:35,130 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-06 11:55:35,148 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/223c1736155b488f8d9ed643fdb959d2_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678103734239; access_time=1678103733428; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-06 11:55:35,148 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/2599c6f7d3ae41359a463fb2ce3625b8; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1678103735121; access_time=1678103734291; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:35,148 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6346fe5d0ba949cf993c79712efadf34; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103733398; access_time=1678103732977; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:35,148 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6918fde6279841bcb6d8287d2b651a5b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103732963; access_time=1678103732150; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:35,199 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/223c1736155b488f8d9ed643fdb959d2_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678103734239; access_time=1678103733428; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-06 11:55:35,199 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/2599c6f7d3ae41359a463fb2ce3625b8; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1678103735121; access_time=1678103734291; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:35,199 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6346fe5d0ba949cf993c79712efadf34; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103733398; access_time=1678103732977; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:35,199 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6918fde6279841bcb6d8287d2b651a5b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103732963; access_time=1678103732150; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:35,208 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6346fe5d0ba949cf993c79712efadf34, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/223c1736155b488f8d9ed643fdb959d2_SeqId_12_] to archive 2023-03-06 11:55:35,208 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:55:35,210 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6346fe5d0ba949cf993c79712efadf34 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6346fe5d0ba949cf993c79712efadf34 2023-03-06 11:55:35,211 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/223c1736155b488f8d9ed643fdb959d2_SeqId_12_ to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/223c1736155b488f8d9ed643fdb959d2_SeqId_12_ 2023-03-06 11:55:35,250 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/2599c6f7d3ae41359a463fb2ce3625b8; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1678103735121; access_time=1678103734291; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:35,250 INFO [Listener at localhost/46717] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6918fde6279841bcb6d8287d2b651a5b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678103732963; access_time=1678103732150; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-06 11:55:35,365 INFO [Listener at localhost/46717] client.HBaseAdmin$15(890): Started disable of testGetAfterCompaction 2023-03-06 11:55:35,370 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.HMaster$11(2418): Client=jenkins//172.31.10.131 disable testGetAfterCompaction 2023-03-06 11:55:35,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure2.ProcedureExecutor(1029): Stored pid=75, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testGetAfterCompaction 2023-03-06 11:55:35,381 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678103735381"}]},"ts":"1678103735381"} 2023-03-06 11:55:35,382 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLING in hbase:meta 2023-03-06 11:55:35,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-03-06 11:55:35,384 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testGetAfterCompaction to state=DISABLING 2023-03-06 11:55:35,385 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=1317a85e18b10578652d1a56a5364ecb, UNASSIGN}] 2023-03-06 11:55:35,385 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=1317a85e18b10578652d1a56a5364ecb, UNASSIGN 2023-03-06 11:55:35,386 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=1317a85e18b10578652d1a56a5364ecb, regionState=CLOSING, regionLocation=jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:35,386 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1678103730030.1317a85e18b10578652d1a56a5364ecb.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1678103735386"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678103735386"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678103735386"}]},"ts":"1678103735386"} 2023-03-06 11:55:35,387 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; CloseRegionProcedure 1317a85e18b10578652d1a56a5364ecb, server=jenkins-hbase5.apache.org,42547,1678103642479}] 2023-03-06 11:55:35,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-03-06 11:55:35,539 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(109): Close 1317a85e18b10578652d1a56a5364ecb 2023-03-06 11:55:35,539 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 1317a85e18b10578652d1a56a5364ecb, disabling compactions & flushes 2023-03-06 11:55:35,539 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1678103730030.1317a85e18b10578652d1a56a5364ecb. 2023-03-06 11:55:35,539 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1678103730030.1317a85e18b10578652d1a56a5364ecb. 2023-03-06 11:55:35,539 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1678103730030.1317a85e18b10578652d1a56a5364ecb. after waiting 0 ms 2023-03-06 11:55:35,540 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1678103730030.1317a85e18b10578652d1a56a5364ecb. 2023-03-06 11:55:35,543 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-03-06 11:55:35,544 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-03-06 11:55:35,545 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1678103730030.1317a85e18b10578652d1a56a5364ecb. 2023-03-06 11:55:35,545 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 1317a85e18b10578652d1a56a5364ecb: 2023-03-06 11:55:35,546 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(147): Closed 1317a85e18b10578652d1a56a5364ecb 2023-03-06 11:55:35,546 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=1317a85e18b10578652d1a56a5364ecb, regionState=CLOSED 2023-03-06 11:55:35,546 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1678103730030.1317a85e18b10578652d1a56a5364ecb.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1678103735546"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678103735546"}]},"ts":"1678103735546"} 2023-03-06 11:55:35,549 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-03-06 11:55:35,549 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; CloseRegionProcedure 1317a85e18b10578652d1a56a5364ecb, server=jenkins-hbase5.apache.org,42547,1678103642479 in 161 msec 2023-03-06 11:55:35,550 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=75 2023-03-06 11:55:35,550 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=75, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=1317a85e18b10578652d1a56a5364ecb, UNASSIGN in 164 msec 2023-03-06 11:55:35,550 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678103735550"}]},"ts":"1678103735550"} 2023-03-06 11:55:35,551 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLED in hbase:meta 2023-03-06 11:55:35,553 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testGetAfterCompaction to state=DISABLED 2023-03-06 11:55:35,554 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=75, state=SUCCESS; DisableTableProcedure table=testGetAfterCompaction in 181 msec 2023-03-06 11:55:35,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-03-06 11:55:35,685 INFO [Listener at localhost/46717] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testGetAfterCompaction, procId: 75 completed 2023-03-06 11:55:35,689 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.HMaster$5(2228): Client=jenkins//172.31.10.131 delete testGetAfterCompaction 2023-03-06 11:55:35,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testGetAfterCompaction 2023-03-06 11:55:35,696 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-03-06 11:55:35,697 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=78, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-03-06 11:55:35,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=78 2023-03-06 11:55:35,700 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb 2023-03-06 11:55:35,702 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1, FileablePath, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/recovered.edits] 2023-03-06 11:55:35,705 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/2599c6f7d3ae41359a463fb2ce3625b8 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/2599c6f7d3ae41359a463fb2ce3625b8 2023-03-06 11:55:35,706 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6918fde6279841bcb6d8287d2b651a5b to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/f1/6918fde6279841bcb6d8287d2b651a5b 2023-03-06 11:55:35,708 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/recovered.edits/15.seqid to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb/recovered.edits/15.seqid 2023-03-06 11:55:35,708 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/default/testGetAfterCompaction/1317a85e18b10578652d1a56a5364ecb 2023-03-06 11:55:35,708 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-03-06 11:55:35,709 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-03-06 11:55:35,709 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1] 2023-03-06 11:55:35,712 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202303061a435fbf84a34f94b1e77d06cad33734 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202303061a435fbf84a34f94b1e77d06cad33734 2023-03-06 11:55:35,713 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-03-06 11:55:35,714 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=78, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-03-06 11:55:35,737 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testGetAfterCompaction from hbase:meta 2023-03-06 11:55:35,739 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testGetAfterCompaction' descriptor. 2023-03-06 11:55:35,740 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=78, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-03-06 11:55:35,740 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testGetAfterCompaction' from region states. 2023-03-06 11:55:35,740 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction,,1678103730030.1317a85e18b10578652d1a56a5364ecb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1678103735740"}]},"ts":"9223372036854775807"} 2023-03-06 11:55:35,742 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-03-06 11:55:35,742 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 1317a85e18b10578652d1a56a5364ecb, NAME => 'testGetAfterCompaction,,1678103730030.1317a85e18b10578652d1a56a5364ecb.', STARTKEY => '', ENDKEY => ''}] 2023-03-06 11:55:35,742 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testGetAfterCompaction' as deleted. 2023-03-06 11:55:35,742 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1678103735742"}]},"ts":"9223372036854775807"} 2023-03-06 11:55:35,743 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testGetAfterCompaction state from META 2023-03-06 11:55:35,746 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=78, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-03-06 11:55:35,747 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; DeleteTableProcedure table=testGetAfterCompaction in 56 msec 2023-03-06 11:55:35,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=78 2023-03-06 11:55:35,799 INFO [Listener at localhost/46717] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testGetAfterCompaction, procId: 78 completed 2023-03-06 11:55:35,811 INFO [Listener at localhost/46717] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=229 (was 249), OpenFileDescriptor=588 (was 640), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=182 (was 198), ProcessCount=160 (was 160), AvailableMemoryMB=9656 (was 9696) 2023-03-06 11:55:35,821 INFO [Listener at localhost/46717] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=229, OpenFileDescriptor=588, MaxFileDescriptor=60000, SystemLoadAverage=182, ProcessCount=160, AvailableMemoryMB=9656 2023-03-06 11:55:35,823 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.HMaster$4(2112): Client=jenkins//172.31.10.131 create 'testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-03-06 11:55:35,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testCompactionWithHFileLink 2023-03-06 11:55:35,824 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_PRE_OPERATION 2023-03-06 11:55:35,825 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(697): Client=jenkins//172.31.10.131 procedure request for creating table: namespace: "default" qualifier: "testCompactionWithHFileLink" procId is: 79 2023-03-06 11:55:35,825 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-06 11:55:35,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-03-06 11:55:35,827 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d 2023-03-06 11:55:35,827 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c 2023-03-06 11:55:35,827 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e 2023-03-06 11:55:35,827 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d empty. 2023-03-06 11:55:35,827 DEBUG [HFileArchiver-14] backup.HFileArchiver(153): Directory hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c empty. 2023-03-06 11:55:35,827 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e empty. 2023-03-06 11:55:35,828 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d 2023-03-06 11:55:35,828 DEBUG [HFileArchiver-14] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c 2023-03-06 11:55:35,828 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e 2023-03-06 11:55:35,828 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testCompactionWithHFileLink regions 2023-03-06 11:55:35,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-03-06 11:55:36,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-03-06 11:55:36,234 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-03-06 11:55:36,236 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(7675): creating {ENCODED => c2cfe3f574de2acbbfc1556c57115d2d, NAME => 'testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp 2023-03-06 11:55:36,236 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(7675): creating {ENCODED => b28bd01ac58b51da722995493250192e, NAME => 'testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp 2023-03-06 11:55:36,236 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(7675): creating {ENCODED => 2f269067b173a7b6fd05253fc30eb70c, NAME => 'testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp 2023-03-06 11:55:36,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-03-06 11:55:36,648 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-06 11:55:36,648 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1604): Closing b28bd01ac58b51da722995493250192e, disabling compactions & flushes 2023-03-06 11:55:36,648 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e. 2023-03-06 11:55:36,648 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e. 2023-03-06 11:55:36,648 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e. after waiting 0 ms 2023-03-06 11:55:36,648 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e. 2023-03-06 11:55:36,648 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e. 2023-03-06 11:55:36,648 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1558): Region close journal for b28bd01ac58b51da722995493250192e: 2023-03-06 11:55:36,649 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-06 11:55:36,649 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1604): Closing 2f269067b173a7b6fd05253fc30eb70c, disabling compactions & flushes 2023-03-06 11:55:36,649 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c. 2023-03-06 11:55:36,649 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c. 2023-03-06 11:55:36,649 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c. after waiting 0 ms 2023-03-06 11:55:36,649 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c. 2023-03-06 11:55:36,649 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-06 11:55:36,649 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c. 2023-03-06 11:55:36,649 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1604): Closing c2cfe3f574de2acbbfc1556c57115d2d, disabling compactions & flushes 2023-03-06 11:55:36,649 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1558): Region close journal for 2f269067b173a7b6fd05253fc30eb70c: 2023-03-06 11:55:36,649 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d. 2023-03-06 11:55:36,649 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d. 2023-03-06 11:55:36,649 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d. after waiting 0 ms 2023-03-06 11:55:36,649 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d. 2023-03-06 11:55:36,650 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d. 2023-03-06 11:55:36,650 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1558): Region close journal for c2cfe3f574de2acbbfc1556c57115d2d: 2023-03-06 11:55:36,652 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ADD_TO_META 2023-03-06 11:55:36,653 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678103736653"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678103736653"}]},"ts":"1678103736653"} 2023-03-06 11:55:36,653 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678103736653"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678103736653"}]},"ts":"1678103736653"} 2023-03-06 11:55:36,653 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678103736653"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678103736653"}]},"ts":"1678103736653"} 2023-03-06 11:55:36,655 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-03-06 11:55:36,656 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-06 11:55:36,656 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678103736656"}]},"ts":"1678103736656"} 2023-03-06 11:55:36,657 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-03-06 11:55:36,661 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c2cfe3f574de2acbbfc1556c57115d2d, ASSIGN}, {pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=2f269067b173a7b6fd05253fc30eb70c, ASSIGN}, {pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b28bd01ac58b51da722995493250192e, ASSIGN}] 2023-03-06 11:55:36,663 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=2f269067b173a7b6fd05253fc30eb70c, ASSIGN 2023-03-06 11:55:36,663 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c2cfe3f574de2acbbfc1556c57115d2d, ASSIGN 2023-03-06 11:55:36,663 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b28bd01ac58b51da722995493250192e, ASSIGN 2023-03-06 11:55:36,663 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=2f269067b173a7b6fd05253fc30eb70c, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,42547,1678103642479; forceNewPlan=false, retain=false 2023-03-06 11:55:36,663 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c2cfe3f574de2acbbfc1556c57115d2d, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,42547,1678103642479; forceNewPlan=false, retain=false 2023-03-06 11:55:36,663 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b28bd01ac58b51da722995493250192e, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,42547,1678103642479; forceNewPlan=false, retain=false 2023-03-06 11:55:36,815 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=b28bd01ac58b51da722995493250192e, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:36,815 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=c2cfe3f574de2acbbfc1556c57115d2d, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:36,815 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=2f269067b173a7b6fd05253fc30eb70c, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:36,815 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678103736815"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678103736815"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678103736815"}]},"ts":"1678103736815"} 2023-03-06 11:55:36,815 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678103736815"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678103736815"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678103736815"}]},"ts":"1678103736815"} 2023-03-06 11:55:36,815 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678103736815"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678103736815"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678103736815"}]},"ts":"1678103736815"} 2023-03-06 11:55:36,816 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=83, ppid=82, state=RUNNABLE; OpenRegionProcedure b28bd01ac58b51da722995493250192e, server=jenkins-hbase5.apache.org,42547,1678103642479}] 2023-03-06 11:55:36,817 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=84, ppid=80, state=RUNNABLE; OpenRegionProcedure c2cfe3f574de2acbbfc1556c57115d2d, server=jenkins-hbase5.apache.org,42547,1678103642479}] 2023-03-06 11:55:36,818 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=81, state=RUNNABLE; OpenRegionProcedure 2f269067b173a7b6fd05253fc30eb70c, server=jenkins-hbase5.apache.org,42547,1678103642479}] 2023-03-06 11:55:36,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-03-06 11:55:36,972 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d. 2023-03-06 11:55:36,972 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c2cfe3f574de2acbbfc1556c57115d2d, NAME => 'testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d.', STARTKEY => '', ENDKEY => '1'} 2023-03-06 11:55:36,972 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink c2cfe3f574de2acbbfc1556c57115d2d 2023-03-06 11:55:36,972 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-06 11:55:36,972 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for c2cfe3f574de2acbbfc1556c57115d2d 2023-03-06 11:55:36,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for c2cfe3f574de2acbbfc1556c57115d2d 2023-03-06 11:55:36,974 INFO [StoreOpener-c2cfe3f574de2acbbfc1556c57115d2d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c2cfe3f574de2acbbfc1556c57115d2d 2023-03-06 11:55:36,975 DEBUG [StoreOpener-c2cfe3f574de2acbbfc1556c57115d2d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1 2023-03-06 11:55:36,975 DEBUG [StoreOpener-c2cfe3f574de2acbbfc1556c57115d2d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1 2023-03-06 11:55:36,975 INFO [StoreOpener-c2cfe3f574de2acbbfc1556c57115d2d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c2cfe3f574de2acbbfc1556c57115d2d columnFamilyName family1 2023-03-06 11:55:36,977 INFO [StoreOpener-c2cfe3f574de2acbbfc1556c57115d2d-1] regionserver.HStore(310): Store=c2cfe3f574de2acbbfc1556c57115d2d/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-06 11:55:36,977 INFO [StoreOpener-c2cfe3f574de2acbbfc1556c57115d2d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region c2cfe3f574de2acbbfc1556c57115d2d 2023-03-06 11:55:36,978 DEBUG [StoreOpener-c2cfe3f574de2acbbfc1556c57115d2d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family2 2023-03-06 11:55:36,978 DEBUG [StoreOpener-c2cfe3f574de2acbbfc1556c57115d2d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family2 2023-03-06 11:55:36,978 INFO [StoreOpener-c2cfe3f574de2acbbfc1556c57115d2d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c2cfe3f574de2acbbfc1556c57115d2d columnFamilyName family2 2023-03-06 11:55:36,979 INFO [StoreOpener-c2cfe3f574de2acbbfc1556c57115d2d-1] regionserver.HStore(310): Store=c2cfe3f574de2acbbfc1556c57115d2d/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-06 11:55:36,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d 2023-03-06 11:55:36,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d 2023-03-06 11:55:36,982 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-06 11:55:36,983 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for c2cfe3f574de2acbbfc1556c57115d2d 2023-03-06 11:55:36,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-06 11:55:36,985 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened c2cfe3f574de2acbbfc1556c57115d2d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63656597, jitterRate=-0.05144278705120087}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-06 11:55:36,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for c2cfe3f574de2acbbfc1556c57115d2d: 2023-03-06 11:55:36,986 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d., pid=84, masterSystemTime=1678103736969 2023-03-06 11:55:36,987 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d. 2023-03-06 11:55:36,987 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d. 2023-03-06 11:55:36,987 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e. 2023-03-06 11:55:36,987 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b28bd01ac58b51da722995493250192e, NAME => 'testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e.', STARTKEY => '2', ENDKEY => ''} 2023-03-06 11:55:36,988 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=c2cfe3f574de2acbbfc1556c57115d2d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:36,988 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink b28bd01ac58b51da722995493250192e 2023-03-06 11:55:36,988 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678103736987"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678103736987"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678103736987"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678103736987"}]},"ts":"1678103736987"} 2023-03-06 11:55:36,988 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-06 11:55:36,988 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for b28bd01ac58b51da722995493250192e 2023-03-06 11:55:36,988 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for b28bd01ac58b51da722995493250192e 2023-03-06 11:55:36,989 INFO [StoreOpener-b28bd01ac58b51da722995493250192e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region b28bd01ac58b51da722995493250192e 2023-03-06 11:55:36,990 DEBUG [StoreOpener-b28bd01ac58b51da722995493250192e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1 2023-03-06 11:55:36,990 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=84, resume processing ppid=80 2023-03-06 11:55:36,990 DEBUG [StoreOpener-b28bd01ac58b51da722995493250192e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1 2023-03-06 11:55:36,990 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=84, ppid=80, state=SUCCESS; OpenRegionProcedure c2cfe3f574de2acbbfc1556c57115d2d, server=jenkins-hbase5.apache.org,42547,1678103642479 in 172 msec 2023-03-06 11:55:36,991 INFO [StoreOpener-b28bd01ac58b51da722995493250192e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b28bd01ac58b51da722995493250192e columnFamilyName family1 2023-03-06 11:55:36,991 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=80, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c2cfe3f574de2acbbfc1556c57115d2d, ASSIGN in 330 msec 2023-03-06 11:55:36,992 INFO [StoreOpener-b28bd01ac58b51da722995493250192e-1] regionserver.HStore(310): Store=b28bd01ac58b51da722995493250192e/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-06 11:55:36,992 INFO [StoreOpener-b28bd01ac58b51da722995493250192e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region b28bd01ac58b51da722995493250192e 2023-03-06 11:55:36,993 DEBUG [StoreOpener-b28bd01ac58b51da722995493250192e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family2 2023-03-06 11:55:36,993 DEBUG [StoreOpener-b28bd01ac58b51da722995493250192e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family2 2023-03-06 11:55:36,994 INFO [StoreOpener-b28bd01ac58b51da722995493250192e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b28bd01ac58b51da722995493250192e columnFamilyName family2 2023-03-06 11:55:36,994 INFO [StoreOpener-b28bd01ac58b51da722995493250192e-1] regionserver.HStore(310): Store=b28bd01ac58b51da722995493250192e/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-06 11:55:36,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e 2023-03-06 11:55:36,996 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e 2023-03-06 11:55:36,997 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-06 11:55:36,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for b28bd01ac58b51da722995493250192e 2023-03-06 11:55:37,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-06 11:55:37,000 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened b28bd01ac58b51da722995493250192e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72276505, jitterRate=0.0770038515329361}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-06 11:55:37,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for b28bd01ac58b51da722995493250192e: 2023-03-06 11:55:37,001 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e., pid=83, masterSystemTime=1678103736969 2023-03-06 11:55:37,002 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e. 2023-03-06 11:55:37,002 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e. 2023-03-06 11:55:37,002 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c. 2023-03-06 11:55:37,002 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2f269067b173a7b6fd05253fc30eb70c, NAME => 'testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c.', STARTKEY => '1', ENDKEY => '2'} 2023-03-06 11:55:37,003 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=b28bd01ac58b51da722995493250192e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:37,003 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678103737002"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678103737002"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678103737002"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678103737002"}]},"ts":"1678103737002"} 2023-03-06 11:55:37,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 2f269067b173a7b6fd05253fc30eb70c 2023-03-06 11:55:37,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-06 11:55:37,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 2f269067b173a7b6fd05253fc30eb70c 2023-03-06 11:55:37,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 2f269067b173a7b6fd05253fc30eb70c 2023-03-06 11:55:37,004 INFO [StoreOpener-2f269067b173a7b6fd05253fc30eb70c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 2f269067b173a7b6fd05253fc30eb70c 2023-03-06 11:55:37,005 DEBUG [StoreOpener-2f269067b173a7b6fd05253fc30eb70c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1 2023-03-06 11:55:37,005 DEBUG [StoreOpener-2f269067b173a7b6fd05253fc30eb70c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1 2023-03-06 11:55:37,005 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=83, resume processing ppid=82 2023-03-06 11:55:37,006 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=83, ppid=82, state=SUCCESS; OpenRegionProcedure b28bd01ac58b51da722995493250192e, server=jenkins-hbase5.apache.org,42547,1678103642479 in 188 msec 2023-03-06 11:55:37,006 INFO [StoreOpener-2f269067b173a7b6fd05253fc30eb70c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2f269067b173a7b6fd05253fc30eb70c columnFamilyName family1 2023-03-06 11:55:37,006 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b28bd01ac58b51da722995493250192e, ASSIGN in 344 msec 2023-03-06 11:55:37,007 INFO [StoreOpener-2f269067b173a7b6fd05253fc30eb70c-1] regionserver.HStore(310): Store=2f269067b173a7b6fd05253fc30eb70c/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-06 11:55:37,007 INFO [StoreOpener-2f269067b173a7b6fd05253fc30eb70c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 2f269067b173a7b6fd05253fc30eb70c 2023-03-06 11:55:37,008 DEBUG [StoreOpener-2f269067b173a7b6fd05253fc30eb70c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family2 2023-03-06 11:55:37,008 DEBUG [StoreOpener-2f269067b173a7b6fd05253fc30eb70c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family2 2023-03-06 11:55:37,008 INFO [StoreOpener-2f269067b173a7b6fd05253fc30eb70c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2f269067b173a7b6fd05253fc30eb70c columnFamilyName family2 2023-03-06 11:55:37,009 INFO [StoreOpener-2f269067b173a7b6fd05253fc30eb70c-1] regionserver.HStore(310): Store=2f269067b173a7b6fd05253fc30eb70c/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-06 11:55:37,010 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c 2023-03-06 11:55:37,010 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c 2023-03-06 11:55:37,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-06 11:55:37,013 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 2f269067b173a7b6fd05253fc30eb70c 2023-03-06 11:55:37,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-06 11:55:37,015 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 2f269067b173a7b6fd05253fc30eb70c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72116942, jitterRate=0.07462617754936218}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-06 11:55:37,015 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 2f269067b173a7b6fd05253fc30eb70c: 2023-03-06 11:55:37,015 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c., pid=85, masterSystemTime=1678103736969 2023-03-06 11:55:37,017 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c. 2023-03-06 11:55:37,017 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c. 2023-03-06 11:55:37,017 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=2f269067b173a7b6fd05253fc30eb70c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:37,017 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678103737017"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678103737017"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678103737017"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678103737017"}]},"ts":"1678103737017"} 2023-03-06 11:55:37,019 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=81 2023-03-06 11:55:37,020 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=81, state=SUCCESS; OpenRegionProcedure 2f269067b173a7b6fd05253fc30eb70c, server=jenkins-hbase5.apache.org,42547,1678103642479 in 201 msec 2023-03-06 11:55:37,021 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=79 2023-03-06 11:55:37,021 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=2f269067b173a7b6fd05253fc30eb70c, ASSIGN in 360 msec 2023-03-06 11:55:37,021 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-06 11:55:37,021 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678103737021"}]},"ts":"1678103737021"} 2023-03-06 11:55:37,022 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-03-06 11:55:37,024 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_POST_OPERATION 2023-03-06 11:55:37,025 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; CreateTableProcedure table=testCompactionWithHFileLink in 1.2010 sec 2023-03-06 11:55:37,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-03-06 11:55:37,930 INFO [Listener at localhost/46717] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testCompactionWithHFileLink, procId: 79 completed 2023-03-06 11:55:37,936 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d. with WAL disabled. Data may be lost in the event of a crash. 2023-03-06 11:55:37,937 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c. with WAL disabled. Data may be lost in the event of a crash. 2023-03-06 11:55:37,938 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e. with WAL disabled. Data may be lost in the event of a crash. 2023-03-06 11:55:37,941 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:55:37,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-03-06 11:55:37,942 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-03-06 11:55:37,943 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:55:37,943 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-03-06 11:55:37,943 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-03-06 11:55:37,943 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-06 11:55:37,943 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-06 11:55:37,944 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:37,944 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:55:37,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:55:37,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:55:37,944 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:37,944 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:55:37,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-06 11:55:37,945 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-06 11:55:37,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:55:37,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-06 11:55:37,945 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-03-06 11:55:37,945 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-03-06 11:55:37,945 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-03-06 11:55:37,945 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:55:37,945 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-03-06 11:55:37,946 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c. 2023-03-06 11:55:37,947 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c. started... 2023-03-06 11:55:37,947 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-06 11:55:37,947 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:55:37,947 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d. 2023-03-06 11:55:37,947 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2f269067b173a7b6fd05253fc30eb70c 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-06 11:55:37,947 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e. 2023-03-06 11:55:37,947 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d. started... 2023-03-06 11:55:37,947 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e. started... 2023-03-06 11:55:37,948 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing c2cfe3f574de2acbbfc1556c57115d2d 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-06 11:55:37,948 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing b28bd01ac58b51da722995493250192e 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-06 11:55:37,965 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023030624719d5ccbd74c628d8cbe46fee355ec to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023030624719d5ccbd74c628d8cbe46fee355ec 2023-03-06 11:55:38,363 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230306bf7eb4a9b83846bc8bf24136a7371f4b to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230306bf7eb4a9b83846bc8bf24136a7371f4b 2023-03-06 11:55:38,365 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023030660002a2d456d4adc97635b1c16827677 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023030660002a2d456d4adc97635b1c16827677 2023-03-06 11:55:38,370 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/.tmp/family1/521f7fea656f4bf0a6a34619819b9b96 2023-03-06 11:55:38,768 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/.tmp/family1/306a91a6892045909bfd8d2fa20e3d07 2023-03-06 11:55:38,769 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/.tmp/family1/aea0facd213e46c3ba7bc1001528645c 2023-03-06 11:55:38,784 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230306580e8ed3672b4323909e44292ca88dde to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230306580e8ed3672b4323909e44292ca88dde 2023-03-06 11:55:38,785 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303063403272ee76f45199997f59c1fef7702 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303063403272ee76f45199997f59c1fef7702 2023-03-06 11:55:38,785 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230306e772a8abe265475db42ce95e912e519c to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230306e772a8abe265475db42ce95e912e519c 2023-03-06 11:55:38,789 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/.tmp/family2/9b48e09b8f7b4159847efb67f49fece1 2023-03-06 11:55:38,792 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/.tmp/family1/306a91a6892045909bfd8d2fa20e3d07 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/306a91a6892045909bfd8d2fa20e3d07 2023-03-06 11:55:38,795 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/306a91a6892045909bfd8d2fa20e3d07, entries=4, sequenceid=5, filesize=5.4 K 2023-03-06 11:55:38,796 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/.tmp/family2/9b48e09b8f7b4159847efb67f49fece1 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family2/9b48e09b8f7b4159847efb67f49fece1 2023-03-06 11:55:38,799 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family2/9b48e09b8f7b4159847efb67f49fece1, entries=2, sequenceid=5, filesize=5.1 K 2023-03-06 11:55:38,799 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 2f269067b173a7b6fd05253fc30eb70c in 852ms, sequenceid=5, compaction requested=false 2023-03-06 11:55:38,800 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-03-06 11:55:38,800 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2f269067b173a7b6fd05253fc30eb70c: 2023-03-06 11:55:38,800 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c. 2023-03-06 11:55:38,800 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-06 11:55:39,189 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/.tmp/family2/453f644748d341d69bac9afdb03542b4 2023-03-06 11:55:39,189 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/.tmp/family2/55c8f076991b4637ad28854f49c12c2e 2023-03-06 11:55:39,194 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/.tmp/family1/521f7fea656f4bf0a6a34619819b9b96 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/521f7fea656f4bf0a6a34619819b9b96 2023-03-06 11:55:39,194 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/.tmp/family1/aea0facd213e46c3ba7bc1001528645c as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/aea0facd213e46c3ba7bc1001528645c 2023-03-06 11:55:39,197 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/aea0facd213e46c3ba7bc1001528645c, entries=4, sequenceid=5, filesize=5.4 K 2023-03-06 11:55:39,197 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/521f7fea656f4bf0a6a34619819b9b96, entries=4, sequenceid=5, filesize=5.4 K 2023-03-06 11:55:39,198 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/.tmp/family2/55c8f076991b4637ad28854f49c12c2e as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family2/55c8f076991b4637ad28854f49c12c2e 2023-03-06 11:55:39,198 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/.tmp/family2/453f644748d341d69bac9afdb03542b4 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family2/453f644748d341d69bac9afdb03542b4 2023-03-06 11:55:39,202 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family2/55c8f076991b4637ad28854f49c12c2e, entries=2, sequenceid=5, filesize=5.1 K 2023-03-06 11:55:39,202 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family2/453f644748d341d69bac9afdb03542b4, entries=2, sequenceid=5, filesize=5.1 K 2023-03-06 11:55:39,203 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for c2cfe3f574de2acbbfc1556c57115d2d in 1255ms, sequenceid=5, compaction requested=false 2023-03-06 11:55:39,203 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for b28bd01ac58b51da722995493250192e in 1255ms, sequenceid=5, compaction requested=false 2023-03-06 11:55:39,203 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for c2cfe3f574de2acbbfc1556c57115d2d: 2023-03-06 11:55:39,203 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for b28bd01ac58b51da722995493250192e: 2023-03-06 11:55:39,203 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d. 2023-03-06 11:55:39,203 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e. 2023-03-06 11:55:39,203 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-06 11:55:39,204 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-06 11:55:39,204 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-06 11:55:39,204 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:39,204 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-03-06 11:55:39,204 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-03-06 11:55:39,205 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-06 11:55:39,205 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:39,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:39,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:39,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:39,205 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-06 11:55:39,206 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:55:39,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:39,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:39,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-06 11:55:39,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:39,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:39,207 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-03-06 11:55:39,207 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@496cad28[Count = 0] remaining members to acquire global barrier 2023-03-06 11:55:39,207 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-03-06 11:55:39,207 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-06 11:55:39,210 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-06 11:55:39,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-06 11:55:39,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-06 11:55:39,210 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-03-06 11:55:39,210 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-03-06 11:55:39,210 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:55:39,210 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:39,210 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:55:39,211 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-03-06 11:55:39,211 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:55:39,211 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:39,211 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-03-06 11:55:39,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:39,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:39,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:39,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:39,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:39,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-06 11:55:39,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:39,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:39,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-06 11:55:39,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:39,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:55:39,213 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-03-06 11:55:39,213 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-03-06 11:55:39,213 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:55:39,213 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:55:39,213 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-03-06 11:55:39,213 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:55:39,214 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-06 11:55:39,214 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-06 11:55:39,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-06 11:55:39,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:39,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:39,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-06 11:55:39,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-06 11:55:39,215 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:55:39,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:39,215 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:39,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:55:39,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:55:39,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-06 11:55:39,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-06 11:55:39,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:39,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-06 11:55:39,216 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:39,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:39,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:39,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-06 11:55:39,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:39,218 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:39,218 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:55:39,218 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-06 11:55:39,218 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-03-06 11:55:39,218 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:55:39,218 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-03-06 11:55:39,218 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:55:39,218 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-06 11:55:39,218 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:55:39,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:55:39,218 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:39,218 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-03-06 11:55:39,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:55:39,218 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:55:39,218 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-06 11:55:39,218 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-06 11:55:39,219 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-06 11:55:39,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:55:39,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:55:39,319 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:55:39,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:55:39,321 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d. with WAL disabled. Data may be lost in the event of a crash. 2023-03-06 11:55:39,321 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c. with WAL disabled. Data may be lost in the event of a crash. 2023-03-06 11:55:39,321 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e. with WAL disabled. Data may be lost in the event of a crash. 2023-03-06 11:55:39,323 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:55:39,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-03-06 11:55:39,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-03-06 11:55:39,325 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-03-06 11:55:39,325 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:55:39,325 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-03-06 11:55:39,325 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-03-06 11:55:39,326 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-06 11:55:39,326 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-06 11:55:39,332 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:55:39,332 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:39,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:55:39,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:55:39,332 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:39,332 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:55:39,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-06 11:55:39,332 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-06 11:55:39,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:55:39,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-06 11:55:39,333 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-03-06 11:55:39,333 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-03-06 11:55:39,333 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-03-06 11:55:39,333 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-03-06 11:55:39,333 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:55:39,333 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-03-06 11:55:39,334 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c. 2023-03-06 11:55:39,334 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-06 11:55:39,334 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e. 2023-03-06 11:55:39,334 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c. started... 2023-03-06 11:55:39,334 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d. 2023-03-06 11:55:39,334 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e. started... 2023-03-06 11:55:39,334 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:55:39,334 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d. started... 2023-03-06 11:55:39,334 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2f269067b173a7b6fd05253fc30eb70c 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-06 11:55:39,334 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing c2cfe3f574de2acbbfc1556c57115d2d 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-06 11:55:39,334 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing b28bd01ac58b51da722995493250192e 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-06 11:55:39,755 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023030665e56004b53049b8816e156ba235feff to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023030665e56004b53049b8816e156ba235feff 2023-03-06 11:55:39,755 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230306fa07443919b04eb8bb92bbc37962d241 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230306fa07443919b04eb8bb92bbc37962d241 2023-03-06 11:55:39,758 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303067011e99a256540749bea0778e1de7574 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303067011e99a256540749bea0778e1de7574 2023-03-06 11:55:39,760 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/.tmp/family1/11179992264b4611827cbb05d77aa09e 2023-03-06 11:55:40,160 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/.tmp/family1/ef09b1b6393b418a9bae617dbb52b822 2023-03-06 11:55:40,162 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/.tmp/family1/c3eb14c8d0a7468087260ec76443837a 2023-03-06 11:55:40,172 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023030632837620b3f54d9fa20827374fb85d0a to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023030632837620b3f54d9fa20827374fb85d0a 2023-03-06 11:55:40,174 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230306d4c2a68214f246df8074aed43c7a1bca to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230306d4c2a68214f246df8074aed43c7a1bca 2023-03-06 11:55:40,178 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/.tmp/family2/e34a67de00c04775a1ee3cd89ea6cfc6 2023-03-06 11:55:40,181 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/.tmp/family1/c3eb14c8d0a7468087260ec76443837a as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/c3eb14c8d0a7468087260ec76443837a 2023-03-06 11:55:40,184 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/c3eb14c8d0a7468087260ec76443837a, entries=4, sequenceid=9, filesize=5.4 K 2023-03-06 11:55:40,184 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/.tmp/family2/e34a67de00c04775a1ee3cd89ea6cfc6 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family2/e34a67de00c04775a1ee3cd89ea6cfc6 2023-03-06 11:55:40,187 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family2/e34a67de00c04775a1ee3cd89ea6cfc6, entries=2, sequenceid=9, filesize=5.1 K 2023-03-06 11:55:40,188 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for b28bd01ac58b51da722995493250192e in 854ms, sequenceid=9, compaction requested=false 2023-03-06 11:55:40,188 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for b28bd01ac58b51da722995493250192e: 2023-03-06 11:55:40,188 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e. 2023-03-06 11:55:40,188 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-06 11:55:40,575 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230306035b20b463cf4676b00038e1ded89b36 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230306035b20b463cf4676b00038e1ded89b36 2023-03-06 11:55:40,577 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/.tmp/family2/1c50ec366ebb4fa1ae19df1bcdd90ce4 2023-03-06 11:55:40,580 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/.tmp/family1/11179992264b4611827cbb05d77aa09e as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/11179992264b4611827cbb05d77aa09e 2023-03-06 11:55:40,584 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/11179992264b4611827cbb05d77aa09e, entries=4, sequenceid=9, filesize=5.4 K 2023-03-06 11:55:40,584 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/.tmp/family2/1c50ec366ebb4fa1ae19df1bcdd90ce4 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family2/1c50ec366ebb4fa1ae19df1bcdd90ce4 2023-03-06 11:55:40,588 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family2/1c50ec366ebb4fa1ae19df1bcdd90ce4, entries=2, sequenceid=9, filesize=5.1 K 2023-03-06 11:55:40,588 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for c2cfe3f574de2acbbfc1556c57115d2d in 1254ms, sequenceid=9, compaction requested=false 2023-03-06 11:55:40,589 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for c2cfe3f574de2acbbfc1556c57115d2d: 2023-03-06 11:55:40,589 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d. 2023-03-06 11:55:40,589 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-06 11:55:40,980 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/.tmp/family2/dc963273a6794ce781fbfad08180cc0e 2023-03-06 11:55:40,984 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/.tmp/family1/ef09b1b6393b418a9bae617dbb52b822 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/ef09b1b6393b418a9bae617dbb52b822 2023-03-06 11:55:40,987 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/ef09b1b6393b418a9bae617dbb52b822, entries=4, sequenceid=9, filesize=5.4 K 2023-03-06 11:55:40,988 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/.tmp/family2/dc963273a6794ce781fbfad08180cc0e as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family2/dc963273a6794ce781fbfad08180cc0e 2023-03-06 11:55:40,991 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family2/dc963273a6794ce781fbfad08180cc0e, entries=2, sequenceid=9, filesize=5.1 K 2023-03-06 11:55:40,992 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 2f269067b173a7b6fd05253fc30eb70c in 1658ms, sequenceid=9, compaction requested=false 2023-03-06 11:55:40,992 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2f269067b173a7b6fd05253fc30eb70c: 2023-03-06 11:55:40,992 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c. 2023-03-06 11:55:40,992 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-06 11:55:40,992 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-06 11:55:40,992 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:40,992 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-03-06 11:55:40,992 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-03-06 11:55:40,994 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:40,994 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-06 11:55:40,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:40,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:40,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:40,994 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-06 11:55:40,994 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:55:40,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:40,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:40,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-06 11:55:40,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:40,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:40,995 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-03-06 11:55:40,995 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5e99980b[Count = 0] remaining members to acquire global barrier 2023-03-06 11:55:40,995 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-03-06 11:55:40,995 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-06 11:55:40,996 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-06 11:55:40,996 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-06 11:55:40,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-06 11:55:40,996 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-03-06 11:55:40,996 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-03-06 11:55:40,996 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:55:40,996 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:40,997 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:55:40,997 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:40,997 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-03-06 11:55:40,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:40,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:40,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:40,997 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:55:40,998 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-03-06 11:55:40,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:40,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:40,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-06 11:55:40,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:40,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:40,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-06 11:55:40,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:40,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:55:41,000 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-03-06 11:55:41,000 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-03-06 11:55:41,000 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:55:41,000 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:55:41,000 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-03-06 11:55:41,000 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:55:41,002 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-06 11:55:41,002 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-06 11:55:41,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-06 11:55:41,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:41,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:41,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-06 11:55:41,002 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:55:41,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-06 11:55:41,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:41,003 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:41,003 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:55:41,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:55:41,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-06 11:55:41,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-06 11:55:41,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:41,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-06 11:55:41,004 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:41,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:41,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:41,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-06 11:55:41,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:41,005 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:41,005 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:55:41,005 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-06 11:55:41,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:55:41,005 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-06 11:55:41,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:55:41,006 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-03-06 11:55:41,005 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:55:41,005 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-03-06 11:55:41,006 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:55:41,005 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:41,005 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:55:41,006 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-06 11:55:41,006 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:55:41,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:55:41,006 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-06 11:55:41,006 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-06 11:55:41,007 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-03-06 11:55:41,007 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:55:41,046 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-06 11:55:41,107 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:55:41,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:55:41,109 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d. with WAL disabled. Data may be lost in the event of a crash. 2023-03-06 11:55:41,109 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c. with WAL disabled. Data may be lost in the event of a crash. 2023-03-06 11:55:41,109 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e. with WAL disabled. Data may be lost in the event of a crash. 2023-03-06 11:55:41,112 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:55:41,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-03-06 11:55:41,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-03-06 11:55:41,114 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-03-06 11:55:41,114 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:55:41,114 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-03-06 11:55:41,114 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-03-06 11:55:41,114 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-06 11:55:41,114 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-06 11:55:41,115 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:55:41,115 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:41,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:55:41,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:55:41,116 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:41,116 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:55:41,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-06 11:55:41,116 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-06 11:55:41,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:55:41,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-06 11:55:41,117 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-03-06 11:55:41,117 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-03-06 11:55:41,117 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-03-06 11:55:41,117 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-03-06 11:55:41,117 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:55:41,117 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-03-06 11:55:41,117 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c. 2023-03-06 11:55:41,117 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c. started... 2023-03-06 11:55:41,117 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d. 2023-03-06 11:55:41,117 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2f269067b173a7b6fd05253fc30eb70c 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-06 11:55:41,117 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d. started... 2023-03-06 11:55:41,117 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing c2cfe3f574de2acbbfc1556c57115d2d 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-06 11:55:41,118 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-06 11:55:41,118 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:55:41,118 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e. 2023-03-06 11:55:41,118 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e. started... 2023-03-06 11:55:41,118 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing b28bd01ac58b51da722995493250192e 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-06 11:55:41,427 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-03-06 11:55:41,539 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230306fe59fbd6fddf403cb72ea83968b5fee0 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230306fe59fbd6fddf403cb72ea83968b5fee0 2023-03-06 11:55:41,539 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023030623dafbf6b980413dac2036d2150cb244 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023030623dafbf6b980413dac2036d2150cb244 2023-03-06 11:55:41,544 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230306276c4eb3750e4cd8a288882063ffda33 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230306276c4eb3750e4cd8a288882063ffda33 2023-03-06 11:55:41,945 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/.tmp/family1/8752ae0e04ef4095a93e824894aeecb8 2023-03-06 11:55:41,947 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/.tmp/family1/222bd21269334cb2b0e7a1802939feae 2023-03-06 11:55:41,950 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/.tmp/family1/fd5561a340c7417ebc42529da127b851 2023-03-06 11:55:42,364 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303062e9c62e68aed4d56a93f3b27ebb0f5ee to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303062e9c62e68aed4d56a93f3b27ebb0f5ee 2023-03-06 11:55:42,367 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303065bb72fd8d11245958ec729633b7b73b1 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303065bb72fd8d11245958ec729633b7b73b1 2023-03-06 11:55:42,368 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230306daa47281759345e68e26eab846a9ca3e to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230306daa47281759345e68e26eab846a9ca3e 2023-03-06 11:55:42,368 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/.tmp/family2/3e4f939b432142e682c697adc6d4bb4d 2023-03-06 11:55:42,372 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/.tmp/family2/7d0afd42878e4420b51d38de0fbcc357 2023-03-06 11:55:42,372 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/.tmp/family1/8752ae0e04ef4095a93e824894aeecb8 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/8752ae0e04ef4095a93e824894aeecb8 2023-03-06 11:55:42,375 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/.tmp/family1/fd5561a340c7417ebc42529da127b851 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/fd5561a340c7417ebc42529da127b851 2023-03-06 11:55:42,376 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/8752ae0e04ef4095a93e824894aeecb8, entries=4, sequenceid=13, filesize=5.4 K 2023-03-06 11:55:42,376 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/.tmp/family2/3e4f939b432142e682c697adc6d4bb4d as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family2/3e4f939b432142e682c697adc6d4bb4d 2023-03-06 11:55:42,379 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/fd5561a340c7417ebc42529da127b851, entries=4, sequenceid=13, filesize=5.4 K 2023-03-06 11:55:42,379 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family2/3e4f939b432142e682c697adc6d4bb4d, entries=2, sequenceid=13, filesize=5.1 K 2023-03-06 11:55:42,379 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/.tmp/family2/7d0afd42878e4420b51d38de0fbcc357 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family2/7d0afd42878e4420b51d38de0fbcc357 2023-03-06 11:55:42,380 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for c2cfe3f574de2acbbfc1556c57115d2d in 1263ms, sequenceid=13, compaction requested=true 2023-03-06 11:55:42,380 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for c2cfe3f574de2acbbfc1556c57115d2d: 2023-03-06 11:55:42,380 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d. 2023-03-06 11:55:42,380 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-06 11:55:42,382 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family2/7d0afd42878e4420b51d38de0fbcc357, entries=2, sequenceid=13, filesize=5.1 K 2023-03-06 11:55:42,383 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 2f269067b173a7b6fd05253fc30eb70c in 1266ms, sequenceid=13, compaction requested=true 2023-03-06 11:55:42,383 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2f269067b173a7b6fd05253fc30eb70c: 2023-03-06 11:55:42,383 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c. 2023-03-06 11:55:42,383 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-06 11:55:42,771 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/.tmp/family2/40ac62114b9142a1b234682618c9abaa 2023-03-06 11:55:42,776 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/.tmp/family1/222bd21269334cb2b0e7a1802939feae as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/222bd21269334cb2b0e7a1802939feae 2023-03-06 11:55:42,779 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/222bd21269334cb2b0e7a1802939feae, entries=4, sequenceid=13, filesize=5.4 K 2023-03-06 11:55:42,779 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/.tmp/family2/40ac62114b9142a1b234682618c9abaa as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family2/40ac62114b9142a1b234682618c9abaa 2023-03-06 11:55:42,784 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family2/40ac62114b9142a1b234682618c9abaa, entries=2, sequenceid=13, filesize=5.1 K 2023-03-06 11:55:42,785 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for b28bd01ac58b51da722995493250192e in 1667ms, sequenceid=13, compaction requested=true 2023-03-06 11:55:42,785 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for b28bd01ac58b51da722995493250192e: 2023-03-06 11:55:42,785 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e. 2023-03-06 11:55:42,785 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-06 11:55:42,785 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-06 11:55:42,785 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:42,785 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-03-06 11:55:42,785 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-03-06 11:55:42,786 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:42,786 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-06 11:55:42,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:42,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:42,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:42,787 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-06 11:55:42,787 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:55:42,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:42,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:42,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-06 11:55:42,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:42,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:42,788 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-03-06 11:55:42,788 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3a679a66[Count = 0] remaining members to acquire global barrier 2023-03-06 11:55:42,788 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-03-06 11:55:42,788 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-06 11:55:42,789 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-06 11:55:42,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-06 11:55:42,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-06 11:55:42,789 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:42,789 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:55:42,789 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-03-06 11:55:42,789 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-03-06 11:55:42,789 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:55:42,799 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-03-06 11:55:42,799 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:42,799 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:55:42,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:42,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:42,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:42,799 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-03-06 11:55:42,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:42,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:42,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-06 11:55:42,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:42,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:42,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-06 11:55:42,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:42,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:55:42,801 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-03-06 11:55:42,801 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-03-06 11:55:42,801 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:55:42,801 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:55:42,801 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-03-06 11:55:42,801 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:55:42,802 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-06 11:55:42,802 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-06 11:55:42,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-06 11:55:42,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:42,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:42,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-06 11:55:42,802 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:55:42,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-06 11:55:42,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:42,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:55:42,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:55:42,803 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:42,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-06 11:55:42,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-06 11:55:42,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:42,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-06 11:55:42,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:42,804 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:42,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:42,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-06 11:55:42,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:42,806 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:42,806 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-06 11:55:42,806 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-06 11:55:42,806 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:55:42,806 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-03-06 11:55:42,806 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:55:42,806 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-03-06 11:55:42,806 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:55:42,806 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:42,806 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:55:42,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:55:42,806 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-06 11:55:42,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:55:42,806 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-06 11:55:42,806 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-03-06 11:55:42,806 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-06 11:55:42,806 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:55:42,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:55:42,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:55:42,906 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:55:42,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:55:42,908 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d. with WAL disabled. Data may be lost in the event of a crash. 2023-03-06 11:55:42,908 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c. with WAL disabled. Data may be lost in the event of a crash. 2023-03-06 11:55:42,908 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e. with WAL disabled. Data may be lost in the event of a crash. 2023-03-06 11:55:42,910 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:55:42,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-03-06 11:55:42,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-03-06 11:55:42,912 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-03-06 11:55:42,912 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:55:42,912 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-03-06 11:55:42,912 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-03-06 11:55:42,913 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-06 11:55:42,913 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-06 11:55:42,915 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:42,915 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:55:42,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:55:42,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:55:42,915 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:42,916 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:55:42,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-06 11:55:42,916 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-06 11:55:42,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:55:42,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-06 11:55:42,916 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-03-06 11:55:42,916 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-03-06 11:55:42,916 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-03-06 11:55:42,916 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-03-06 11:55:42,916 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:55:42,917 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-03-06 11:55:42,917 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c. 2023-03-06 11:55:42,917 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d. 2023-03-06 11:55:42,917 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e. 2023-03-06 11:55:42,917 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c. started... 2023-03-06 11:55:42,917 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-06 11:55:42,917 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:55:42,917 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e. started... 2023-03-06 11:55:42,917 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d. started... 2023-03-06 11:55:42,917 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2f269067b173a7b6fd05253fc30eb70c 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-06 11:55:42,917 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing c2cfe3f574de2acbbfc1556c57115d2d 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-06 11:55:42,917 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing b28bd01ac58b51da722995493250192e 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-06 11:55:43,335 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023030663cd81e529c54b83b1daefd26c6b83be to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023030663cd81e529c54b83b1daefd26c6b83be 2023-03-06 11:55:43,340 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230306d631bc914a074bb4a12b9a982a26f16e to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230306d631bc914a074bb4a12b9a982a26f16e 2023-03-06 11:55:43,342 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230306c11f7967e9eb4cd594cabd367a739dfb to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230306c11f7967e9eb4cd594cabd367a739dfb 2023-03-06 11:55:43,342 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/.tmp/family1/2f93a191ebca4d5c9dca411185590aa6 2023-03-06 11:55:43,346 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/.tmp/family1/e1d6306f346045c7a65451b81473cbf9 2023-03-06 11:55:43,361 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303060669d827db994d8582f9eda6be05f99b to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303060669d827db994d8582f9eda6be05f99b 2023-03-06 11:55:43,747 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/.tmp/family1/40dba177f68a45158f9d5b5d497c8b90 2023-03-06 11:55:43,765 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303067f5ef34fec6b48c1be64aa901ab087cf to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303067f5ef34fec6b48c1be64aa901ab087cf 2023-03-06 11:55:43,766 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/.tmp/family2/5cc62b27f8ad4edf8b330b0c303b9512 2023-03-06 11:55:43,770 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/.tmp/family1/2f93a191ebca4d5c9dca411185590aa6 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/2f93a191ebca4d5c9dca411185590aa6 2023-03-06 11:55:43,773 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/2f93a191ebca4d5c9dca411185590aa6, entries=4, sequenceid=17, filesize=5.4 K 2023-03-06 11:55:43,774 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/.tmp/family2/5cc62b27f8ad4edf8b330b0c303b9512 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family2/5cc62b27f8ad4edf8b330b0c303b9512 2023-03-06 11:55:43,777 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family2/5cc62b27f8ad4edf8b330b0c303b9512, entries=2, sequenceid=17, filesize=5.1 K 2023-03-06 11:55:43,778 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for c2cfe3f574de2acbbfc1556c57115d2d in 861ms, sequenceid=17, compaction requested=true 2023-03-06 11:55:43,778 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for c2cfe3f574de2acbbfc1556c57115d2d: 2023-03-06 11:55:43,778 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d. 2023-03-06 11:55:43,778 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-06 11:55:44,161 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230306ffb8b2fe1e8d4b35a4795c1fdbe647fd to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230306ffb8b2fe1e8d4b35a4795c1fdbe647fd 2023-03-06 11:55:44,170 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/.tmp/family2/87dd2c76e0704c02bf5d7e6c177f51b2 2023-03-06 11:55:44,173 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/.tmp/family1/e1d6306f346045c7a65451b81473cbf9 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/e1d6306f346045c7a65451b81473cbf9 2023-03-06 11:55:44,176 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/e1d6306f346045c7a65451b81473cbf9, entries=4, sequenceid=17, filesize=5.4 K 2023-03-06 11:55:44,177 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/.tmp/family2/87dd2c76e0704c02bf5d7e6c177f51b2 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family2/87dd2c76e0704c02bf5d7e6c177f51b2 2023-03-06 11:55:44,180 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family2/87dd2c76e0704c02bf5d7e6c177f51b2, entries=2, sequenceid=17, filesize=5.1 K 2023-03-06 11:55:44,180 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 2f269067b173a7b6fd05253fc30eb70c in 1263ms, sequenceid=17, compaction requested=true 2023-03-06 11:55:44,180 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2f269067b173a7b6fd05253fc30eb70c: 2023-03-06 11:55:44,180 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c. 2023-03-06 11:55:44,180 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-06 11:55:44,566 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/.tmp/family2/3d762d3394994f9db9eaaa5bc78cd499 2023-03-06 11:55:44,570 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/.tmp/family1/40dba177f68a45158f9d5b5d497c8b90 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/40dba177f68a45158f9d5b5d497c8b90 2023-03-06 11:55:44,573 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/40dba177f68a45158f9d5b5d497c8b90, entries=4, sequenceid=17, filesize=5.4 K 2023-03-06 11:55:44,574 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/.tmp/family2/3d762d3394994f9db9eaaa5bc78cd499 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family2/3d762d3394994f9db9eaaa5bc78cd499 2023-03-06 11:55:44,577 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family2/3d762d3394994f9db9eaaa5bc78cd499, entries=2, sequenceid=17, filesize=5.1 K 2023-03-06 11:55:44,578 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for b28bd01ac58b51da722995493250192e in 1661ms, sequenceid=17, compaction requested=true 2023-03-06 11:55:44,578 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for b28bd01ac58b51da722995493250192e: 2023-03-06 11:55:44,578 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e. 2023-03-06 11:55:44,578 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-06 11:55:44,578 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-06 11:55:44,578 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:44,578 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-03-06 11:55:44,578 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-03-06 11:55:44,580 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-06 11:55:44,580 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:44,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:44,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:44,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:44,580 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-06 11:55:44,580 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:55:44,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:44,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:44,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-06 11:55:44,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:44,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:44,581 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-03-06 11:55:44,582 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@f22317e[Count = 0] remaining members to acquire global barrier 2023-03-06 11:55:44,582 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-03-06 11:55:44,582 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-06 11:55:44,583 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-06 11:55:44,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-06 11:55:44,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-06 11:55:44,583 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-03-06 11:55:44,583 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-03-06 11:55:44,583 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:55:44,583 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:44,583 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:55:44,584 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:44,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:44,585 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-03-06 11:55:44,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:44,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:44,585 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:55:44,585 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-03-06 11:55:44,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:44,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:44,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-06 11:55:44,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:44,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:44,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-06 11:55:44,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:44,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:55:44,587 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-03-06 11:55:44,587 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:55:44,587 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:55:44,587 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-03-06 11:55:44,587 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-03-06 11:55:44,587 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:55:44,590 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-06 11:55:44,590 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-06 11:55:44,590 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:55:44,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-06 11:55:44,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:44,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:44,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-06 11:55:44,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-06 11:55:44,590 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:44,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:55:44,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:55:44,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:44,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-06 11:55:44,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-06 11:55:44,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:44,591 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:44,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-06 11:55:44,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:44,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:44,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-06 11:55:44,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:44,593 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:44,593 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-06 11:55:44,593 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:55:44,593 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-06 11:55:44,593 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:55:44,593 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-03-06 11:55:44,593 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:55:44,593 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:44,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:55:44,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:55:44,593 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:55:44,594 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-03-06 11:55:44,593 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-06 11:55:44,594 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-06 11:55:44,594 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-06 11:55:44,594 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-03-06 11:55:44,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:55:44,594 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:55:44,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:55:44,694 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:55:44,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:55:44,704 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1580): Client=jenkins//172.31.10.131 snapshot request for:{ ss=snaptb-1678103744695 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-06 11:55:44,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1678103744705 (current time:1678103744705). 2023-03-06 11:55:44,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-03-06 11:55:44,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] zookeeper.ReadOnlyZKClient(139): Connect 0x42a77cc6 to 127.0.0.1:62659 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-06 11:55:44,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@577f9796, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-06 11:55:44,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-06 11:55:44,716 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:47860, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-06 11:55:44,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x42a77cc6 to 127.0.0.1:62659 2023-03-06 11:55:44,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-06 11:55:44,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-03-06 11:55:44,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb-1678103744695 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-06 11:55:44,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure2.ProcedureExecutor(1029): Stored pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-06 11:55:44,727 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-06 11:55:44,727 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=86, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1678104344727 2023-03-06 11:55:44,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb-1678103744695 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-06 11:55:44,728 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb-1678103744695 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-03-06 11:55:44,729 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=86, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-06 11:55:44,729 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure2.ProcedureExecutor(1029): Stored pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-03-06 11:55:44,730 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=86, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 3 msec 2023-03-06 11:55:44,730 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-03-06 11:55:44,731 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=87, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED; timeout=600000, timestamp=1678104344731 2023-03-06 11:55:44,732 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb-1678103744695 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-03-06 11:55:44,732 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-03-06 11:55:44,832 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-06 11:55:44,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1678103744695 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-06 11:55:44,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1678103744695 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-06 11:55:44,837 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-03-06 11:55:45,037 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-06 11:55:45,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1678103744695 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-06 11:55:45,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1678103744695 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-06 11:55:45,038 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-03-06 11:55:45,137 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb-1678103744695 2023-03-06 11:55:45,137 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb-1678103744695' 2023-03-06 11:55:45,137 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-03-06 11:55:45,137 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb-1678103744695' starting 'acquire' 2023-03-06 11:55:45,137 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb-1678103744695', kicking off acquire phase on members. 2023-03-06 11:55:45,138 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1678103744695 2023-03-06 11:55:45,138 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb-1678103744695 2023-03-06 11:55:45,141 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-03-06 11:55:45,141 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb-1678103744695/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:45,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-03-06 11:55:45,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-03-06 11:55:45,141 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb-1678103744695/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:45,141 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:55:45,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb-1678103744695 2023-03-06 11:55:45,141 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1678103744695 2023-03-06 11:55:45,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-03-06 11:55:45,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb-1678103744695 2023-03-06 11:55:45,142 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb-1678103744695 from table testCompactionWithHFileLink type FLUSH 2023-03-06 11:55:45,144 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb-1678103744695 2023-03-06 11:55:45,144 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb-1678103744695' with timeout 300000ms 2023-03-06 11:55:45,144 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-03-06 11:55:45,144 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb-1678103744695' starting 'acquire' stage 2023-03-06 11:55:45,144 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb-1678103744695' locally acquired 2023-03-06 11:55:45,144 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (snaptb-1678103744695) in zk 2023-03-06 11:55:45,145 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1678103744695/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:45,145 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb-1678103744695 2023-03-06 11:55:45,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb-1678103744695/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:45,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:45,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-03-06 11:55:45,146 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1678103744695 2023-03-06 11:55:45,146 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb-1678103744695' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:55:45,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:45,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:45,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1678103744695 2023-03-06 11:55:45,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:45,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:45,147 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'snaptb-1678103744695' on coordinator 2023-03-06 11:55:45,147 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@238bd85f[Count = 0] remaining members to acquire global barrier 2023-03-06 11:55:45,147 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb-1678103744695' starting 'in-barrier' execution. 2023-03-06 11:55:45,147 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb-1678103744695 2023-03-06 11:55:45,148 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1678103744695 2023-03-06 11:55:45,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb-1678103744695 2023-03-06 11:55:45,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb-1678103744695 2023-03-06 11:55:45,148 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb-1678103744695' received 'reached' from coordinator. 2023-03-06 11:55:45,148 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1678103744695/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:45,148 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:55:45,149 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c. 2023-03-06 11:55:45,149 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 3 regions 2023-03-06 11:55:45,149 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e. 2023-03-06 11:55:45,149 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-03-06 11:55:45,149 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d. 2023-03-06 11:55:45,149 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e. started... 2023-03-06 11:55:45,149 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c. started... 2023-03-06 11:55:45,149 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d. started... 2023-03-06 11:55:45,149 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-snapshot-pool-2] regionserver.HRegion(2446): Flush status journal for b28bd01ac58b51da722995493250192e: 2023-03-06 11:55:45,149 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2f269067b173a7b6fd05253fc30eb70c: 2023-03-06 11:55:45,149 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-snapshot-pool-1] regionserver.HRegion(2446): Flush status journal for c2cfe3f574de2acbbfc1556c57115d2d: 2023-03-06 11:55:45,150 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e.' region-info for snapshot=snaptb-1678103744695 2023-03-06 11:55:45,150 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d.' region-info for snapshot=snaptb-1678103744695 2023-03-06 11:55:45,150 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c.' region-info for snapshot=snaptb-1678103744695 2023-03-06 11:55:45,155 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-03-06 11:55:45,155 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-03-06 11:55:45,155 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-03-06 11:55:45,298 INFO [regionserver/jenkins-hbase5:0.Chore.1] hbase.ScheduledChore(142): Chore: CompactedHFilesCleaner missed its start time 2023-03-06 11:55:45,302 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/aea0facd213e46c3ba7bc1001528645c, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/11179992264b4611827cbb05d77aa09e, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/8752ae0e04ef4095a93e824894aeecb8, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/2f93a191ebca4d5c9dca411185590aa6] hfiles 2023-03-06 11:55:45,302 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/306a91a6892045909bfd8d2fa20e3d07, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/ef09b1b6393b418a9bae617dbb52b822, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/fd5561a340c7417ebc42529da127b851, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/e1d6306f346045c7a65451b81473cbf9] hfiles 2023-03-06 11:55:45,302 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/521f7fea656f4bf0a6a34619819b9b96, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/c3eb14c8d0a7468087260ec76443837a, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/222bd21269334cb2b0e7a1802939feae, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/40dba177f68a45158f9d5b5d497c8b90] hfiles 2023-03-06 11:55:45,302 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/306a91a6892045909bfd8d2fa20e3d07 for snapshot=snaptb-1678103744695 2023-03-06 11:55:45,302 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/aea0facd213e46c3ba7bc1001528645c for snapshot=snaptb-1678103744695 2023-03-06 11:55:45,302 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/521f7fea656f4bf0a6a34619819b9b96 for snapshot=snaptb-1678103744695 2023-03-06 11:55:45,305 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/c3eb14c8d0a7468087260ec76443837a for snapshot=snaptb-1678103744695 2023-03-06 11:55:45,305 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/ef09b1b6393b418a9bae617dbb52b822 for snapshot=snaptb-1678103744695 2023-03-06 11:55:45,305 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/222bd21269334cb2b0e7a1802939feae for snapshot=snaptb-1678103744695 2023-03-06 11:55:45,305 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/fd5561a340c7417ebc42529da127b851 for snapshot=snaptb-1678103744695 2023-03-06 11:55:45,305 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/40dba177f68a45158f9d5b5d497c8b90 for snapshot=snaptb-1678103744695 2023-03-06 11:55:45,305 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/e1d6306f346045c7a65451b81473cbf9 for snapshot=snaptb-1678103744695 2023-03-06 11:55:45,305 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/11179992264b4611827cbb05d77aa09e for snapshot=snaptb-1678103744695 2023-03-06 11:55:45,305 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/8752ae0e04ef4095a93e824894aeecb8 for snapshot=snaptb-1678103744695 2023-03-06 11:55:45,305 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family2/453f644748d341d69bac9afdb03542b4, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family2/e34a67de00c04775a1ee3cd89ea6cfc6, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family2/40ac62114b9142a1b234682618c9abaa, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family2/3d762d3394994f9db9eaaa5bc78cd499] hfiles 2023-03-06 11:55:45,305 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/2f93a191ebca4d5c9dca411185590aa6 for snapshot=snaptb-1678103744695 2023-03-06 11:55:45,305 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family2/453f644748d341d69bac9afdb03542b4 for snapshot=snaptb-1678103744695 2023-03-06 11:55:45,306 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family2/55c8f076991b4637ad28854f49c12c2e, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family2/1c50ec366ebb4fa1ae19df1bcdd90ce4, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family2/3e4f939b432142e682c697adc6d4bb4d, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family2/5cc62b27f8ad4edf8b330b0c303b9512] hfiles 2023-03-06 11:55:45,306 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family2/e34a67de00c04775a1ee3cd89ea6cfc6 for snapshot=snaptb-1678103744695 2023-03-06 11:55:45,306 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family2/55c8f076991b4637ad28854f49c12c2e for snapshot=snaptb-1678103744695 2023-03-06 11:55:45,306 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family2/40ac62114b9142a1b234682618c9abaa for snapshot=snaptb-1678103744695 2023-03-06 11:55:45,305 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family2/9b48e09b8f7b4159847efb67f49fece1, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family2/dc963273a6794ce781fbfad08180cc0e, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family2/7d0afd42878e4420b51d38de0fbcc357, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family2/87dd2c76e0704c02bf5d7e6c177f51b2] hfiles 2023-03-06 11:55:45,306 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family2/3d762d3394994f9db9eaaa5bc78cd499 for snapshot=snaptb-1678103744695 2023-03-06 11:55:45,306 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family2/9b48e09b8f7b4159847efb67f49fece1 for snapshot=snaptb-1678103744695 2023-03-06 11:55:45,306 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family2/1c50ec366ebb4fa1ae19df1bcdd90ce4 for snapshot=snaptb-1678103744695 2023-03-06 11:55:45,306 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family2/dc963273a6794ce781fbfad08180cc0e for snapshot=snaptb-1678103744695 2023-03-06 11:55:45,306 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family2/3e4f939b432142e682c697adc6d4bb4d for snapshot=snaptb-1678103744695 2023-03-06 11:55:45,306 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family2/7d0afd42878e4420b51d38de0fbcc357 for snapshot=snaptb-1678103744695 2023-03-06 11:55:45,306 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family2/5cc62b27f8ad4edf8b330b0c303b9512 for snapshot=snaptb-1678103744695 2023-03-06 11:55:45,306 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family2/87dd2c76e0704c02bf5d7e6c177f51b2 for snapshot=snaptb-1678103744695 2023-03-06 11:55:45,339 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-06 11:55:45,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1678103744695 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-06 11:55:45,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1678103744695 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-06 11:55:45,340 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-03-06 11:55:45,715 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e. completed. 2023-03-06 11:55:45,715 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e. 2023-03-06 11:55:45,715 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d. completed. 2023-03-06 11:55:45,715 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d. 2023-03-06 11:55:45,715 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/3 local region snapshots. 2023-03-06 11:55:45,715 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/3 local region snapshots. 2023-03-06 11:55:45,721 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c. completed. 2023-03-06 11:55:45,721 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c. 2023-03-06 11:55:45,721 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/3 local region snapshots. 2023-03-06 11:55:45,721 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 3 local region snapshots. 2023-03-06 11:55:45,721 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:45,721 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb-1678103744695' locally completed 2023-03-06 11:55:45,721 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb-1678103744695' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:55:45,724 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb-1678103744695' has notified controller of completion 2023-03-06 11:55:45,724 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1678103744695/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:45,724 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:55:45,724 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb-1678103744695' completed. 2023-03-06 11:55:45,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb-1678103744695/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:45,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:45,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-03-06 11:55:45,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:45,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:45,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1678103744695 2023-03-06 11:55:45,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:45,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:45,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1678103744695 2023-03-06 11:55:45,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:45,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb-1678103744695' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:55:45,727 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'snaptb-1678103744695', counting down latch. Waiting for 0 more 2023-03-06 11:55:45,727 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb-1678103744695' execution completed 2023-03-06 11:55:45,727 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:55:45,727 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:55:45,727 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb-1678103744695 2023-03-06 11:55:45,727 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb-1678103744695including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-03-06 11:55:45,730 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1678103744695 2023-03-06 11:55:45,730 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1678103744695 2023-03-06 11:55:45,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb-1678103744695 2023-03-06 11:55:45,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:45,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-03-06 11:55:45,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb-1678103744695 2023-03-06 11:55:45,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1678103744695 2023-03-06 11:55:45,730 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-03-06 11:55:45,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:45,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-03-06 11:55:45,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-03-06 11:55:45,730 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb-1678103744695/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:45,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1678103744695 2023-03-06 11:55:45,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1678103744695 2023-03-06 11:55:45,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:45,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1678103744695 2023-03-06 11:55:45,731 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb-1678103744695/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:45,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:45,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:45,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1678103744695 2023-03-06 11:55:45,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:45,733 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1678103744695/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:45,733 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-03-06 11:55:45,733 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1678103744695 2023-03-06 11:55:45,733 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-03-06 11:55:45,733 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1678103744695 2023-03-06 11:55:45,733 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1678103744695/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:45,733 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb-1678103744695 2023-03-06 11:55:45,733 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:55:45,733 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testCompactionWithHFileLink 2023-03-06 11:55:45,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-03-06 11:55:45,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-03-06 11:55:45,733 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1678103744695 2023-03-06 11:55:45,733 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 0e7b6fa9e81bd62588edd7d77d6165e4, NAME => 'testCompactionWithHFileLink,.mob,0.0e7b6fa9e81bd62588edd7d77d6165e4.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb-1678103744695 2023-03-06 11:55:45,734 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1678103744695 2023-03-06 11:55:45,734 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-03-06 11:55:45,734 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1678103744695 2023-03-06 11:55:45,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-03-06 11:55:45,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-03-06 11:55:45,735 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230306276c4eb3750e4cd8a288882063ffda33, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230306bf7eb4a9b83846bc8bf24136a7371f4b, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230306d631bc914a074bb4a12b9a982a26f16e, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230306fa07443919b04eb8bb92bbc37962d241, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023030624719d5ccbd74c628d8cbe46fee355ec, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303067011e99a256540749bea0778e1de7574, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230306c11f7967e9eb4cd594cabd367a739dfb, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230306fe59fbd6fddf403cb72ea83968b5fee0, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023030623dafbf6b980413dac2036d2150cb244, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023030660002a2d456d4adc97635b1c16827677, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023030663cd81e529c54b83b1daefd26c6b83be, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023030665e56004b53049b8816e156ba235feff] mob files 2023-03-06 11:55:45,735 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230306276c4eb3750e4cd8a288882063ffda33 2023-03-06 11:55:45,735 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230306bf7eb4a9b83846bc8bf24136a7371f4b 2023-03-06 11:55:45,735 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230306d631bc914a074bb4a12b9a982a26f16e 2023-03-06 11:55:45,735 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230306fa07443919b04eb8bb92bbc37962d241 2023-03-06 11:55:45,735 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023030624719d5ccbd74c628d8cbe46fee355ec 2023-03-06 11:55:45,735 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303067011e99a256540749bea0778e1de7574 2023-03-06 11:55:45,735 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230306c11f7967e9eb4cd594cabd367a739dfb 2023-03-06 11:55:45,735 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230306fe59fbd6fddf403cb72ea83968b5fee0 2023-03-06 11:55:45,735 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023030623dafbf6b980413dac2036d2150cb244 2023-03-06 11:55:45,735 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023030660002a2d456d4adc97635b1c16827677 2023-03-06 11:55:45,735 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023030663cd81e529c54b83b1daefd26c6b83be 2023-03-06 11:55:45,735 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023030665e56004b53049b8816e156ba235feff 2023-03-06 11:55:45,736 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230306035b20b463cf4676b00038e1ded89b36, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303067f5ef34fec6b48c1be64aa901ab087cf, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230306daa47281759345e68e26eab846a9ca3e, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230306e772a8abe265475db42ce95e912e519c, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230306580e8ed3672b4323909e44292ca88dde, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303065bb72fd8d11245958ec729633b7b73b1, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230306d4c2a68214f246df8074aed43c7a1bca, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230306ffb8b2fe1e8d4b35a4795c1fdbe647fd, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303060669d827db994d8582f9eda6be05f99b, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303062e9c62e68aed4d56a93f3b27ebb0f5ee, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023030632837620b3f54d9fa20827374fb85d0a, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303063403272ee76f45199997f59c1fef7702] mob files 2023-03-06 11:55:45,736 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230306035b20b463cf4676b00038e1ded89b36 2023-03-06 11:55:45,736 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303067f5ef34fec6b48c1be64aa901ab087cf 2023-03-06 11:55:45,736 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230306daa47281759345e68e26eab846a9ca3e 2023-03-06 11:55:45,736 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230306e772a8abe265475db42ce95e912e519c 2023-03-06 11:55:45,736 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230306580e8ed3672b4323909e44292ca88dde 2023-03-06 11:55:45,736 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303065bb72fd8d11245958ec729633b7b73b1 2023-03-06 11:55:45,736 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230306d4c2a68214f246df8074aed43c7a1bca 2023-03-06 11:55:45,736 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230306ffb8b2fe1e8d4b35a4795c1fdbe647fd 2023-03-06 11:55:45,736 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303060669d827db994d8582f9eda6be05f99b 2023-03-06 11:55:45,736 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303062e9c62e68aed4d56a93f3b27ebb0f5ee 2023-03-06 11:55:45,736 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023030632837620b3f54d9fa20827374fb85d0a 2023-03-06 11:55:45,736 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303063403272ee76f45199997f59c1fef7702 2023-03-06 11:55:45,840 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-06 11:55:45,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1678103744695 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-06 11:55:45,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1678103744695 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-06 11:55:45,841 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-03-06 11:55:46,142 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb-1678103744695 2023-03-06 11:55:46,144 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.hbase-snapshot/.tmp/snaptb-1678103744695 2023-03-06 11:55:46,586 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.hbase-snapshot/.tmp/snaptb-1678103744695 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.hbase-snapshot/snaptb-1678103744695 2023-03-06 11:55:46,841 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-06 11:55:46,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1678103744695 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-06 11:55:46,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1678103744695 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-06 11:55:46,842 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2428): (#6) Sleeping: 2000ms while waiting for snapshot completion. 2023-03-06 11:55:46,930 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-06 11:55:47,000 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb-1678103744695 of table testCompactionWithHFileLink completed 2023-03-06 11:55:47,000 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.hbase-snapshot/.tmp/snaptb-1678103744695 2023-03-06 11:55:47,000 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.hbase-snapshot/.tmp/snaptb-1678103744695 2023-03-06 11:55:47,000 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb-1678103744695 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1678103744728Completed referencing HFiles for the mob region of table: testCompactionWithHFileLink at 1678103746142 (+1414 ms)Consolidate snapshot: snaptb-1678103744695 at 1678103746142Loading Region manifests for snaptb-1678103744695 at 1678103746142Writing data manifest for snaptb-1678103744695 at 1678103746151 (+9 ms)Verifying snapshot: snaptb-1678103744695 at 1678103746557 (+406 ms)Snapshot snaptb-1678103744695 of table testCompactionWithHFileLink completed at 1678103747000 (+443 ms) 2023-03-06 11:55:47,002 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=87, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-03-06 11:55:47,003 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=87, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED in 2.2730 sec 2023-03-06 11:55:48,842 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-06 11:55:48,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1678103744695 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-06 11:55:48,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb-1678103744695 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-03-06 11:55:48,869 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:55:48,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-03-06 11:55:48,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-03-06 11:55:48,870 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-03-06 11:55:48,870 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:55:48,870 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-03-06 11:55:48,871 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-03-06 11:55:48,871 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-06 11:55:48,871 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-06 11:55:48,872 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:55:48,872 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:48,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:55:48,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:55:48,872 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:48,872 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:55:48,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-06 11:55:48,872 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-06 11:55:48,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:55:48,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-06 11:55:48,873 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-03-06 11:55:48,873 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-03-06 11:55:48,873 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-03-06 11:55:48,873 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:55:48,873 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-03-06 11:55:48,873 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c. 2023-03-06 11:55:48,873 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-06 11:55:48,874 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e. 2023-03-06 11:55:48,873 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c. started... 2023-03-06 11:55:48,873 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d. 2023-03-06 11:55:48,874 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d. started... 2023-03-06 11:55:48,874 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e. started... 2023-03-06 11:55:48,874 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:55:48,874 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing b28bd01ac58b51da722995493250192e 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-06 11:55:48,874 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing c2cfe3f574de2acbbfc1556c57115d2d 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-06 11:55:48,874 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2f269067b173a7b6fd05253fc30eb70c 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-06 11:55:49,692 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/.tmp/family1/5d51f9bda9a74f4d91f3f0ecbed8f27d 2023-03-06 11:55:49,692 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/.tmp/family1/dd8a3e83e78d4c829064fbfed67d3657 2023-03-06 11:55:49,695 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/.tmp/family1/3de8c3c9674c4725b85f43c7564a729f 2023-03-06 11:55:49,696 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5d51f9bda9a74f4d91f3f0ecbed8f27d 2023-03-06 11:55:49,696 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dd8a3e83e78d4c829064fbfed67d3657 2023-03-06 11:55:49,698 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3de8c3c9674c4725b85f43c7564a729f 2023-03-06 11:55:50,117 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/.tmp/family2/e2c6879f80bf47b8aafd5f0abda78032 2023-03-06 11:55:50,121 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e2c6879f80bf47b8aafd5f0abda78032 2023-03-06 11:55:50,122 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/.tmp/family1/5d51f9bda9a74f4d91f3f0ecbed8f27d as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/5d51f9bda9a74f4d91f3f0ecbed8f27d 2023-03-06 11:55:50,125 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5d51f9bda9a74f4d91f3f0ecbed8f27d 2023-03-06 11:55:50,125 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/5d51f9bda9a74f4d91f3f0ecbed8f27d, entries=3, sequenceid=24, filesize=5.0 K 2023-03-06 11:55:50,126 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/.tmp/family2/e2c6879f80bf47b8aafd5f0abda78032 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family2/e2c6879f80bf47b8aafd5f0abda78032 2023-03-06 11:55:50,129 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e2c6879f80bf47b8aafd5f0abda78032 2023-03-06 11:55:50,129 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family2/e2c6879f80bf47b8aafd5f0abda78032, entries=1, sequenceid=24, filesize=5.0 K 2023-03-06 11:55:50,129 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for b28bd01ac58b51da722995493250192e in 1255ms, sequenceid=24, compaction requested=true 2023-03-06 11:55:50,130 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for b28bd01ac58b51da722995493250192e: 2023-03-06 11:55:50,130 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e. 2023-03-06 11:55:50,130 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-06 11:55:50,524 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/.tmp/family2/ea767a89fb5e410abb52d36abe6cb1c2 2023-03-06 11:55:50,524 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/.tmp/family2/eb422fa4a8ef45319bfa50d969b319a3 2023-03-06 11:55:50,528 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ea767a89fb5e410abb52d36abe6cb1c2 2023-03-06 11:55:50,528 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for eb422fa4a8ef45319bfa50d969b319a3 2023-03-06 11:55:50,529 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/.tmp/family1/dd8a3e83e78d4c829064fbfed67d3657 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/dd8a3e83e78d4c829064fbfed67d3657 2023-03-06 11:55:50,529 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/.tmp/family1/3de8c3c9674c4725b85f43c7564a729f as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/3de8c3c9674c4725b85f43c7564a729f 2023-03-06 11:55:50,533 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dd8a3e83e78d4c829064fbfed67d3657 2023-03-06 11:55:50,533 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/dd8a3e83e78d4c829064fbfed67d3657, entries=3, sequenceid=24, filesize=5.0 K 2023-03-06 11:55:50,533 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3de8c3c9674c4725b85f43c7564a729f 2023-03-06 11:55:50,533 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/3de8c3c9674c4725b85f43c7564a729f, entries=3, sequenceid=24, filesize=5.0 K 2023-03-06 11:55:50,533 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/.tmp/family2/ea767a89fb5e410abb52d36abe6cb1c2 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family2/ea767a89fb5e410abb52d36abe6cb1c2 2023-03-06 11:55:50,534 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/.tmp/family2/eb422fa4a8ef45319bfa50d969b319a3 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family2/eb422fa4a8ef45319bfa50d969b319a3 2023-03-06 11:55:50,537 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ea767a89fb5e410abb52d36abe6cb1c2 2023-03-06 11:55:50,538 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family2/ea767a89fb5e410abb52d36abe6cb1c2, entries=1, sequenceid=24, filesize=5.0 K 2023-03-06 11:55:50,538 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for eb422fa4a8ef45319bfa50d969b319a3 2023-03-06 11:55:50,538 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family2/eb422fa4a8ef45319bfa50d969b319a3, entries=1, sequenceid=24, filesize=5.0 K 2023-03-06 11:55:50,538 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 2f269067b173a7b6fd05253fc30eb70c in 1664ms, sequenceid=24, compaction requested=true 2023-03-06 11:55:50,538 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2f269067b173a7b6fd05253fc30eb70c: 2023-03-06 11:55:50,538 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c. 2023-03-06 11:55:50,539 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-06 11:55:50,539 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for c2cfe3f574de2acbbfc1556c57115d2d in 1665ms, sequenceid=24, compaction requested=true 2023-03-06 11:55:50,539 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for c2cfe3f574de2acbbfc1556c57115d2d: 2023-03-06 11:55:50,539 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d. 2023-03-06 11:55:50,539 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-06 11:55:50,539 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-06 11:55:50,539 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:50,539 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-03-06 11:55:50,539 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-03-06 11:55:50,541 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:50,541 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-06 11:55:50,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:50,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:50,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:50,541 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-06 11:55:50,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:50,541 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:55:50,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:50,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-06 11:55:50,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:50,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:50,542 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-03-06 11:55:50,542 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@31c055e5[Count = 0] remaining members to acquire global barrier 2023-03-06 11:55:50,542 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-03-06 11:55:50,542 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-06 11:55:50,548 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-06 11:55:50,548 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-06 11:55:50,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-06 11:55:50,549 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-03-06 11:55:50,549 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-03-06 11:55:50,549 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:55:50,549 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:50,549 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:55:50,550 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:50,550 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-03-06 11:55:50,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:50,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:50,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:50,550 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:55:50,550 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-03-06 11:55:50,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:50,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:50,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-06 11:55:50,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:50,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:50,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-06 11:55:50,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:50,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:55:50,552 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-03-06 11:55:50,552 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-03-06 11:55:50,552 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:55:50,552 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:55:50,552 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-03-06 11:55:50,552 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:55:50,553 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-06 11:55:50,553 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-06 11:55:50,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-06 11:55:50,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:55:50,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:55:50,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-06 11:55:50,553 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:55:50,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-06 11:55:50,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:55:50,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:55:50,554 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:50,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:55:50,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-06 11:55:50,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-06 11:55:50,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:55:50,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-06 11:55:50,555 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:50,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:50,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:55:50,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-06 11:55:50,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:50,557 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:50,557 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:55:50,557 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-06 11:55:50,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:55:50,557 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-06 11:55:50,557 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:50,557 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-06 11:55:50,557 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-06 11:55:50,557 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-06 11:55:50,557 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-03-06 11:55:50,558 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:55:50,557 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:55:50,557 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:55:50,557 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-03-06 11:55:50,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:55:50,558 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-03-06 11:55:50,558 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:55:50,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:55:50,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:55:50,658 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:55:50,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:55:50,660 DEBUG [Listener at localhost/46717] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-06 11:55:50,660 DEBUG [Listener at localhost/46717] regionserver.HStore(1912): 2f269067b173a7b6fd05253fc30eb70c/family1 is initiating major compaction (all files) 2023-03-06 11:55:50,660 INFO [Listener at localhost/46717] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-06 11:55:50,660 INFO [Listener at localhost/46717] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-06 11:55:50,661 INFO [Listener at localhost/46717] regionserver.HRegion(2259): Starting compaction of 2f269067b173a7b6fd05253fc30eb70c/family1 in testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c. 2023-03-06 11:55:50,661 INFO [Listener at localhost/46717] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/306a91a6892045909bfd8d2fa20e3d07, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/ef09b1b6393b418a9bae617dbb52b822, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/fd5561a340c7417ebc42529da127b851, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/e1d6306f346045c7a65451b81473cbf9, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/dd8a3e83e78d4c829064fbfed67d3657] into tmpdir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/.tmp, totalSize=26.7 K 2023-03-06 11:55:50,661 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting 306a91a6892045909bfd8d2fa20e3d07, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678103737937 2023-03-06 11:55:50,662 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting ef09b1b6393b418a9bae617dbb52b822, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678103739321 2023-03-06 11:55:50,662 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting fd5561a340c7417ebc42529da127b851, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678103741109 2023-03-06 11:55:50,662 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting e1d6306f346045c7a65451b81473cbf9, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678103742908 2023-03-06 11:55:50,663 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting dd8a3e83e78d4c829064fbfed67d3657, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-06 11:55:50,675 INFO [Listener at localhost/46717] throttle.PressureAwareThroughputController(145): 2f269067b173a7b6fd05253fc30eb70c#family1#compaction#107 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-06 11:55:51,084 INFO [Listener at localhost/46717] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202303064f2652ff889e4410bc16a1688d5e9a09_del 2023-03-06 11:55:51,085 INFO [Listener at localhost/46717] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303064f2652ff889e4410bc16a1688d5e9a09_del to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303064f2652ff889e4410bc16a1688d5e9a09_del 2023-03-06 11:55:51,900 INFO [Listener at localhost/46717] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e9f06a1b951d4ee2b34bf04596434e79 2023-03-06 11:55:51,900 DEBUG [Listener at localhost/46717] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/.tmp/family1/e9f06a1b951d4ee2b34bf04596434e79 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/e9f06a1b951d4ee2b34bf04596434e79 2023-03-06 11:55:51,903 INFO [Listener at localhost/46717] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e9f06a1b951d4ee2b34bf04596434e79 2023-03-06 11:55:51,904 INFO [Listener at localhost/46717] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 2f269067b173a7b6fd05253fc30eb70c/family1 of 2f269067b173a7b6fd05253fc30eb70c into e9f06a1b951d4ee2b34bf04596434e79(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-06 11:55:51,904 DEBUG [Listener at localhost/46717] regionserver.HRegion(2289): Compaction status journal for 2f269067b173a7b6fd05253fc30eb70c: 2023-03-06 11:55:51,904 DEBUG [Listener at localhost/46717] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-06 11:55:51,905 DEBUG [Listener at localhost/46717] regionserver.HStore(1912): 2f269067b173a7b6fd05253fc30eb70c/family2 is initiating major compaction (all files) 2023-03-06 11:55:51,905 INFO [Listener at localhost/46717] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-06 11:55:51,905 INFO [Listener at localhost/46717] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-06 11:55:51,905 INFO [Listener at localhost/46717] regionserver.HRegion(2259): Starting compaction of 2f269067b173a7b6fd05253fc30eb70c/family2 in testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c. 2023-03-06 11:55:51,905 INFO [Listener at localhost/46717] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family2/9b48e09b8f7b4159847efb67f49fece1, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family2/dc963273a6794ce781fbfad08180cc0e, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family2/7d0afd42878e4420b51d38de0fbcc357, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family2/87dd2c76e0704c02bf5d7e6c177f51b2, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family2/ea767a89fb5e410abb52d36abe6cb1c2] into tmpdir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/.tmp, totalSize=25.4 K 2023-03-06 11:55:51,905 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting 9b48e09b8f7b4159847efb67f49fece1, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678103737937 2023-03-06 11:55:51,906 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting dc963273a6794ce781fbfad08180cc0e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678103739321 2023-03-06 11:55:51,906 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting 7d0afd42878e4420b51d38de0fbcc357, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678103741109 2023-03-06 11:55:51,906 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting 87dd2c76e0704c02bf5d7e6c177f51b2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678103742908 2023-03-06 11:55:51,906 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting ea767a89fb5e410abb52d36abe6cb1c2, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-06 11:55:51,916 INFO [Listener at localhost/46717] throttle.PressureAwareThroughputController(145): 2f269067b173a7b6fd05253fc30eb70c#family2#compaction#108 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-06 11:55:52,004 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/306a91a6892045909bfd8d2fa20e3d07, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/ef09b1b6393b418a9bae617dbb52b822, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/fd5561a340c7417ebc42529da127b851, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/e1d6306f346045c7a65451b81473cbf9, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/dd8a3e83e78d4c829064fbfed67d3657] to archive 2023-03-06 11:55:52,005 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:55:52,006 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/306a91a6892045909bfd8d2fa20e3d07 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/306a91a6892045909bfd8d2fa20e3d07 2023-03-06 11:55:52,007 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/ef09b1b6393b418a9bae617dbb52b822 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/ef09b1b6393b418a9bae617dbb52b822 2023-03-06 11:55:52,008 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/fd5561a340c7417ebc42529da127b851 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/fd5561a340c7417ebc42529da127b851 2023-03-06 11:55:52,009 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/e1d6306f346045c7a65451b81473cbf9 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/e1d6306f346045c7a65451b81473cbf9 2023-03-06 11:55:52,010 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/dd8a3e83e78d4c829064fbfed67d3657 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/dd8a3e83e78d4c829064fbfed67d3657 2023-03-06 11:55:52,323 INFO [Listener at localhost/46717] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230306f0f94b45dc4a4d95a50f39e1d776f6ed_del 2023-03-06 11:55:52,324 INFO [Listener at localhost/46717] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230306f0f94b45dc4a4d95a50f39e1d776f6ed_del to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230306f0f94b45dc4a4d95a50f39e1d776f6ed_del 2023-03-06 11:55:53,136 INFO [Listener at localhost/46717] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ee52abce20b34c85a41dd905eabeeaec 2023-03-06 11:55:53,136 DEBUG [Listener at localhost/46717] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/.tmp/family2/ee52abce20b34c85a41dd905eabeeaec as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family2/ee52abce20b34c85a41dd905eabeeaec 2023-03-06 11:55:53,140 INFO [Listener at localhost/46717] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ee52abce20b34c85a41dd905eabeeaec 2023-03-06 11:55:53,141 INFO [Listener at localhost/46717] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 2f269067b173a7b6fd05253fc30eb70c/family2 of 2f269067b173a7b6fd05253fc30eb70c into ee52abce20b34c85a41dd905eabeeaec(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-06 11:55:53,141 DEBUG [Listener at localhost/46717] regionserver.HRegion(2289): Compaction status journal for 2f269067b173a7b6fd05253fc30eb70c: 2023-03-06 11:55:53,141 DEBUG [Listener at localhost/46717] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-06 11:55:53,141 DEBUG [Listener at localhost/46717] regionserver.HStore(1912): c2cfe3f574de2acbbfc1556c57115d2d/family1 is initiating major compaction (all files) 2023-03-06 11:55:53,141 INFO [Listener at localhost/46717] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-06 11:55:53,141 INFO [Listener at localhost/46717] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-06 11:55:53,141 INFO [Listener at localhost/46717] regionserver.HRegion(2259): Starting compaction of c2cfe3f574de2acbbfc1556c57115d2d/family1 in testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d. 2023-03-06 11:55:53,142 INFO [Listener at localhost/46717] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/aea0facd213e46c3ba7bc1001528645c, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/11179992264b4611827cbb05d77aa09e, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/8752ae0e04ef4095a93e824894aeecb8, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/2f93a191ebca4d5c9dca411185590aa6, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/3de8c3c9674c4725b85f43c7564a729f] into tmpdir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/.tmp, totalSize=26.7 K 2023-03-06 11:55:53,142 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting aea0facd213e46c3ba7bc1001528645c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678103737936 2023-03-06 11:55:53,142 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting 11179992264b4611827cbb05d77aa09e, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678103739321 2023-03-06 11:55:53,143 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting 8752ae0e04ef4095a93e824894aeecb8, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678103741109 2023-03-06 11:55:53,143 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting 2f93a191ebca4d5c9dca411185590aa6, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678103742908 2023-03-06 11:55:53,143 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting 3de8c3c9674c4725b85f43c7564a729f, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-06 11:55:53,153 INFO [Listener at localhost/46717] throttle.PressureAwareThroughputController(145): c2cfe3f574de2acbbfc1556c57115d2d#family1#compaction#109 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-06 11:55:53,160 INFO [Listener at localhost/46717] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230306ba38916240ad42869210932b8eebf6e4_del 2023-03-06 11:55:53,160 INFO [Listener at localhost/46717] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230306ba38916240ad42869210932b8eebf6e4_del to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230306ba38916240ad42869210932b8eebf6e4_del 2023-03-06 11:55:53,204 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family2/9b48e09b8f7b4159847efb67f49fece1, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family2/dc963273a6794ce781fbfad08180cc0e, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family2/7d0afd42878e4420b51d38de0fbcc357, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family2/87dd2c76e0704c02bf5d7e6c177f51b2, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family2/ea767a89fb5e410abb52d36abe6cb1c2] to archive 2023-03-06 11:55:53,205 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:55:53,207 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family2/9b48e09b8f7b4159847efb67f49fece1 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family2/9b48e09b8f7b4159847efb67f49fece1 2023-03-06 11:55:53,207 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family2/dc963273a6794ce781fbfad08180cc0e to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family2/dc963273a6794ce781fbfad08180cc0e 2023-03-06 11:55:53,208 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family2/7d0afd42878e4420b51d38de0fbcc357 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family2/7d0afd42878e4420b51d38de0fbcc357 2023-03-06 11:55:53,209 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family2/87dd2c76e0704c02bf5d7e6c177f51b2 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family2/87dd2c76e0704c02bf5d7e6c177f51b2 2023-03-06 11:55:53,210 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family2/ea767a89fb5e410abb52d36abe6cb1c2 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family2/ea767a89fb5e410abb52d36abe6cb1c2 2023-03-06 11:55:53,972 INFO [Listener at localhost/46717] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 26cc4c4616f64ec5a5dc4b4c92596f83 2023-03-06 11:55:53,973 DEBUG [Listener at localhost/46717] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/.tmp/family1/26cc4c4616f64ec5a5dc4b4c92596f83 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/26cc4c4616f64ec5a5dc4b4c92596f83 2023-03-06 11:55:53,977 INFO [Listener at localhost/46717] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 26cc4c4616f64ec5a5dc4b4c92596f83 2023-03-06 11:55:53,978 INFO [Listener at localhost/46717] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in c2cfe3f574de2acbbfc1556c57115d2d/family1 of c2cfe3f574de2acbbfc1556c57115d2d into 26cc4c4616f64ec5a5dc4b4c92596f83(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-06 11:55:53,978 DEBUG [Listener at localhost/46717] regionserver.HRegion(2289): Compaction status journal for c2cfe3f574de2acbbfc1556c57115d2d: 2023-03-06 11:55:53,978 DEBUG [Listener at localhost/46717] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-06 11:55:53,978 DEBUG [Listener at localhost/46717] regionserver.HStore(1912): c2cfe3f574de2acbbfc1556c57115d2d/family2 is initiating major compaction (all files) 2023-03-06 11:55:53,978 INFO [Listener at localhost/46717] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-06 11:55:53,978 INFO [Listener at localhost/46717] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-06 11:55:53,978 INFO [Listener at localhost/46717] regionserver.HRegion(2259): Starting compaction of c2cfe3f574de2acbbfc1556c57115d2d/family2 in testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d. 2023-03-06 11:55:53,979 INFO [Listener at localhost/46717] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family2/55c8f076991b4637ad28854f49c12c2e, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family2/1c50ec366ebb4fa1ae19df1bcdd90ce4, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family2/3e4f939b432142e682c697adc6d4bb4d, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family2/5cc62b27f8ad4edf8b330b0c303b9512, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family2/eb422fa4a8ef45319bfa50d969b319a3] into tmpdir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/.tmp, totalSize=25.4 K 2023-03-06 11:55:53,979 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting 55c8f076991b4637ad28854f49c12c2e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678103737936 2023-03-06 11:55:53,979 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting 1c50ec366ebb4fa1ae19df1bcdd90ce4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678103739321 2023-03-06 11:55:53,980 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting 3e4f939b432142e682c697adc6d4bb4d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678103741109 2023-03-06 11:55:53,980 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting 5cc62b27f8ad4edf8b330b0c303b9512, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678103742908 2023-03-06 11:55:53,980 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting eb422fa4a8ef45319bfa50d969b319a3, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-06 11:55:53,991 INFO [Listener at localhost/46717] throttle.PressureAwareThroughputController(145): c2cfe3f574de2acbbfc1556c57115d2d#family2#compaction#110 average throughput is 0.35 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-06 11:55:54,001 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/aea0facd213e46c3ba7bc1001528645c, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/11179992264b4611827cbb05d77aa09e, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/8752ae0e04ef4095a93e824894aeecb8, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/2f93a191ebca4d5c9dca411185590aa6, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/3de8c3c9674c4725b85f43c7564a729f] to archive 2023-03-06 11:55:54,001 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:55:54,003 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/aea0facd213e46c3ba7bc1001528645c to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/aea0facd213e46c3ba7bc1001528645c 2023-03-06 11:55:54,004 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/11179992264b4611827cbb05d77aa09e to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/11179992264b4611827cbb05d77aa09e 2023-03-06 11:55:54,005 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/8752ae0e04ef4095a93e824894aeecb8 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/8752ae0e04ef4095a93e824894aeecb8 2023-03-06 11:55:54,006 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/2f93a191ebca4d5c9dca411185590aa6 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/2f93a191ebca4d5c9dca411185590aa6 2023-03-06 11:55:54,007 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/3de8c3c9674c4725b85f43c7564a729f to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/3de8c3c9674c4725b85f43c7564a729f 2023-03-06 11:55:54,399 INFO [Listener at localhost/46717] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230306e4a5d177834d4502813451ed7c490b47_del 2023-03-06 11:55:54,399 INFO [Listener at localhost/46717] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230306e4a5d177834d4502813451ed7c490b47_del to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230306e4a5d177834d4502813451ed7c490b47_del 2023-03-06 11:55:55,212 INFO [Listener at localhost/46717] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2b3110281eff49229f6734d5a9cc2da6 2023-03-06 11:55:55,212 DEBUG [Listener at localhost/46717] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/.tmp/family2/2b3110281eff49229f6734d5a9cc2da6 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family2/2b3110281eff49229f6734d5a9cc2da6 2023-03-06 11:55:55,216 INFO [Listener at localhost/46717] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2b3110281eff49229f6734d5a9cc2da6 2023-03-06 11:55:55,217 INFO [Listener at localhost/46717] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in c2cfe3f574de2acbbfc1556c57115d2d/family2 of c2cfe3f574de2acbbfc1556c57115d2d into 2b3110281eff49229f6734d5a9cc2da6(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-06 11:55:55,217 DEBUG [Listener at localhost/46717] regionserver.HRegion(2289): Compaction status journal for c2cfe3f574de2acbbfc1556c57115d2d: 2023-03-06 11:55:55,217 DEBUG [Listener at localhost/46717] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-06 11:55:55,217 DEBUG [Listener at localhost/46717] regionserver.HStore(1912): b28bd01ac58b51da722995493250192e/family1 is initiating major compaction (all files) 2023-03-06 11:55:55,217 INFO [Listener at localhost/46717] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-06 11:55:55,217 INFO [Listener at localhost/46717] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-06 11:55:55,217 INFO [Listener at localhost/46717] regionserver.HRegion(2259): Starting compaction of b28bd01ac58b51da722995493250192e/family1 in testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e. 2023-03-06 11:55:55,217 INFO [Listener at localhost/46717] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/521f7fea656f4bf0a6a34619819b9b96, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/c3eb14c8d0a7468087260ec76443837a, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/222bd21269334cb2b0e7a1802939feae, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/40dba177f68a45158f9d5b5d497c8b90, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/5d51f9bda9a74f4d91f3f0ecbed8f27d] into tmpdir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/.tmp, totalSize=26.7 K 2023-03-06 11:55:55,218 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting 521f7fea656f4bf0a6a34619819b9b96, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678103737938 2023-03-06 11:55:55,218 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting c3eb14c8d0a7468087260ec76443837a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678103739321 2023-03-06 11:55:55,218 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting 222bd21269334cb2b0e7a1802939feae, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678103741109 2023-03-06 11:55:55,219 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting 40dba177f68a45158f9d5b5d497c8b90, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678103742908 2023-03-06 11:55:55,219 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting 5d51f9bda9a74f4d91f3f0ecbed8f27d, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-06 11:55:55,228 INFO [Listener at localhost/46717] throttle.PressureAwareThroughputController(145): b28bd01ac58b51da722995493250192e#family1#compaction#111 average throughput is 0.85 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-06 11:55:55,304 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family2/55c8f076991b4637ad28854f49c12c2e, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family2/1c50ec366ebb4fa1ae19df1bcdd90ce4, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family2/3e4f939b432142e682c697adc6d4bb4d, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family2/5cc62b27f8ad4edf8b330b0c303b9512, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family2/eb422fa4a8ef45319bfa50d969b319a3] to archive 2023-03-06 11:55:55,305 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:55:55,307 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family2/55c8f076991b4637ad28854f49c12c2e to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family2/55c8f076991b4637ad28854f49c12c2e 2023-03-06 11:55:55,308 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family2/1c50ec366ebb4fa1ae19df1bcdd90ce4 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family2/1c50ec366ebb4fa1ae19df1bcdd90ce4 2023-03-06 11:55:55,309 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family2/3e4f939b432142e682c697adc6d4bb4d to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family2/3e4f939b432142e682c697adc6d4bb4d 2023-03-06 11:55:55,310 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family2/5cc62b27f8ad4edf8b330b0c303b9512 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family2/5cc62b27f8ad4edf8b330b0c303b9512 2023-03-06 11:55:55,311 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family2/eb422fa4a8ef45319bfa50d969b319a3 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family2/eb422fa4a8ef45319bfa50d969b319a3 2023-03-06 11:55:55,635 INFO [Listener at localhost/46717] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230306e4908784eef04885a8f7e18b80576631_del 2023-03-06 11:55:55,635 INFO [Listener at localhost/46717] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230306e4908784eef04885a8f7e18b80576631_del to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230306e4908784eef04885a8f7e18b80576631_del 2023-03-06 11:55:56,448 INFO [Listener at localhost/46717] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 967ba174e0d1415d9483f3ebae22c4e6 2023-03-06 11:55:56,449 DEBUG [Listener at localhost/46717] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/.tmp/family1/967ba174e0d1415d9483f3ebae22c4e6 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/967ba174e0d1415d9483f3ebae22c4e6 2023-03-06 11:55:56,452 INFO [Listener at localhost/46717] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 967ba174e0d1415d9483f3ebae22c4e6 2023-03-06 11:55:56,453 INFO [Listener at localhost/46717] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in b28bd01ac58b51da722995493250192e/family1 of b28bd01ac58b51da722995493250192e into 967ba174e0d1415d9483f3ebae22c4e6(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-06 11:55:56,453 DEBUG [Listener at localhost/46717] regionserver.HRegion(2289): Compaction status journal for b28bd01ac58b51da722995493250192e: 2023-03-06 11:55:56,453 DEBUG [Listener at localhost/46717] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-06 11:55:56,453 DEBUG [Listener at localhost/46717] regionserver.HStore(1912): b28bd01ac58b51da722995493250192e/family2 is initiating major compaction (all files) 2023-03-06 11:55:56,453 INFO [Listener at localhost/46717] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-06 11:55:56,453 INFO [Listener at localhost/46717] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-06 11:55:56,453 INFO [Listener at localhost/46717] regionserver.HRegion(2259): Starting compaction of b28bd01ac58b51da722995493250192e/family2 in testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e. 2023-03-06 11:55:56,454 INFO [Listener at localhost/46717] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family2/453f644748d341d69bac9afdb03542b4, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family2/e34a67de00c04775a1ee3cd89ea6cfc6, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family2/40ac62114b9142a1b234682618c9abaa, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family2/3d762d3394994f9db9eaaa5bc78cd499, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family2/e2c6879f80bf47b8aafd5f0abda78032] into tmpdir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/.tmp, totalSize=25.4 K 2023-03-06 11:55:56,454 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting 453f644748d341d69bac9afdb03542b4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678103737938 2023-03-06 11:55:56,454 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting e34a67de00c04775a1ee3cd89ea6cfc6, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678103739321 2023-03-06 11:55:56,454 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting 40ac62114b9142a1b234682618c9abaa, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678103741109 2023-03-06 11:55:56,455 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting 3d762d3394994f9db9eaaa5bc78cd499, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678103742908 2023-03-06 11:55:56,455 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting e2c6879f80bf47b8aafd5f0abda78032, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-06 11:55:56,469 INFO [Listener at localhost/46717] throttle.PressureAwareThroughputController(145): b28bd01ac58b51da722995493250192e#family2#compaction#112 average throughput is 0.26 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-06 11:55:56,503 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/521f7fea656f4bf0a6a34619819b9b96, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/c3eb14c8d0a7468087260ec76443837a, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/222bd21269334cb2b0e7a1802939feae, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/40dba177f68a45158f9d5b5d497c8b90, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/5d51f9bda9a74f4d91f3f0ecbed8f27d] to archive 2023-03-06 11:55:56,504 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:55:56,505 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/521f7fea656f4bf0a6a34619819b9b96 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/521f7fea656f4bf0a6a34619819b9b96 2023-03-06 11:55:56,506 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/c3eb14c8d0a7468087260ec76443837a to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/c3eb14c8d0a7468087260ec76443837a 2023-03-06 11:55:56,507 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/222bd21269334cb2b0e7a1802939feae to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/222bd21269334cb2b0e7a1802939feae 2023-03-06 11:55:56,509 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/40dba177f68a45158f9d5b5d497c8b90 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/40dba177f68a45158f9d5b5d497c8b90 2023-03-06 11:55:56,510 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/5d51f9bda9a74f4d91f3f0ecbed8f27d to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/5d51f9bda9a74f4d91f3f0ecbed8f27d 2023-03-06 11:55:56,879 INFO [Listener at localhost/46717] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230306bc6e126b801747d399c27c43d5a7171c_del 2023-03-06 11:55:56,879 INFO [Listener at localhost/46717] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230306bc6e126b801747d399c27c43d5a7171c_del to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230306bc6e126b801747d399c27c43d5a7171c_del 2023-03-06 11:55:57,692 INFO [Listener at localhost/46717] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dfa084d4eb5c48ba9f6635cc667386c6 2023-03-06 11:55:57,693 DEBUG [Listener at localhost/46717] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/.tmp/family2/dfa084d4eb5c48ba9f6635cc667386c6 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family2/dfa084d4eb5c48ba9f6635cc667386c6 2023-03-06 11:55:57,696 INFO [Listener at localhost/46717] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dfa084d4eb5c48ba9f6635cc667386c6 2023-03-06 11:55:57,697 INFO [Listener at localhost/46717] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in b28bd01ac58b51da722995493250192e/family2 of b28bd01ac58b51da722995493250192e into dfa084d4eb5c48ba9f6635cc667386c6(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-06 11:55:57,697 DEBUG [Listener at localhost/46717] regionserver.HRegion(2289): Compaction status journal for b28bd01ac58b51da722995493250192e: 2023-03-06 11:55:57,699 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family2/453f644748d341d69bac9afdb03542b4, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family2/e34a67de00c04775a1ee3cd89ea6cfc6, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family2/40ac62114b9142a1b234682618c9abaa, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family2/3d762d3394994f9db9eaaa5bc78cd499, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family2/e2c6879f80bf47b8aafd5f0abda78032] to archive 2023-03-06 11:55:57,701 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:55:57,702 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family2/453f644748d341d69bac9afdb03542b4 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family2/453f644748d341d69bac9afdb03542b4 2023-03-06 11:55:57,702 DEBUG [Listener at localhost/46717] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-06 11:55:57,703 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family2/e34a67de00c04775a1ee3cd89ea6cfc6 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family2/e34a67de00c04775a1ee3cd89ea6cfc6 2023-03-06 11:55:57,705 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family2/40ac62114b9142a1b234682618c9abaa to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family2/40ac62114b9142a1b234682618c9abaa 2023-03-06 11:55:57,706 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family2/3d762d3394994f9db9eaaa5bc78cd499 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family2/3d762d3394994f9db9eaaa5bc78cd499 2023-03-06 11:55:57,706 DEBUG [Listener at localhost/46717] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-06 11:55:57,707 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family2/e2c6879f80bf47b8aafd5f0abda78032 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family2/e2c6879f80bf47b8aafd5f0abda78032 2023-03-06 11:55:57,711 DEBUG [Listener at localhost/46717] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-06 11:55:57,712 DEBUG [Listener at localhost/46717] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-06 11:55:57,719 INFO [Listener at localhost/46717] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-06 11:55:57,750 INFO [Listener at localhost/46717] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-03-06 11:55:57,753 INFO [Listener at localhost/46717] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230306ba38916240ad42869210932b8eebf6e4_del 2023-03-06 11:55:57,756 INFO [Listener at localhost/46717] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202303064f2652ff889e4410bc16a1688d5e9a09_del 2023-03-06 11:55:57,758 INFO [Listener at localhost/46717] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230306e4908784eef04885a8f7e18b80576631_del 2023-03-06 11:55:57,758 INFO [Listener at localhost/46717] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testCompactionWithHFileLink' column='family1' 2023-03-06 11:55:57,759 DEBUG [Listener at localhost/46717] zookeeper.ReadOnlyZKClient(139): Connect 0x3eac4e78 to 127.0.0.1:62659 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-06 11:55:57,764 DEBUG [Listener at localhost/46717] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7c7517f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-06 11:55:57,764 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230306 for table='testCompactionWithHFileLink' and column='family1' 2023-03-06 11:55:57,764 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230306 for table='testCompactionWithHFileLink' and column='family1' 2023-03-06 11:55:57,764 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230306 for table='testCompactionWithHFileLink' and column='family1' 2023-03-06 11:55:58,215 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230306fb333997e65d4255b4fecca412d331ec to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230306fb333997e65d4255b4fecca412d331ec 2023-03-06 11:55:58,216 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230306 table='testCompactionWithHFileLink' column='family1' 2023-03-06 11:55:58,229 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-06 11:55:58,232 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:38536, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-06 11:55:58,237 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-06 11:55:58,239 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:49840, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-06 11:55:58,246 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230306/family1/938efe62d73c43f0acbdfe2dbdcefebb first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-03-06 11:55:58,246 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c., hostname=jenkins-hbase5.apache.org,42547,1678103642479, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230306/family1/938efe62d73c43f0acbdfe2dbdcefebb}] 2023-03-06 11:55:58,250 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(763): Validating hfile at hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230306/family1/938efe62d73c43f0acbdfe2dbdcefebb for inclusion in 2f269067b173a7b6fd05253fc30eb70c/family1 2023-03-06 11:55:58,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-03-06 11:55:58,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(777): Region bounds: first=1 last=2 2023-03-06 11:55:58,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegion(2446): Flush status journal for 2f269067b173a7b6fd05253fc30eb70c: 2023-03-06 11:55:58,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230306/family1/938efe62d73c43f0acbdfe2dbdcefebb to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testCompactionWithHFileLink__e9kejavck4bjjmqh0fvoufbgenodl7s83eijbslmbf4q8bghmekt50baaagmb2rm/family1/938efe62d73c43f0acbdfe2dbdcefebb 2023-03-06 11:55:58,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testCompactionWithHFileLink__e9kejavck4bjjmqh0fvoufbgenodl7s83eijbslmbf4q8bghmekt50baaagmb2rm/family1/938efe62d73c43f0acbdfe2dbdcefebb as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/60193256dfc143549f3eb332132f9bf0_SeqId_29_ 2023-03-06 11:55:58,254 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(849): Loaded HFile hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testCompactionWithHFileLink__e9kejavck4bjjmqh0fvoufbgenodl7s83eijbslmbf4q8bghmekt50baaagmb2rm/family1/938efe62d73c43f0acbdfe2dbdcefebb into 2f269067b173a7b6fd05253fc30eb70c/family1 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/60193256dfc143549f3eb332132f9bf0_SeqId_29_ - updating store file list. 2023-03-06 11:55:58,257 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(882): Loaded HFile hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/60193256dfc143549f3eb332132f9bf0_SeqId_29_ into 2f269067b173a7b6fd05253fc30eb70c/family1 2023-03-06 11:55:58,257 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(855): Successfully loaded hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testCompactionWithHFileLink__e9kejavck4bjjmqh0fvoufbgenodl7s83eijbslmbf4q8bghmekt50baaagmb2rm/family1/938efe62d73c43f0acbdfe2dbdcefebb into 2f269067b173a7b6fd05253fc30eb70c/family1 (new location: hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/60193256dfc143549f3eb332132f9bf0_SeqId_29_) 2023-03-06 11:55:58,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testCompactionWithHFileLink__e9kejavck4bjjmqh0fvoufbgenodl7s83eijbslmbf4q8bghmekt50baaagmb2rm/family1/938efe62d73c43f0acbdfe2dbdcefebb 2023-03-06 11:55:58,259 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230306 table='testCompactionWithHFileLink' column='family1' 2023-03-06 11:55:58,259 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:55:58,260 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230306276c4eb3750e4cd8a288882063ffda33 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230306276c4eb3750e4cd8a288882063ffda33 2023-03-06 11:55:58,261 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230306bf7eb4a9b83846bc8bf24136a7371f4b to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230306bf7eb4a9b83846bc8bf24136a7371f4b 2023-03-06 11:55:58,261 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230306d631bc914a074bb4a12b9a982a26f16e to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230306d631bc914a074bb4a12b9a982a26f16e 2023-03-06 11:55:58,262 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230306fa07443919b04eb8bb92bbc37962d241 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230306fa07443919b04eb8bb92bbc37962d241 2023-03-06 11:55:58,262 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-06 11:55:58,262 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230306' 2023-03-06 11:55:58,262 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230306 for table='testCompactionWithHFileLink' and column='family1' 2023-03-06 11:55:58,619 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303062bdd47c1b3a7491cbf9b437a38a37055 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303062bdd47c1b3a7491cbf9b437a38a37055 2023-03-06 11:55:58,619 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023030608ce0bfa74b14e0b8701ddc3845272bc to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023030608ce0bfa74b14e0b8701ddc3845272bc 2023-03-06 11:55:58,620 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230306 table='testCompactionWithHFileLink' column='family1' 2023-03-06 11:55:58,620 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230306 table='testCompactionWithHFileLink' column='family1' 2023-03-06 11:55:58,645 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230306/family1/9f48ccf388194fc7b0f6eb53a6b929a7 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-03-06 11:55:58,650 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d., hostname=jenkins-hbase5.apache.org,42547,1678103642479, seqNum=2 for row with hfile group [{family1,hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230306/family1/9f48ccf388194fc7b0f6eb53a6b929a7}] 2023-03-06 11:55:58,652 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42547] regionserver.HStore(763): Validating hfile at hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230306/family1/9f48ccf388194fc7b0f6eb53a6b929a7 for inclusion in c2cfe3f574de2acbbfc1556c57115d2d/family1 2023-03-06 11:55:58,652 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230306/family1/6ca830039b454ec5b0a775b3b571a4fc first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-03-06 11:55:58,653 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e., hostname=jenkins-hbase5.apache.org,42547,1678103642479, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230306/family1/6ca830039b454ec5b0a775b3b571a4fc}] 2023-03-06 11:55:58,654 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(763): Validating hfile at hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230306/family1/6ca830039b454ec5b0a775b3b571a4fc for inclusion in b28bd01ac58b51da722995493250192e/family1 2023-03-06 11:55:58,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42547] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-03-06 11:55:58,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42547] regionserver.HStore(777): Region bounds: first= last=1 2023-03-06 11:55:58,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42547] regionserver.HRegion(2446): Flush status journal for c2cfe3f574de2acbbfc1556c57115d2d: 2023-03-06 11:55:58,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42547] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230306/family1/9f48ccf388194fc7b0f6eb53a6b929a7 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testCompactionWithHFileLink__pmi413vs4c2i0qfuubgusgkugeocpov4chqihvbmfmsn3t94p3vujie10m8bsb6u/family1/9f48ccf388194fc7b0f6eb53a6b929a7 2023-03-06 11:55:58,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-03-06 11:55:58,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(777): Region bounds: first=2 last= 2023-03-06 11:55:58,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegion(2446): Flush status journal for b28bd01ac58b51da722995493250192e: 2023-03-06 11:55:58,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230306/family1/6ca830039b454ec5b0a775b3b571a4fc to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testCompactionWithHFileLink__tfutmogbratel6rmf4st5v9ah6u159fn7hmlespallm15oqpl36ekf7lslf3d0to/family1/6ca830039b454ec5b0a775b3b571a4fc 2023-03-06 11:55:58,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42547] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testCompactionWithHFileLink__pmi413vs4c2i0qfuubgusgkugeocpov4chqihvbmfmsn3t94p3vujie10m8bsb6u/family1/9f48ccf388194fc7b0f6eb53a6b929a7 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/89bd82db2d124547b4a0c4d7a846ea66_SeqId_29_ 2023-03-06 11:55:58,659 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42547] regionserver.HStore(849): Loaded HFile hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testCompactionWithHFileLink__pmi413vs4c2i0qfuubgusgkugeocpov4chqihvbmfmsn3t94p3vujie10m8bsb6u/family1/9f48ccf388194fc7b0f6eb53a6b929a7 into c2cfe3f574de2acbbfc1556c57115d2d/family1 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/89bd82db2d124547b4a0c4d7a846ea66_SeqId_29_ - updating store file list. 2023-03-06 11:55:58,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testCompactionWithHFileLink__tfutmogbratel6rmf4st5v9ah6u159fn7hmlespallm15oqpl36ekf7lslf3d0to/family1/6ca830039b454ec5b0a775b3b571a4fc as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/a58ea0b5d64647909c2de4ce741aaba3_SeqId_29_ 2023-03-06 11:55:58,661 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(849): Loaded HFile hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testCompactionWithHFileLink__tfutmogbratel6rmf4st5v9ah6u159fn7hmlespallm15oqpl36ekf7lslf3d0to/family1/6ca830039b454ec5b0a775b3b571a4fc into b28bd01ac58b51da722995493250192e/family1 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/a58ea0b5d64647909c2de4ce741aaba3_SeqId_29_ - updating store file list. 2023-03-06 11:55:58,662 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42547] regionserver.HStore(882): Loaded HFile hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/89bd82db2d124547b4a0c4d7a846ea66_SeqId_29_ into c2cfe3f574de2acbbfc1556c57115d2d/family1 2023-03-06 11:55:58,662 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42547] regionserver.HStore(855): Successfully loaded hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testCompactionWithHFileLink__pmi413vs4c2i0qfuubgusgkugeocpov4chqihvbmfmsn3t94p3vujie10m8bsb6u/family1/9f48ccf388194fc7b0f6eb53a6b929a7 into c2cfe3f574de2acbbfc1556c57115d2d/family1 (new location: hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/89bd82db2d124547b4a0c4d7a846ea66_SeqId_29_) 2023-03-06 11:55:58,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42547] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testCompactionWithHFileLink__pmi413vs4c2i0qfuubgusgkugeocpov4chqihvbmfmsn3t94p3vujie10m8bsb6u/family1/9f48ccf388194fc7b0f6eb53a6b929a7 2023-03-06 11:55:58,664 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(882): Loaded HFile hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/a58ea0b5d64647909c2de4ce741aaba3_SeqId_29_ into b28bd01ac58b51da722995493250192e/family1 2023-03-06 11:55:58,664 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(855): Successfully loaded hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testCompactionWithHFileLink__tfutmogbratel6rmf4st5v9ah6u159fn7hmlespallm15oqpl36ekf7lslf3d0to/family1/6ca830039b454ec5b0a775b3b571a4fc into b28bd01ac58b51da722995493250192e/family1 (new location: hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/a58ea0b5d64647909c2de4ce741aaba3_SeqId_29_) 2023-03-06 11:55:58,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testCompactionWithHFileLink__tfutmogbratel6rmf4st5v9ah6u159fn7hmlespallm15oqpl36ekf7lslf3d0to/family1/6ca830039b454ec5b0a775b3b571a4fc 2023-03-06 11:55:58,665 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230306 table='testCompactionWithHFileLink' column='family1' 2023-03-06 11:55:58,665 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:55:58,666 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230306 table='testCompactionWithHFileLink' column='family1' 2023-03-06 11:55:58,666 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:55:58,667 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023030623dafbf6b980413dac2036d2150cb244 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023030623dafbf6b980413dac2036d2150cb244 2023-03-06 11:55:58,667 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023030624719d5ccbd74c628d8cbe46fee355ec to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023030624719d5ccbd74c628d8cbe46fee355ec 2023-03-06 11:55:58,668 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023030660002a2d456d4adc97635b1c16827677 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023030660002a2d456d4adc97635b1c16827677 2023-03-06 11:55:58,669 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303067011e99a256540749bea0778e1de7574 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303067011e99a256540749bea0778e1de7574 2023-03-06 11:55:58,669 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023030663cd81e529c54b83b1daefd26c6b83be to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023030663cd81e529c54b83b1daefd26c6b83be 2023-03-06 11:55:58,670 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230306c11f7967e9eb4cd594cabd367a739dfb to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230306c11f7967e9eb4cd594cabd367a739dfb 2023-03-06 11:55:58,670 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023030665e56004b53049b8816e156ba235feff to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023030665e56004b53049b8816e156ba235feff 2023-03-06 11:55:58,670 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-06 11:55:58,670 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230306' 2023-03-06 11:55:58,670 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230306 for table='testCompactionWithHFileLink' and column='family1' 2023-03-06 11:55:58,671 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230306fe59fbd6fddf403cb72ea83968b5fee0 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230306fe59fbd6fddf403cb72ea83968b5fee0 2023-03-06 11:55:58,671 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-06 11:55:58,671 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230306' 2023-03-06 11:55:58,671 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230306 for table='testCompactionWithHFileLink' and column='family1' 2023-03-06 11:55:58,671 INFO [Listener at localhost/46717] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-03-06 11:55:58,671 INFO [Listener at localhost/46717] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testCompactionWithHFileLink' and column='family1' 2023-03-06 11:55:58,671 INFO [Listener at localhost/46717] compactions.PartitionedMobCompactor(367): [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230306ba38916240ad42869210932b8eebf6e4_del] 2023-03-06 11:55:58,672 DEBUG [Listener at localhost/46717] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:55:58,673 DEBUG [Listener at localhost/46717] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230306ba38916240ad42869210932b8eebf6e4_del to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230306ba38916240ad42869210932b8eebf6e4_del 2023-03-06 11:55:58,673 INFO [Listener at localhost/46717] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-03-06 11:55:58,673 INFO [Listener at localhost/46717] compactions.PartitionedMobCompactor(367): [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303064f2652ff889e4410bc16a1688d5e9a09_del] 2023-03-06 11:55:58,673 DEBUG [Listener at localhost/46717] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:55:58,674 DEBUG [Listener at localhost/46717] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303064f2652ff889e4410bc16a1688d5e9a09_del to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303064f2652ff889e4410bc16a1688d5e9a09_del 2023-03-06 11:55:58,674 INFO [Listener at localhost/46717] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-03-06 11:55:58,674 INFO [Listener at localhost/46717] compactions.PartitionedMobCompactor(367): [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230306e4908784eef04885a8f7e18b80576631_del] 2023-03-06 11:55:58,675 DEBUG [Listener at localhost/46717] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:55:58,675 DEBUG [Listener at localhost/46717] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230306e4908784eef04885a8f7e18b80576631_del to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230306e4908784eef04885a8f7e18b80576631_del 2023-03-06 11:55:58,676 INFO [Listener at localhost/46717] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-03-06 11:55:58,678 DEBUG [Listener at localhost/46717] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-06 11:55:58,680 DEBUG [Listener at localhost/46717] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-06 11:55:58,683 DEBUG [Listener at localhost/46717] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-06 11:55:58,683 DEBUG [Listener at localhost/46717] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-06 11:55:58,688 INFO [Listener at localhost/46717] client.HBaseAdmin$15(890): Started disable of testCompactionWithHFileLink 2023-03-06 11:55:58,688 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] master.HMaster$11(2418): Client=jenkins//172.31.10.131 disable testCompactionWithHFileLink 2023-03-06 11:55:58,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] procedure2.ProcedureExecutor(1029): Stored pid=88, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testCompactionWithHFileLink 2023-03-06 11:55:58,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-03-06 11:55:58,691 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678103758691"}]},"ts":"1678103758691"} 2023-03-06 11:55:58,692 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLING in hbase:meta 2023-03-06 11:55:58,694 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testCompactionWithHFileLink to state=DISABLING 2023-03-06 11:55:58,694 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c2cfe3f574de2acbbfc1556c57115d2d, UNASSIGN}, {pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=2f269067b173a7b6fd05253fc30eb70c, UNASSIGN}, {pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b28bd01ac58b51da722995493250192e, UNASSIGN}] 2023-03-06 11:55:58,695 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=2f269067b173a7b6fd05253fc30eb70c, UNASSIGN 2023-03-06 11:55:58,696 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c2cfe3f574de2acbbfc1556c57115d2d, UNASSIGN 2023-03-06 11:55:58,696 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b28bd01ac58b51da722995493250192e, UNASSIGN 2023-03-06 11:55:58,696 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=2f269067b173a7b6fd05253fc30eb70c, regionState=CLOSING, regionLocation=jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:58,696 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=c2cfe3f574de2acbbfc1556c57115d2d, regionState=CLOSING, regionLocation=jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:58,696 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678103758696"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678103758696"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678103758696"}]},"ts":"1678103758696"} 2023-03-06 11:55:58,696 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=b28bd01ac58b51da722995493250192e, regionState=CLOSING, regionLocation=jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:55:58,696 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678103758696"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678103758696"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678103758696"}]},"ts":"1678103758696"} 2023-03-06 11:55:58,696 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678103758696"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678103758696"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678103758696"}]},"ts":"1678103758696"} 2023-03-06 11:55:58,697 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=92, ppid=90, state=RUNNABLE; CloseRegionProcedure 2f269067b173a7b6fd05253fc30eb70c, server=jenkins-hbase5.apache.org,42547,1678103642479}] 2023-03-06 11:55:58,698 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=89, state=RUNNABLE; CloseRegionProcedure c2cfe3f574de2acbbfc1556c57115d2d, server=jenkins-hbase5.apache.org,42547,1678103642479}] 2023-03-06 11:55:58,698 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; CloseRegionProcedure b28bd01ac58b51da722995493250192e, server=jenkins-hbase5.apache.org,42547,1678103642479}] 2023-03-06 11:55:58,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-03-06 11:55:58,849 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(109): Close c2cfe3f574de2acbbfc1556c57115d2d 2023-03-06 11:55:58,849 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing c2cfe3f574de2acbbfc1556c57115d2d, disabling compactions & flushes 2023-03-06 11:55:58,849 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d. 2023-03-06 11:55:58,849 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d. 2023-03-06 11:55:58,849 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d. after waiting 0 ms 2023-03-06 11:55:58,849 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d. 2023-03-06 11:55:58,853 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-03-06 11:55:58,854 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d. 2023-03-06 11:55:58,854 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for c2cfe3f574de2acbbfc1556c57115d2d: 2023-03-06 11:55:58,855 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(147): Closed c2cfe3f574de2acbbfc1556c57115d2d 2023-03-06 11:55:58,855 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(109): Close 2f269067b173a7b6fd05253fc30eb70c 2023-03-06 11:55:58,856 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 2f269067b173a7b6fd05253fc30eb70c, disabling compactions & flushes 2023-03-06 11:55:58,856 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c. 2023-03-06 11:55:58,856 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c. 2023-03-06 11:55:58,856 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c. after waiting 0 ms 2023-03-06 11:55:58,856 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c. 2023-03-06 11:55:58,856 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=c2cfe3f574de2acbbfc1556c57115d2d, regionState=CLOSED 2023-03-06 11:55:58,856 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678103758856"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678103758856"}]},"ts":"1678103758856"} 2023-03-06 11:55:58,858 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=89 2023-03-06 11:55:58,859 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=89, state=SUCCESS; CloseRegionProcedure c2cfe3f574de2acbbfc1556c57115d2d, server=jenkins-hbase5.apache.org,42547,1678103642479 in 159 msec 2023-03-06 11:55:58,859 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-03-06 11:55:58,859 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=89, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c2cfe3f574de2acbbfc1556c57115d2d, UNASSIGN in 165 msec 2023-03-06 11:55:58,860 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c. 2023-03-06 11:55:58,860 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 2f269067b173a7b6fd05253fc30eb70c: 2023-03-06 11:55:58,861 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(147): Closed 2f269067b173a7b6fd05253fc30eb70c 2023-03-06 11:55:58,861 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(109): Close b28bd01ac58b51da722995493250192e 2023-03-06 11:55:58,861 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing b28bd01ac58b51da722995493250192e, disabling compactions & flushes 2023-03-06 11:55:58,861 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e. 2023-03-06 11:55:58,861 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e. 2023-03-06 11:55:58,861 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e. after waiting 0 ms 2023-03-06 11:55:58,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e. 2023-03-06 11:55:58,862 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=2f269067b173a7b6fd05253fc30eb70c, regionState=CLOSED 2023-03-06 11:55:58,862 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678103758862"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678103758862"}]},"ts":"1678103758862"} 2023-03-06 11:55:58,864 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-03-06 11:55:58,864 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; CloseRegionProcedure 2f269067b173a7b6fd05253fc30eb70c, server=jenkins-hbase5.apache.org,42547,1678103642479 in 166 msec 2023-03-06 11:55:58,865 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=90, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=2f269067b173a7b6fd05253fc30eb70c, UNASSIGN in 170 msec 2023-03-06 11:55:58,865 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-03-06 11:55:58,866 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e. 2023-03-06 11:55:58,866 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for b28bd01ac58b51da722995493250192e: 2023-03-06 11:55:58,867 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(147): Closed b28bd01ac58b51da722995493250192e 2023-03-06 11:55:58,867 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=b28bd01ac58b51da722995493250192e, regionState=CLOSED 2023-03-06 11:55:58,867 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678103758867"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678103758867"}]},"ts":"1678103758867"} 2023-03-06 11:55:58,869 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=91 2023-03-06 11:55:58,869 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=91, state=SUCCESS; CloseRegionProcedure b28bd01ac58b51da722995493250192e, server=jenkins-hbase5.apache.org,42547,1678103642479 in 170 msec 2023-03-06 11:55:58,870 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=91, resume processing ppid=88 2023-03-06 11:55:58,870 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b28bd01ac58b51da722995493250192e, UNASSIGN in 175 msec 2023-03-06 11:55:58,871 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678103758871"}]},"ts":"1678103758871"} 2023-03-06 11:55:58,872 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLED in hbase:meta 2023-03-06 11:55:58,875 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testCompactionWithHFileLink to state=DISABLED 2023-03-06 11:55:58,876 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=88, state=SUCCESS; DisableTableProcedure table=testCompactionWithHFileLink in 186 msec 2023-03-06 11:55:58,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-03-06 11:55:58,993 INFO [Listener at localhost/46717] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testCompactionWithHFileLink, procId: 88 completed 2023-03-06 11:55:59,003 INFO [Listener at localhost/46717] client.HBaseAdmin(2586): Taking restore-failsafe snapshot: hbase-failsafe-snaptb-1678103744695-1678103759003 2023-03-06 11:55:59,003 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] master.MasterRpcServices(1580): Client=jenkins//172.31.10.131 snapshot request for:{ ss=hbase-failsafe-snaptb-1678103744695-1678103759003 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-06 11:55:59,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1678103759003 (current time:1678103759003). 2023-03-06 11:55:59,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-03-06 11:55:59,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] zookeeper.ReadOnlyZKClient(139): Connect 0x7c311838 to 127.0.0.1:62659 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-06 11:55:59,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@69ac7e21, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-06 11:55:59,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-06 11:55:59,011 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:38542, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-06 11:55:59,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7c311838 to 127.0.0.1:62659 2023-03-06 11:55:59,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-06 11:55:59,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-03-06 11:55:59,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] snapshot.SnapshotManager(659): Table is disabled, running snapshot entirely on master for { ss=hbase-failsafe-snaptb-1678103744695-1678103759003 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-06 11:55:59,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-06 11:55:59,014 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-06 11:55:59,015 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1678104359015 2023-03-06 11:55:59,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] snapshot.SnapshotManager(664): Started snapshot: { ss=hbase-failsafe-snaptb-1678103744695-1678103759003 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-06 11:55:59,015 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(174): Running DISABLED table snapshot hbase-failsafe-snaptb-1678103744695-1678103759003 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-03-06 11:55:59,015 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase-failsafe-snaptb-1678103744695-1678103759003 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-03-06 11:55:59,015 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-03-06 11:55:59,116 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-06 11:55:59,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1678103744695-1678103759003 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-06 11:55:59,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1678103744695-1678103759003 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-06 11:55:59,117 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-03-06 11:55:59,317 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-06 11:55:59,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1678103744695-1678103759003 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-06 11:55:59,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1678103744695-1678103759003 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-06 11:55:59,318 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-03-06 11:55:59,421 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.DisabledTableSnapshotHandler(97): Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1678103744695-1678103759003 table=testCompactionWithHFileLink type=DISABLED ttl=0 } 2023-03-06 11:55:59,422 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-03-06 11:55:59,423 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-03-06 11:55:59,423 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-03-06 11:55:59,423 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-03-06 11:55:59,423 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-03-06 11:55:59,423 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-03-06 11:55:59,423 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-03-06 11:55:59,423 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-03-06 11:55:59,425 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/26cc4c4616f64ec5a5dc4b4c92596f83, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/89bd82db2d124547b4a0c4d7a846ea66_SeqId_29_] hfiles 2023-03-06 11:55:59,425 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/60193256dfc143549f3eb332132f9bf0_SeqId_29_, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/e9f06a1b951d4ee2b34bf04596434e79] hfiles 2023-03-06 11:55:59,425 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/967ba174e0d1415d9483f3ebae22c4e6, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/a58ea0b5d64647909c2de4ce741aaba3_SeqId_29_] hfiles 2023-03-06 11:55:59,425 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/60193256dfc143549f3eb332132f9bf0_SeqId_29_ 2023-03-06 11:55:59,425 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/967ba174e0d1415d9483f3ebae22c4e6 2023-03-06 11:55:59,426 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/e9f06a1b951d4ee2b34bf04596434e79 2023-03-06 11:55:59,426 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/a58ea0b5d64647909c2de4ce741aaba3_SeqId_29_ 2023-03-06 11:55:59,425 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230306fb333997e65d4255b4fecca412d331ec, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023030608ce0bfa74b14e0b8701ddc3845272bc, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303062bdd47c1b3a7491cbf9b437a38a37055] hfiles 2023-03-06 11:55:59,425 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/26cc4c4616f64ec5a5dc4b4c92596f83 2023-03-06 11:55:59,426 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/3): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230306fb333997e65d4255b4fecca412d331ec 2023-03-06 11:55:59,426 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/89bd82db2d124547b4a0c4d7a846ea66_SeqId_29_ 2023-03-06 11:55:59,426 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/3): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023030608ce0bfa74b14e0b8701ddc3845272bc 2023-03-06 11:55:59,426 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/3): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303062bdd47c1b3a7491cbf9b437a38a37055 2023-03-06 11:55:59,426 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family2/ee52abce20b34c85a41dd905eabeeaec] hfiles 2023-03-06 11:55:59,426 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family2/ee52abce20b34c85a41dd905eabeeaec 2023-03-06 11:55:59,426 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family2/dfa084d4eb5c48ba9f6635cc667386c6] hfiles 2023-03-06 11:55:59,426 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family2/dfa084d4eb5c48ba9f6635cc667386c6 2023-03-06 11:55:59,426 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family2/2b3110281eff49229f6734d5a9cc2da6] hfiles 2023-03-06 11:55:59,427 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family2/2b3110281eff49229f6734d5a9cc2da6 2023-03-06 11:55:59,432 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230306035b20b463cf4676b00038e1ded89b36, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303067f5ef34fec6b48c1be64aa901ab087cf, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230306daa47281759345e68e26eab846a9ca3e, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230306e772a8abe265475db42ce95e912e519c, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230306f0f94b45dc4a4d95a50f39e1d776f6ed_del, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230306580e8ed3672b4323909e44292ca88dde, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303065bb72fd8d11245958ec729633b7b73b1, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230306bc6e126b801747d399c27c43d5a7171c_del, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230306d4c2a68214f246df8074aed43c7a1bca, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230306ffb8b2fe1e8d4b35a4795c1fdbe647fd, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303060669d827db994d8582f9eda6be05f99b, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303062e9c62e68aed4d56a93f3b27ebb0f5ee, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023030632837620b3f54d9fa20827374fb85d0a, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303063403272ee76f45199997f59c1fef7702, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230306e4a5d177834d4502813451ed7c490b47_del] hfiles 2023-03-06 11:55:59,432 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/15): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230306035b20b463cf4676b00038e1ded89b36 2023-03-06 11:55:59,432 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/15): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303067f5ef34fec6b48c1be64aa901ab087cf 2023-03-06 11:55:59,432 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/15): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230306daa47281759345e68e26eab846a9ca3e 2023-03-06 11:55:59,432 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (4/15): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230306e772a8abe265475db42ce95e912e519c 2023-03-06 11:55:59,432 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (5/15): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230306f0f94b45dc4a4d95a50f39e1d776f6ed_del 2023-03-06 11:55:59,432 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (6/15): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230306580e8ed3672b4323909e44292ca88dde 2023-03-06 11:55:59,432 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (7/15): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303065bb72fd8d11245958ec729633b7b73b1 2023-03-06 11:55:59,433 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (8/15): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230306bc6e126b801747d399c27c43d5a7171c_del 2023-03-06 11:55:59,433 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (9/15): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230306d4c2a68214f246df8074aed43c7a1bca 2023-03-06 11:55:59,433 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (10/15): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230306ffb8b2fe1e8d4b35a4795c1fdbe647fd 2023-03-06 11:55:59,433 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (11/15): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303060669d827db994d8582f9eda6be05f99b 2023-03-06 11:55:59,433 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (12/15): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303062e9c62e68aed4d56a93f3b27ebb0f5ee 2023-03-06 11:55:59,433 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (13/15): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023030632837620b3f54d9fa20827374fb85d0a 2023-03-06 11:55:59,433 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (14/15): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303063403272ee76f45199997f59c1fef7702 2023-03-06 11:55:59,433 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (15/15): hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230306e4a5d177834d4502813451ed7c490b47_del 2023-03-06 11:55:59,618 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-06 11:55:59,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1678103744695-1678103759003 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-06 11:55:59,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1678103744695-1678103759003 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-06 11:55:59,619 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-03-06 11:55:59,836 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.DisabledTableSnapshotHandler(120): Marking snapshot{ ss=hbase-failsafe-snaptb-1678103744695-1678103759003 table=testCompactionWithHFileLink type=DISABLED ttl=0 } as finished. 2023-03-06 11:55:59,837 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase-failsafe-snaptb-1678103744695-1678103759003 2023-03-06 11:55:59,837 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1678103744695-1678103759003 2023-03-06 11:56:00,119 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-06 11:56:00,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1678103744695-1678103759003 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-06 11:56:00,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1678103744695-1678103759003 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-06 11:56:00,120 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-03-06 11:56:00,259 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1678103744695-1678103759003 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.hbase-snapshot/hbase-failsafe-snaptb-1678103744695-1678103759003 2023-03-06 11:56:00,673 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase-failsafe-snaptb-1678103744695-1678103759003 of table testCompactionWithHFileLink completed 2023-03-06 11:56:00,673 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1678103744695-1678103759003 2023-03-06 11:56:00,674 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1678103744695-1678103759003 2023-03-06 11:56:00,674 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running DISABLED table snapshot hbase-failsafe-snaptb-1678103744695-1678103759003 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1678103759015Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1678103744695-1678103759003 table=testCompactionWithHFileLink type=DISABLED ttl=0 } at 1678103759421 (+406 ms)Consolidate snapshot: hbase-failsafe-snaptb-1678103744695-1678103759003 at 1678103759837 (+416 ms)Loading Region manifests for hbase-failsafe-snaptb-1678103744695-1678103759003 at 1678103759837Writing data manifest for hbase-failsafe-snaptb-1678103744695-1678103759003 at 1678103759839 (+2 ms)Verifying snapshot: hbase-failsafe-snaptb-1678103744695-1678103759003 at 1678103760246 (+407 ms)Snapshot hbase-failsafe-snaptb-1678103744695-1678103759003 of table testCompactionWithHFileLink completed at 1678103760673 (+427 ms) 2023-03-06 11:56:00,675 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-06 11:56:00,676 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 1.6620 sec 2023-03-06 11:56:01,121 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-06 11:56:01,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1678103744695-1678103759003 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-06 11:56:01,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] snapshot.SnapshotManager(401): Snapshot '{ ss=hbase-failsafe-snaptb-1678103744695-1678103759003 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-03-06 11:56:01,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE:RESTORE_SNAPSHOT_PRE_OPERATION; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1678103744695" table: "testCompactionWithHFileLink" creation_time: 1678103744705 type: FLUSH version: 2 ttl: 0 ) 2023-03-06 11:56:01,164 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] snapshot.SnapshotManager(880): Restore snapshot=snaptb-1678103744695 as table=testCompactionWithHFileLink 2023-03-06 11:56:01,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-03-06 11:56:01,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-03-06 11:56:01,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-03-06 11:56:01,573 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-03-06 11:56:01,574 DEBUG [PEWorker-2] util.FSTableDescriptors(519): Deleted hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-03-06 11:56:01,574 INFO [PEWorker-2] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-03-06 11:56:01,575 INFO [PEWorker-2] procedure.RestoreSnapshotProcedure(374): Starting restore snapshot={ ss=snaptb-1678103744695 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-06 11:56:01,579 INFO [PEWorker-2] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "snaptb-1678103744695" table: "testCompactionWithHFileLink" creation_time: 1678103744705 type: FLUSH version: 2 ttl: 0 2023-03-06 11:56:01,580 DEBUG [PEWorker-2] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink 2023-03-06 11:56:01,584 DEBUG [PEWorker-2] snapshot.RestoreSnapshotHelper(797): found 3 regions for table=testCompactionWithHFileLink 2023-03-06 11:56:01,587 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303062bdd47c1b3a7491cbf9b437a38a37055 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303062bdd47c1b3a7491cbf9b437a38a37055 2023-03-06 11:56:01,588 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230306fb333997e65d4255b4fecca412d331ec to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230306fb333997e65d4255b4fecca412d331ec 2023-03-06 11:56:01,589 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023030608ce0bfa74b14e0b8701ddc3845272bc to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023030608ce0bfa74b14e0b8701ddc3845272bc 2023-03-06 11:56:01,589 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20230306276c4eb3750e4cd8a288882063ffda33 of snapshot=snaptb-1678103744695 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-06 11:56:01,592 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20230306bf7eb4a9b83846bc8bf24136a7371f4b of snapshot=snaptb-1678103744695 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-06 11:56:01,594 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20230306d631bc914a074bb4a12b9a982a26f16e of snapshot=snaptb-1678103744695 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-06 11:56:01,597 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20230306fa07443919b04eb8bb92bbc37962d241 of snapshot=snaptb-1678103744695 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-06 11:56:01,600 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c2023030624719d5ccbd74c628d8cbe46fee355ec of snapshot=snaptb-1678103744695 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-06 11:56:01,603 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202303067011e99a256540749bea0778e1de7574 of snapshot=snaptb-1678103744695 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-06 11:56:01,606 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230306c11f7967e9eb4cd594cabd367a739dfb of snapshot=snaptb-1678103744695 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-06 11:56:01,608 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230306fe59fbd6fddf403cb72ea83968b5fee0 of snapshot=snaptb-1678103744695 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-06 11:56:01,611 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e2023030623dafbf6b980413dac2036d2150cb244 of snapshot=snaptb-1678103744695 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-06 11:56:01,614 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e2023030660002a2d456d4adc97635b1c16827677 of snapshot=snaptb-1678103744695 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-06 11:56:01,617 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e2023030663cd81e529c54b83b1daefd26c6b83be of snapshot=snaptb-1678103744695 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-06 11:56:01,619 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e2023030665e56004b53049b8816e156ba235feff of snapshot=snaptb-1678103744695 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-06 11:56:01,623 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230306e4a5d177834d4502813451ed7c490b47_del to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230306e4a5d177834d4502813451ed7c490b47_del 2023-03-06 11:56:01,624 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230306f0f94b45dc4a4d95a50f39e1d776f6ed_del to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230306f0f94b45dc4a4d95a50f39e1d776f6ed_del 2023-03-06 11:56:01,625 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230306bc6e126b801747d399c27c43d5a7171c_del to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230306bc6e126b801747d399c27c43d5a7171c_del 2023-03-06 11:56:01,625 INFO [PEWorker-2] snapshot.RestoreSnapshotHelper(223): region to restore: 2f269067b173a7b6fd05253fc30eb70c 2023-03-06 11:56:01,625 INFO [PEWorker-2] snapshot.RestoreSnapshotHelper(223): region to restore: b28bd01ac58b51da722995493250192e 2023-03-06 11:56:01,625 INFO [PEWorker-2] snapshot.RestoreSnapshotHelper(223): region to restore: c2cfe3f574de2acbbfc1556c57115d2d 2023-03-06 11:56:01,628 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/60193256dfc143549f3eb332132f9bf0_SeqId_29_ to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/60193256dfc143549f3eb332132f9bf0_SeqId_29_ 2023-03-06 11:56:01,628 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/89bd82db2d124547b4a0c4d7a846ea66_SeqId_29_ to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/89bd82db2d124547b4a0c4d7a846ea66_SeqId_29_ 2023-03-06 11:56:01,629 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/a58ea0b5d64647909c2de4ce741aaba3_SeqId_29_ to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/a58ea0b5d64647909c2de4ce741aaba3_SeqId_29_ 2023-03-06 11:56:01,630 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/e9f06a1b951d4ee2b34bf04596434e79 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/e9f06a1b951d4ee2b34bf04596434e79 2023-03-06 11:56:01,630 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 306a91a6892045909bfd8d2fa20e3d07 of snapshot=snaptb-1678103744695 to region=2f269067b173a7b6fd05253fc30eb70c table=testCompactionWithHFileLink 2023-03-06 11:56:01,630 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/26cc4c4616f64ec5a5dc4b4c92596f83 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/26cc4c4616f64ec5a5dc4b4c92596f83 2023-03-06 11:56:01,630 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink aea0facd213e46c3ba7bc1001528645c of snapshot=snaptb-1678103744695 to region=c2cfe3f574de2acbbfc1556c57115d2d table=testCompactionWithHFileLink 2023-03-06 11:56:01,630 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/967ba174e0d1415d9483f3ebae22c4e6 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/967ba174e0d1415d9483f3ebae22c4e6 2023-03-06 11:56:01,630 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 521f7fea656f4bf0a6a34619819b9b96 of snapshot=snaptb-1678103744695 to region=b28bd01ac58b51da722995493250192e table=testCompactionWithHFileLink 2023-03-06 11:56:01,633 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink ef09b1b6393b418a9bae617dbb52b822 of snapshot=snaptb-1678103744695 to region=2f269067b173a7b6fd05253fc30eb70c table=testCompactionWithHFileLink 2023-03-06 11:56:01,633 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 11179992264b4611827cbb05d77aa09e of snapshot=snaptb-1678103744695 to region=c2cfe3f574de2acbbfc1556c57115d2d table=testCompactionWithHFileLink 2023-03-06 11:56:01,633 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c3eb14c8d0a7468087260ec76443837a of snapshot=snaptb-1678103744695 to region=b28bd01ac58b51da722995493250192e table=testCompactionWithHFileLink 2023-03-06 11:56:01,637 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 222bd21269334cb2b0e7a1802939feae of snapshot=snaptb-1678103744695 to region=b28bd01ac58b51da722995493250192e table=testCompactionWithHFileLink 2023-03-06 11:56:01,637 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink fd5561a340c7417ebc42529da127b851 of snapshot=snaptb-1678103744695 to region=2f269067b173a7b6fd05253fc30eb70c table=testCompactionWithHFileLink 2023-03-06 11:56:01,637 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 8752ae0e04ef4095a93e824894aeecb8 of snapshot=snaptb-1678103744695 to region=c2cfe3f574de2acbbfc1556c57115d2d table=testCompactionWithHFileLink 2023-03-06 11:56:01,640 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 40dba177f68a45158f9d5b5d497c8b90 of snapshot=snaptb-1678103744695 to region=b28bd01ac58b51da722995493250192e table=testCompactionWithHFileLink 2023-03-06 11:56:01,641 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink e1d6306f346045c7a65451b81473cbf9 of snapshot=snaptb-1678103744695 to region=2f269067b173a7b6fd05253fc30eb70c table=testCompactionWithHFileLink 2023-03-06 11:56:01,642 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 2f93a191ebca4d5c9dca411185590aa6 of snapshot=snaptb-1678103744695 to region=c2cfe3f574de2acbbfc1556c57115d2d table=testCompactionWithHFileLink 2023-03-06 11:56:01,646 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family2/dfa084d4eb5c48ba9f6635cc667386c6 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family2/dfa084d4eb5c48ba9f6635cc667386c6 2023-03-06 11:56:01,646 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 453f644748d341d69bac9afdb03542b4 of snapshot=snaptb-1678103744695 to region=b28bd01ac58b51da722995493250192e table=testCompactionWithHFileLink 2023-03-06 11:56:01,646 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family2/ee52abce20b34c85a41dd905eabeeaec to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family2/ee52abce20b34c85a41dd905eabeeaec 2023-03-06 11:56:01,646 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 9b48e09b8f7b4159847efb67f49fece1 of snapshot=snaptb-1678103744695 to region=2f269067b173a7b6fd05253fc30eb70c table=testCompactionWithHFileLink 2023-03-06 11:56:01,648 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family2/2b3110281eff49229f6734d5a9cc2da6 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family2/2b3110281eff49229f6734d5a9cc2da6 2023-03-06 11:56:01,648 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 55c8f076991b4637ad28854f49c12c2e of snapshot=snaptb-1678103744695 to region=c2cfe3f574de2acbbfc1556c57115d2d table=testCompactionWithHFileLink 2023-03-06 11:56:01,650 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink e34a67de00c04775a1ee3cd89ea6cfc6 of snapshot=snaptb-1678103744695 to region=b28bd01ac58b51da722995493250192e table=testCompactionWithHFileLink 2023-03-06 11:56:01,651 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink dc963273a6794ce781fbfad08180cc0e of snapshot=snaptb-1678103744695 to region=2f269067b173a7b6fd05253fc30eb70c table=testCompactionWithHFileLink 2023-03-06 11:56:01,652 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 1c50ec366ebb4fa1ae19df1bcdd90ce4 of snapshot=snaptb-1678103744695 to region=c2cfe3f574de2acbbfc1556c57115d2d table=testCompactionWithHFileLink 2023-03-06 11:56:01,654 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 40ac62114b9142a1b234682618c9abaa of snapshot=snaptb-1678103744695 to region=b28bd01ac58b51da722995493250192e table=testCompactionWithHFileLink 2023-03-06 11:56:01,654 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 7d0afd42878e4420b51d38de0fbcc357 of snapshot=snaptb-1678103744695 to region=2f269067b173a7b6fd05253fc30eb70c table=testCompactionWithHFileLink 2023-03-06 11:56:01,655 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 3e4f939b432142e682c697adc6d4bb4d of snapshot=snaptb-1678103744695 to region=c2cfe3f574de2acbbfc1556c57115d2d table=testCompactionWithHFileLink 2023-03-06 11:56:01,657 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 3d762d3394994f9db9eaaa5bc78cd499 of snapshot=snaptb-1678103744695 to region=b28bd01ac58b51da722995493250192e table=testCompactionWithHFileLink 2023-03-06 11:56:01,657 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 87dd2c76e0704c02bf5d7e6c177f51b2 of snapshot=snaptb-1678103744695 to region=2f269067b173a7b6fd05253fc30eb70c table=testCompactionWithHFileLink 2023-03-06 11:56:01,658 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 5cc62b27f8ad4edf8b330b0c303b9512 of snapshot=snaptb-1678103744695 to region=c2cfe3f574de2acbbfc1556c57115d2d table=testCompactionWithHFileLink 2023-03-06 11:56:01,661 INFO [PEWorker-2] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "snaptb-1678103744695" table: "testCompactionWithHFileLink" creation_time: 1678103744705 type: FLUSH version: 2 ttl: 0 2023-03-06 11:56:01,662 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1678103761662"}]},"ts":"9223372036854775807"} 2023-03-06 11:56:01,663 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1678103761662"}]},"ts":"9223372036854775807"} 2023-03-06 11:56:01,663 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1678103761662"}]},"ts":"9223372036854775807"} 2023-03-06 11:56:01,664 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-03-06 11:56:01,664 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 2f269067b173a7b6fd05253fc30eb70c, NAME => 'testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => b28bd01ac58b51da722995493250192e, NAME => 'testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => c2cfe3f574de2acbbfc1556c57115d2d, NAME => 'testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d.', STARTKEY => '', ENDKEY => '1'}] 2023-03-06 11:56:01,665 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678103761663"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678103761663"}]},"ts":"1678103761663"} 2023-03-06 11:56:01,665 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678103761663"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678103761663"}]},"ts":"1678103761663"} 2023-03-06 11:56:01,665 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678103761663"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678103761663"}]},"ts":"1678103761663"} 2023-03-06 11:56:01,666 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-03-06 11:56:01,666 INFO [PEWorker-2] hbase.MetaTableAccessor(1810): Overwritten 3 regions to Meta 2023-03-06 11:56:01,666 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1811): Overwritten regions: [{ENCODED => 2f269067b173a7b6fd05253fc30eb70c, NAME => 'testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => b28bd01ac58b51da722995493250192e, NAME => 'testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => c2cfe3f574de2acbbfc1556c57115d2d, NAME => 'testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d.', STARTKEY => '', ENDKEY => '1'}] 2023-03-06 11:56:01,667 INFO [PEWorker-2] procedure.RestoreSnapshotProcedure(447): Restore snapshot={ ss=snaptb-1678103744695 table=testCompactionWithHFileLink type=FLUSH ttl=0 } on table=testCompactionWithHFileLink completed! 2023-03-06 11:56:01,669 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1678103744695" table: "testCompactionWithHFileLink" creation_time: 1678103744705 type: FLUSH version: 2 ttl: 0 ) in 517 msec 2023-03-06 11:56:01,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-03-06 11:56:01,770 INFO [Listener at localhost/46717] client.HBaseAdmin$TableFuture(3541): Operation: MODIFY, Table Name: default:testCompactionWithHFileLink, procId: 96 completed 2023-03-06 11:56:01,770 INFO [Listener at localhost/46717] client.HBaseAdmin(2618): Deleting restore-failsafe snapshot: hbase-failsafe-snaptb-1678103744695-1678103759003 2023-03-06 11:56:01,774 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] master.MasterRpcServices(748): Client=jenkins//172.31.10.131 delete name: "hbase-failsafe-snaptb-1678103744695-1678103759003" 2023-03-06 11:56:01,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] snapshot.SnapshotManager(333): Deleting snapshot: hbase-failsafe-snaptb-1678103744695-1678103759003 2023-03-06 11:56:01,778 INFO [Listener at localhost/46717] client.HBaseAdmin$14(830): Started enable of testCompactionWithHFileLink 2023-03-06 11:56:01,782 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] master.HMaster$10(2385): Client=jenkins//172.31.10.131 enable testCompactionWithHFileLink 2023-03-06 11:56:01,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE:ENABLE_TABLE_PREPARE; EnableTableProcedure table=testCompactionWithHFileLink 2023-03-06 11:56:01,791 INFO [PEWorker-3] procedure.EnableTableProcedure(296): Attempting to enable the table testCompactionWithHFileLink 2023-03-06 11:56:01,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-03-06 11:56:01,791 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678103761791"}]},"ts":"1678103761791"} 2023-03-06 11:56:01,792 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-03-06 11:56:01,794 DEBUG [PEWorker-3] procedure.EnableTableProcedure(107): No change in number of region replicas (configuredReplicaCount=1); assigning. 2023-03-06 11:56:01,794 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c2cfe3f574de2acbbfc1556c57115d2d, ASSIGN}, {pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=2f269067b173a7b6fd05253fc30eb70c, ASSIGN}, {pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b28bd01ac58b51da722995493250192e, ASSIGN}] 2023-03-06 11:56:01,795 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b28bd01ac58b51da722995493250192e, ASSIGN 2023-03-06 11:56:01,795 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c2cfe3f574de2acbbfc1556c57115d2d, ASSIGN 2023-03-06 11:56:01,795 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=2f269067b173a7b6fd05253fc30eb70c, ASSIGN 2023-03-06 11:56:01,796 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c2cfe3f574de2acbbfc1556c57115d2d, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-03-06 11:56:01,796 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b28bd01ac58b51da722995493250192e, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-03-06 11:56:01,796 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=2f269067b173a7b6fd05253fc30eb70c, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-03-06 11:56:01,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-03-06 11:56:01,947 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=2f269067b173a7b6fd05253fc30eb70c, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:01,947 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=b28bd01ac58b51da722995493250192e, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:01,947 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=c2cfe3f574de2acbbfc1556c57115d2d, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:01,948 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678103761947"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678103761947"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678103761947"}]},"ts":"1678103761947"} 2023-03-06 11:56:01,948 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678103761947"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678103761947"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678103761947"}]},"ts":"1678103761947"} 2023-03-06 11:56:01,948 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678103761947"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678103761947"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678103761947"}]},"ts":"1678103761947"} 2023-03-06 11:56:01,949 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=101, ppid=99, state=RUNNABLE; OpenRegionProcedure 2f269067b173a7b6fd05253fc30eb70c, server=jenkins-hbase5.apache.org,42547,1678103642479}] 2023-03-06 11:56:01,950 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; OpenRegionProcedure b28bd01ac58b51da722995493250192e, server=jenkins-hbase5.apache.org,42547,1678103642479}] 2023-03-06 11:56:01,950 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=98, state=RUNNABLE; OpenRegionProcedure c2cfe3f574de2acbbfc1556c57115d2d, server=jenkins-hbase5.apache.org,42547,1678103642479}] 2023-03-06 11:56:02,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-03-06 11:56:02,103 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e. 2023-03-06 11:56:02,103 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b28bd01ac58b51da722995493250192e, NAME => 'testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e.', STARTKEY => '2', ENDKEY => ''} 2023-03-06 11:56:02,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink b28bd01ac58b51da722995493250192e 2023-03-06 11:56:02,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-06 11:56:02,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for b28bd01ac58b51da722995493250192e 2023-03-06 11:56:02,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for b28bd01ac58b51da722995493250192e 2023-03-06 11:56:02,105 INFO [StoreOpener-b28bd01ac58b51da722995493250192e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region b28bd01ac58b51da722995493250192e 2023-03-06 11:56:02,106 DEBUG [StoreOpener-b28bd01ac58b51da722995493250192e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1 2023-03-06 11:56:02,106 DEBUG [StoreOpener-b28bd01ac58b51da722995493250192e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1 2023-03-06 11:56:02,106 INFO [StoreOpener-b28bd01ac58b51da722995493250192e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b28bd01ac58b51da722995493250192e columnFamilyName family1 2023-03-06 11:56:02,121 DEBUG [StoreOpener-b28bd01ac58b51da722995493250192e-1] regionserver.HStore(539): loaded hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/testCompactionWithHFileLink=b28bd01ac58b51da722995493250192e-222bd21269334cb2b0e7a1802939feae 2023-03-06 11:56:02,127 DEBUG [StoreOpener-b28bd01ac58b51da722995493250192e-1] regionserver.HStore(539): loaded hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/testCompactionWithHFileLink=b28bd01ac58b51da722995493250192e-40dba177f68a45158f9d5b5d497c8b90 2023-03-06 11:56:02,132 DEBUG [StoreOpener-b28bd01ac58b51da722995493250192e-1] regionserver.HStore(539): loaded hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/testCompactionWithHFileLink=b28bd01ac58b51da722995493250192e-521f7fea656f4bf0a6a34619819b9b96 2023-03-06 11:56:02,137 DEBUG [StoreOpener-b28bd01ac58b51da722995493250192e-1] regionserver.HStore(539): loaded hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/testCompactionWithHFileLink=b28bd01ac58b51da722995493250192e-c3eb14c8d0a7468087260ec76443837a 2023-03-06 11:56:02,137 INFO [StoreOpener-b28bd01ac58b51da722995493250192e-1] regionserver.HStore(310): Store=b28bd01ac58b51da722995493250192e/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-06 11:56:02,138 INFO [StoreOpener-b28bd01ac58b51da722995493250192e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region b28bd01ac58b51da722995493250192e 2023-03-06 11:56:02,139 DEBUG [StoreOpener-b28bd01ac58b51da722995493250192e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family2 2023-03-06 11:56:02,139 DEBUG [StoreOpener-b28bd01ac58b51da722995493250192e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family2 2023-03-06 11:56:02,139 INFO [StoreOpener-b28bd01ac58b51da722995493250192e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b28bd01ac58b51da722995493250192e columnFamilyName family2 2023-03-06 11:56:02,146 DEBUG [StoreOpener-b28bd01ac58b51da722995493250192e-1] regionserver.HStore(539): loaded hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family2/testCompactionWithHFileLink=b28bd01ac58b51da722995493250192e-3d762d3394994f9db9eaaa5bc78cd499 2023-03-06 11:56:02,151 DEBUG [StoreOpener-b28bd01ac58b51da722995493250192e-1] regionserver.HStore(539): loaded hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family2/testCompactionWithHFileLink=b28bd01ac58b51da722995493250192e-40ac62114b9142a1b234682618c9abaa 2023-03-06 11:56:02,155 DEBUG [StoreOpener-b28bd01ac58b51da722995493250192e-1] regionserver.HStore(539): loaded hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family2/testCompactionWithHFileLink=b28bd01ac58b51da722995493250192e-453f644748d341d69bac9afdb03542b4 2023-03-06 11:56:02,159 DEBUG [StoreOpener-b28bd01ac58b51da722995493250192e-1] regionserver.HStore(539): loaded hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family2/testCompactionWithHFileLink=b28bd01ac58b51da722995493250192e-e34a67de00c04775a1ee3cd89ea6cfc6 2023-03-06 11:56:02,159 INFO [StoreOpener-b28bd01ac58b51da722995493250192e-1] regionserver.HStore(310): Store=b28bd01ac58b51da722995493250192e/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-06 11:56:02,160 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e 2023-03-06 11:56:02,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e 2023-03-06 11:56:02,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-06 11:56:02,164 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for b28bd01ac58b51da722995493250192e 2023-03-06 11:56:02,164 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened b28bd01ac58b51da722995493250192e; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75259597, jitterRate=0.12145538628101349}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-06 11:56:02,164 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for b28bd01ac58b51da722995493250192e: 2023-03-06 11:56:02,165 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e., pid=102, masterSystemTime=1678103762101 2023-03-06 11:56:02,165 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-06 11:56:02,165 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-06 11:56:02,165 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-03-06 11:56:02,165 DEBUG [RS:0;jenkins-hbase5:42547-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-03-06 11:56:02,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e. 2023-03-06 11:56:02,167 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e. 2023-03-06 11:56:02,167 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c. 2023-03-06 11:56:02,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2f269067b173a7b6fd05253fc30eb70c, NAME => 'testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c.', STARTKEY => '1', ENDKEY => '2'} 2023-03-06 11:56:02,167 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=b28bd01ac58b51da722995493250192e, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:02,168 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 2f269067b173a7b6fd05253fc30eb70c 2023-03-06 11:56:02,168 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678103762167"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678103762167"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678103762167"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678103762167"}]},"ts":"1678103762167"} 2023-03-06 11:56:02,168 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-06 11:56:02,168 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 2f269067b173a7b6fd05253fc30eb70c 2023-03-06 11:56:02,168 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 2f269067b173a7b6fd05253fc30eb70c 2023-03-06 11:56:02,169 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-03-06 11:56:02,169 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HStore(1912): b28bd01ac58b51da722995493250192e/family1 is initiating minor compaction (all files) 2023-03-06 11:56:02,169 DEBUG [RS:0;jenkins-hbase5:42547-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-03-06 11:56:02,169 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of b28bd01ac58b51da722995493250192e/family1 in testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e. 2023-03-06 11:56:02,169 DEBUG [RS:0;jenkins-hbase5:42547-longCompactions-0] regionserver.HStore(1912): b28bd01ac58b51da722995493250192e/family2 is initiating minor compaction (all files) 2023-03-06 11:56:02,169 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/testCompactionWithHFileLink=b28bd01ac58b51da722995493250192e-521f7fea656f4bf0a6a34619819b9b96, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/testCompactionWithHFileLink=b28bd01ac58b51da722995493250192e-c3eb14c8d0a7468087260ec76443837a, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/testCompactionWithHFileLink=b28bd01ac58b51da722995493250192e-222bd21269334cb2b0e7a1802939feae, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/testCompactionWithHFileLink=b28bd01ac58b51da722995493250192e-40dba177f68a45158f9d5b5d497c8b90] into tmpdir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/.tmp, totalSize=21.6 K 2023-03-06 11:56:02,169 INFO [RS:0;jenkins-hbase5:42547-longCompactions-0] regionserver.HRegion(2259): Starting compaction of b28bd01ac58b51da722995493250192e/family2 in testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e. 2023-03-06 11:56:02,169 INFO [RS:0;jenkins-hbase5:42547-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family2/testCompactionWithHFileLink=b28bd01ac58b51da722995493250192e-453f644748d341d69bac9afdb03542b4, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family2/testCompactionWithHFileLink=b28bd01ac58b51da722995493250192e-e34a67de00c04775a1ee3cd89ea6cfc6, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family2/testCompactionWithHFileLink=b28bd01ac58b51da722995493250192e-40ac62114b9142a1b234682618c9abaa, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family2/testCompactionWithHFileLink=b28bd01ac58b51da722995493250192e-3d762d3394994f9db9eaaa5bc78cd499] into tmpdir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/.tmp, totalSize=20.4 K 2023-03-06 11:56:02,169 INFO [StoreOpener-2f269067b173a7b6fd05253fc30eb70c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 2f269067b173a7b6fd05253fc30eb70c 2023-03-06 11:56:02,170 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b28bd01ac58b51da722995493250192e-521f7fea656f4bf0a6a34619819b9b96, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678103737938 2023-03-06 11:56:02,171 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-03-06 11:56:02,171 DEBUG [RS:0;jenkins-hbase5:42547-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b28bd01ac58b51da722995493250192e-453f644748d341d69bac9afdb03542b4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678103737938 2023-03-06 11:56:02,171 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; OpenRegionProcedure b28bd01ac58b51da722995493250192e, server=jenkins-hbase5.apache.org,42547,1678103642479 in 219 msec 2023-03-06 11:56:02,172 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b28bd01ac58b51da722995493250192e-c3eb14c8d0a7468087260ec76443837a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678103739321 2023-03-06 11:56:02,172 DEBUG [StoreOpener-2f269067b173a7b6fd05253fc30eb70c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1 2023-03-06 11:56:02,172 DEBUG [StoreOpener-2f269067b173a7b6fd05253fc30eb70c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1 2023-03-06 11:56:02,172 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b28bd01ac58b51da722995493250192e, ASSIGN in 377 msec 2023-03-06 11:56:02,172 INFO [StoreOpener-2f269067b173a7b6fd05253fc30eb70c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2f269067b173a7b6fd05253fc30eb70c columnFamilyName family1 2023-03-06 11:56:02,173 DEBUG [RS:0;jenkins-hbase5:42547-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b28bd01ac58b51da722995493250192e-e34a67de00c04775a1ee3cd89ea6cfc6, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678103739321 2023-03-06 11:56:02,173 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b28bd01ac58b51da722995493250192e-222bd21269334cb2b0e7a1802939feae, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678103741109 2023-03-06 11:56:02,174 DEBUG [RS:0;jenkins-hbase5:42547-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b28bd01ac58b51da722995493250192e-40ac62114b9142a1b234682618c9abaa, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678103741109 2023-03-06 11:56:02,174 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b28bd01ac58b51da722995493250192e-40dba177f68a45158f9d5b5d497c8b90, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678103742908 2023-03-06 11:56:02,176 DEBUG [RS:0;jenkins-hbase5:42547-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b28bd01ac58b51da722995493250192e-3d762d3394994f9db9eaaa5bc78cd499, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678103742908 2023-03-06 11:56:02,188 DEBUG [StoreOpener-2f269067b173a7b6fd05253fc30eb70c-1] regionserver.HStore(539): loaded hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/testCompactionWithHFileLink=2f269067b173a7b6fd05253fc30eb70c-306a91a6892045909bfd8d2fa20e3d07 2023-03-06 11:56:02,198 DEBUG [StoreOpener-2f269067b173a7b6fd05253fc30eb70c-1] regionserver.HStore(539): loaded hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/testCompactionWithHFileLink=2f269067b173a7b6fd05253fc30eb70c-e1d6306f346045c7a65451b81473cbf9 2023-03-06 11:56:02,210 DEBUG [StoreOpener-2f269067b173a7b6fd05253fc30eb70c-1] regionserver.HStore(539): loaded hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/testCompactionWithHFileLink=2f269067b173a7b6fd05253fc30eb70c-ef09b1b6393b418a9bae617dbb52b822 2023-03-06 11:56:02,221 INFO [RS:0;jenkins-hbase5:42547-longCompactions-0] throttle.PressureAwareThroughputController(145): b28bd01ac58b51da722995493250192e#family2#compaction#113 average throughput is 0.12 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 50.00 MB/second 2023-03-06 11:56:02,227 DEBUG [StoreOpener-2f269067b173a7b6fd05253fc30eb70c-1] regionserver.HStore(539): loaded hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/testCompactionWithHFileLink=2f269067b173a7b6fd05253fc30eb70c-fd5561a340c7417ebc42529da127b851 2023-03-06 11:56:02,229 INFO [StoreOpener-2f269067b173a7b6fd05253fc30eb70c-1] regionserver.HStore(310): Store=2f269067b173a7b6fd05253fc30eb70c/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-06 11:56:02,229 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] throttle.PressureAwareThroughputController(145): b28bd01ac58b51da722995493250192e#family1#compaction#114 average throughput is 0.21 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-06 11:56:02,230 INFO [StoreOpener-2f269067b173a7b6fd05253fc30eb70c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 2f269067b173a7b6fd05253fc30eb70c 2023-03-06 11:56:02,230 DEBUG [StoreOpener-2f269067b173a7b6fd05253fc30eb70c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family2 2023-03-06 11:56:02,231 DEBUG [StoreOpener-2f269067b173a7b6fd05253fc30eb70c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family2 2023-03-06 11:56:02,231 INFO [StoreOpener-2f269067b173a7b6fd05253fc30eb70c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2f269067b173a7b6fd05253fc30eb70c columnFamilyName family2 2023-03-06 11:56:02,242 DEBUG [StoreOpener-2f269067b173a7b6fd05253fc30eb70c-1] regionserver.HStore(539): loaded hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family2/testCompactionWithHFileLink=2f269067b173a7b6fd05253fc30eb70c-7d0afd42878e4420b51d38de0fbcc357 2023-03-06 11:56:02,253 DEBUG [StoreOpener-2f269067b173a7b6fd05253fc30eb70c-1] regionserver.HStore(539): loaded hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family2/testCompactionWithHFileLink=2f269067b173a7b6fd05253fc30eb70c-87dd2c76e0704c02bf5d7e6c177f51b2 2023-03-06 11:56:02,258 DEBUG [StoreOpener-2f269067b173a7b6fd05253fc30eb70c-1] regionserver.HStore(539): loaded hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family2/testCompactionWithHFileLink=2f269067b173a7b6fd05253fc30eb70c-9b48e09b8f7b4159847efb67f49fece1 2023-03-06 11:56:02,263 DEBUG [StoreOpener-2f269067b173a7b6fd05253fc30eb70c-1] regionserver.HStore(539): loaded hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family2/testCompactionWithHFileLink=2f269067b173a7b6fd05253fc30eb70c-dc963273a6794ce781fbfad08180cc0e 2023-03-06 11:56:02,263 INFO [StoreOpener-2f269067b173a7b6fd05253fc30eb70c-1] regionserver.HStore(310): Store=2f269067b173a7b6fd05253fc30eb70c/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-06 11:56:02,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c 2023-03-06 11:56:02,265 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/.tmp/family1/e5bf24157ee4429d9c3a538885ea21ba as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/e5bf24157ee4429d9c3a538885ea21ba 2023-03-06 11:56:02,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c 2023-03-06 11:56:02,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-06 11:56:02,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 2f269067b173a7b6fd05253fc30eb70c 2023-03-06 11:56:02,269 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 2f269067b173a7b6fd05253fc30eb70c; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69592115, jitterRate=0.037003323435783386}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-06 11:56:02,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 2f269067b173a7b6fd05253fc30eb70c: 2023-03-06 11:56:02,270 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in b28bd01ac58b51da722995493250192e/family1 of b28bd01ac58b51da722995493250192e into e5bf24157ee4429d9c3a538885ea21ba(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-06 11:56:02,270 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for b28bd01ac58b51da722995493250192e: 2023-03-06 11:56:02,270 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e., storeName=b28bd01ac58b51da722995493250192e/family1, priority=12, startTime=1678103762165; duration=0sec 2023-03-06 11:56:02,270 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-06 11:56:02,270 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c., pid=101, masterSystemTime=1678103762101 2023-03-06 11:56:02,270 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-06 11:56:02,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-03-06 11:56:02,271 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-03-06 11:56:02,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c. 2023-03-06 11:56:02,272 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c. 2023-03-06 11:56:02,272 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d. 2023-03-06 11:56:02,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c2cfe3f574de2acbbfc1556c57115d2d, NAME => 'testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d.', STARTKEY => '', ENDKEY => '1'} 2023-03-06 11:56:02,272 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=2f269067b173a7b6fd05253fc30eb70c, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:02,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink c2cfe3f574de2acbbfc1556c57115d2d 2023-03-06 11:56:02,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-06 11:56:02,273 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678103762272"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678103762272"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678103762272"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678103762272"}]},"ts":"1678103762272"} 2023-03-06 11:56:02,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for c2cfe3f574de2acbbfc1556c57115d2d 2023-03-06 11:56:02,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for c2cfe3f574de2acbbfc1556c57115d2d 2023-03-06 11:56:02,273 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-03-06 11:56:02,273 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HStore(1912): 2f269067b173a7b6fd05253fc30eb70c/family1 is initiating minor compaction (all files) 2023-03-06 11:56:02,273 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 2f269067b173a7b6fd05253fc30eb70c/family1 in testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c. 2023-03-06 11:56:02,273 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/testCompactionWithHFileLink=2f269067b173a7b6fd05253fc30eb70c-306a91a6892045909bfd8d2fa20e3d07, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/testCompactionWithHFileLink=2f269067b173a7b6fd05253fc30eb70c-ef09b1b6393b418a9bae617dbb52b822, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/testCompactionWithHFileLink=2f269067b173a7b6fd05253fc30eb70c-fd5561a340c7417ebc42529da127b851, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/testCompactionWithHFileLink=2f269067b173a7b6fd05253fc30eb70c-e1d6306f346045c7a65451b81473cbf9] into tmpdir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/.tmp, totalSize=21.6 K 2023-03-06 11:56:02,274 INFO [StoreOpener-c2cfe3f574de2acbbfc1556c57115d2d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c2cfe3f574de2acbbfc1556c57115d2d 2023-03-06 11:56:02,274 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=2f269067b173a7b6fd05253fc30eb70c-306a91a6892045909bfd8d2fa20e3d07, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678103737937 2023-03-06 11:56:02,275 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=2f269067b173a7b6fd05253fc30eb70c-ef09b1b6393b418a9bae617dbb52b822, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678103739321 2023-03-06 11:56:02,275 DEBUG [StoreOpener-c2cfe3f574de2acbbfc1556c57115d2d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1 2023-03-06 11:56:02,275 DEBUG [StoreOpener-c2cfe3f574de2acbbfc1556c57115d2d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1 2023-03-06 11:56:02,275 INFO [StoreOpener-c2cfe3f574de2acbbfc1556c57115d2d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c2cfe3f574de2acbbfc1556c57115d2d columnFamilyName family1 2023-03-06 11:56:02,275 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-03-06 11:56:02,275 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=2f269067b173a7b6fd05253fc30eb70c-fd5561a340c7417ebc42529da127b851, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678103741109 2023-03-06 11:56:02,275 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; OpenRegionProcedure 2f269067b173a7b6fd05253fc30eb70c, server=jenkins-hbase5.apache.org,42547,1678103642479 in 325 msec 2023-03-06 11:56:02,276 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=2f269067b173a7b6fd05253fc30eb70c-e1d6306f346045c7a65451b81473cbf9, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678103742908 2023-03-06 11:56:02,276 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=99, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=2f269067b173a7b6fd05253fc30eb70c, ASSIGN in 481 msec 2023-03-06 11:56:02,281 DEBUG [StoreOpener-c2cfe3f574de2acbbfc1556c57115d2d-1] regionserver.HStore(539): loaded hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/testCompactionWithHFileLink=c2cfe3f574de2acbbfc1556c57115d2d-11179992264b4611827cbb05d77aa09e 2023-03-06 11:56:02,286 DEBUG [StoreOpener-c2cfe3f574de2acbbfc1556c57115d2d-1] regionserver.HStore(539): loaded hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/testCompactionWithHFileLink=c2cfe3f574de2acbbfc1556c57115d2d-2f93a191ebca4d5c9dca411185590aa6 2023-03-06 11:56:02,296 DEBUG [StoreOpener-c2cfe3f574de2acbbfc1556c57115d2d-1] regionserver.HStore(539): loaded hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/testCompactionWithHFileLink=c2cfe3f574de2acbbfc1556c57115d2d-8752ae0e04ef4095a93e824894aeecb8 2023-03-06 11:56:02,297 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] throttle.PressureAwareThroughputController(145): 2f269067b173a7b6fd05253fc30eb70c#family1#compaction#115 average throughput is 1.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-06 11:56:02,302 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/testCompactionWithHFileLink=b28bd01ac58b51da722995493250192e-521f7fea656f4bf0a6a34619819b9b96, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/testCompactionWithHFileLink=b28bd01ac58b51da722995493250192e-c3eb14c8d0a7468087260ec76443837a, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/testCompactionWithHFileLink=b28bd01ac58b51da722995493250192e-222bd21269334cb2b0e7a1802939feae, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/testCompactionWithHFileLink=b28bd01ac58b51da722995493250192e-40dba177f68a45158f9d5b5d497c8b90] to archive 2023-03-06 11:56:02,302 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:56:02,305 DEBUG [StoreOpener-c2cfe3f574de2acbbfc1556c57115d2d-1] regionserver.HStore(539): loaded hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/testCompactionWithHFileLink=c2cfe3f574de2acbbfc1556c57115d2d-aea0facd213e46c3ba7bc1001528645c 2023-03-06 11:56:02,305 INFO [StoreOpener-c2cfe3f574de2acbbfc1556c57115d2d-1] regionserver.HStore(310): Store=c2cfe3f574de2acbbfc1556c57115d2d/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-06 11:56:02,305 INFO [StoreOpener-c2cfe3f574de2acbbfc1556c57115d2d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region c2cfe3f574de2acbbfc1556c57115d2d 2023-03-06 11:56:02,306 DEBUG [StoreOpener-c2cfe3f574de2acbbfc1556c57115d2d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family2 2023-03-06 11:56:02,306 DEBUG [StoreOpener-c2cfe3f574de2acbbfc1556c57115d2d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family2 2023-03-06 11:56:02,306 INFO [StoreOpener-c2cfe3f574de2acbbfc1556c57115d2d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c2cfe3f574de2acbbfc1556c57115d2d columnFamilyName family2 2023-03-06 11:56:02,307 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/testCompactionWithHFileLink=b28bd01ac58b51da722995493250192e-521f7fea656f4bf0a6a34619819b9b96 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/testCompactionWithHFileLink=b28bd01ac58b51da722995493250192e-521f7fea656f4bf0a6a34619819b9b96 2023-03-06 11:56:02,308 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/testCompactionWithHFileLink=b28bd01ac58b51da722995493250192e-c3eb14c8d0a7468087260ec76443837a to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/testCompactionWithHFileLink=b28bd01ac58b51da722995493250192e-c3eb14c8d0a7468087260ec76443837a 2023-03-06 11:56:02,309 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/testCompactionWithHFileLink=b28bd01ac58b51da722995493250192e-222bd21269334cb2b0e7a1802939feae to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/testCompactionWithHFileLink=b28bd01ac58b51da722995493250192e-222bd21269334cb2b0e7a1802939feae 2023-03-06 11:56:02,310 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/testCompactionWithHFileLink=b28bd01ac58b51da722995493250192e-40dba177f68a45158f9d5b5d497c8b90 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/testCompactionWithHFileLink=b28bd01ac58b51da722995493250192e-40dba177f68a45158f9d5b5d497c8b90 2023-03-06 11:56:02,313 DEBUG [StoreOpener-c2cfe3f574de2acbbfc1556c57115d2d-1] regionserver.HStore(539): loaded hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family2/testCompactionWithHFileLink=c2cfe3f574de2acbbfc1556c57115d2d-1c50ec366ebb4fa1ae19df1bcdd90ce4 2023-03-06 11:56:02,317 DEBUG [StoreOpener-c2cfe3f574de2acbbfc1556c57115d2d-1] regionserver.HStore(539): loaded hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family2/testCompactionWithHFileLink=c2cfe3f574de2acbbfc1556c57115d2d-3e4f939b432142e682c697adc6d4bb4d 2023-03-06 11:56:02,320 DEBUG [StoreOpener-c2cfe3f574de2acbbfc1556c57115d2d-1] regionserver.HStore(539): loaded hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family2/testCompactionWithHFileLink=c2cfe3f574de2acbbfc1556c57115d2d-55c8f076991b4637ad28854f49c12c2e 2023-03-06 11:56:02,323 DEBUG [StoreOpener-c2cfe3f574de2acbbfc1556c57115d2d-1] regionserver.HStore(539): loaded hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family2/testCompactionWithHFileLink=c2cfe3f574de2acbbfc1556c57115d2d-5cc62b27f8ad4edf8b330b0c303b9512 2023-03-06 11:56:02,323 INFO [StoreOpener-c2cfe3f574de2acbbfc1556c57115d2d-1] regionserver.HStore(310): Store=c2cfe3f574de2acbbfc1556c57115d2d/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-06 11:56:02,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d 2023-03-06 11:56:02,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d 2023-03-06 11:56:02,326 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-06 11:56:02,327 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for c2cfe3f574de2acbbfc1556c57115d2d 2023-03-06 11:56:02,327 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened c2cfe3f574de2acbbfc1556c57115d2d; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66774344, jitterRate=-0.004984736442565918}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-06 11:56:02,327 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for c2cfe3f574de2acbbfc1556c57115d2d: 2023-03-06 11:56:02,328 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d., pid=103, masterSystemTime=1678103762101 2023-03-06 11:56:02,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-03-06 11:56:02,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-03-06 11:56:02,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d. 2023-03-06 11:56:02,329 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d. 2023-03-06 11:56:02,329 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=c2cfe3f574de2acbbfc1556c57115d2d, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:02,330 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678103762329"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678103762329"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678103762329"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678103762329"}]},"ts":"1678103762329"} 2023-03-06 11:56:02,332 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=98 2023-03-06 11:56:02,332 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=98, state=SUCCESS; OpenRegionProcedure c2cfe3f574de2acbbfc1556c57115d2d, server=jenkins-hbase5.apache.org,42547,1678103642479 in 381 msec 2023-03-06 11:56:02,333 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=98, resume processing ppid=97 2023-03-06 11:56:02,333 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=98, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c2cfe3f574de2acbbfc1556c57115d2d, ASSIGN in 538 msec 2023-03-06 11:56:02,333 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678103762333"}]},"ts":"1678103762333"} 2023-03-06 11:56:02,334 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-03-06 11:56:02,337 INFO [PEWorker-5] procedure.EnableTableProcedure(310): Table 'testCompactionWithHFileLink' was successfully enabled. 2023-03-06 11:56:02,338 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; EnableTableProcedure table=testCompactionWithHFileLink in 553 msec 2023-03-06 11:56:02,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-03-06 11:56:02,394 INFO [Listener at localhost/46717] client.HBaseAdmin$TableFuture(3541): Operation: ENABLE, Table Name: default:testCompactionWithHFileLink, procId: 97 completed 2023-03-06 11:56:02,404 DEBUG [Listener at localhost/46717] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-06 11:56:02,412 DEBUG [Listener at localhost/46717] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-06 11:56:02,418 DEBUG [Listener at localhost/46717] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-06 11:56:02,419 DEBUG [Listener at localhost/46717] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-06 11:56:02,424 INFO [Listener at localhost/46717] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-06 11:56:02,435 INFO [Listener at localhost/46717] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-03-06 11:56:02,435 INFO [Listener at localhost/46717] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testCompactionWithHFileLink' column='family1' 2023-03-06 11:56:02,436 DEBUG [Listener at localhost/46717] zookeeper.ReadOnlyZKClient(139): Connect 0x6f8fe831 to 127.0.0.1:62659 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-06 11:56:02,439 DEBUG [Listener at localhost/46717] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5ea8e728, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-06 11:56:02,440 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230306 for table='testCompactionWithHFileLink' and column='family1' 2023-03-06 11:56:02,440 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230306 for table='testCompactionWithHFileLink' and column='family1' 2023-03-06 11:56:02,440 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230306 for table='testCompactionWithHFileLink' and column='family1' 2023-03-06 11:56:02,916 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303068a3228d7e96743f8847146e0570c6fe1 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303068a3228d7e96743f8847146e0570c6fe1 2023-03-06 11:56:02,917 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230306 table='testCompactionWithHFileLink' column='family1' 2023-03-06 11:56:02,929 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-06 11:56:02,932 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:38546, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-06 11:56:02,938 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-06 11:56:02,941 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:49846, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-06 11:56:02,954 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230306/family1/9694ededbe7f4fa08c49ab290ecfb5cb first=Optional[1\x00\x00\x00\x00] last=Optional[1\x00\x00\x00\x07] 2023-03-06 11:56:02,955 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c., hostname=jenkins-hbase5.apache.org,42547,1678103642479, seqNum=32 for row 1 with hfile group [{family1,hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230306/family1/9694ededbe7f4fa08c49ab290ecfb5cb}] 2023-03-06 11:56:02,961 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(763): Validating hfile at hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230306/family1/9694ededbe7f4fa08c49ab290ecfb5cb for inclusion in 2f269067b173a7b6fd05253fc30eb70c/family1 2023-03-06 11:56:02,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x00 last=1\x00\x00\x00\x07 2023-03-06 11:56:02,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(777): Region bounds: first=1 last=2 2023-03-06 11:56:02,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegion(2446): Flush status journal for 2f269067b173a7b6fd05253fc30eb70c: 2023-03-06 11:56:02,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230306/family1/9694ededbe7f4fa08c49ab290ecfb5cb to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testCompactionWithHFileLink__lalqd47n15vq313qj7dip7ioo8g9tdpsdmed1f9a8nj6g7ncjha10p2i7kh2mnpd/family1/9694ededbe7f4fa08c49ab290ecfb5cb 2023-03-06 11:56:02,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testCompactionWithHFileLink__lalqd47n15vq313qj7dip7ioo8g9tdpsdmed1f9a8nj6g7ncjha10p2i7kh2mnpd/family1/9694ededbe7f4fa08c49ab290ecfb5cb as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/08585dd51d174a0296a28592a8547343_SeqId_34_ 2023-03-06 11:56:02,967 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(849): Loaded HFile hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testCompactionWithHFileLink__lalqd47n15vq313qj7dip7ioo8g9tdpsdmed1f9a8nj6g7ncjha10p2i7kh2mnpd/family1/9694ededbe7f4fa08c49ab290ecfb5cb into 2f269067b173a7b6fd05253fc30eb70c/family1 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/08585dd51d174a0296a28592a8547343_SeqId_34_ - updating store file list. 2023-03-06 11:56:02,970 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(882): Loaded HFile hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/08585dd51d174a0296a28592a8547343_SeqId_34_ into 2f269067b173a7b6fd05253fc30eb70c/family1 2023-03-06 11:56:02,970 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(855): Successfully loaded hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testCompactionWithHFileLink__lalqd47n15vq313qj7dip7ioo8g9tdpsdmed1f9a8nj6g7ncjha10p2i7kh2mnpd/family1/9694ededbe7f4fa08c49ab290ecfb5cb into 2f269067b173a7b6fd05253fc30eb70c/family1 (new location: hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/08585dd51d174a0296a28592a8547343_SeqId_34_) 2023-03-06 11:56:02,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testCompactionWithHFileLink__lalqd47n15vq313qj7dip7ioo8g9tdpsdmed1f9a8nj6g7ncjha10p2i7kh2mnpd/family1/9694ededbe7f4fa08c49ab290ecfb5cb 2023-03-06 11:56:02,972 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230306 table='testCompactionWithHFileLink' column='family1' 2023-03-06 11:56:02,973 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:56:02,974 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230306276c4eb3750e4cd8a288882063ffda33 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230306276c4eb3750e4cd8a288882063ffda33 2023-03-06 11:56:02,975 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230306bf7eb4a9b83846bc8bf24136a7371f4b to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230306bf7eb4a9b83846bc8bf24136a7371f4b 2023-03-06 11:56:02,976 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230306d631bc914a074bb4a12b9a982a26f16e to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230306d631bc914a074bb4a12b9a982a26f16e 2023-03-06 11:56:02,977 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230306fa07443919b04eb8bb92bbc37962d241 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230306fa07443919b04eb8bb92bbc37962d241 2023-03-06 11:56:02,977 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-06 11:56:02,977 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230306' 2023-03-06 11:56:02,978 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230306 for table='testCompactionWithHFileLink' and column='family1' 2023-03-06 11:56:03,118 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/.tmp/family1/99da835ba6034e52a3b503179645765d as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/99da835ba6034e52a3b503179645765d 2023-03-06 11:56:03,122 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 2f269067b173a7b6fd05253fc30eb70c/family1 of 2f269067b173a7b6fd05253fc30eb70c into 99da835ba6034e52a3b503179645765d(size=7.6 K), total size for store is 14.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-06 11:56:03,122 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 2f269067b173a7b6fd05253fc30eb70c: 2023-03-06 11:56:03,122 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c., storeName=2f269067b173a7b6fd05253fc30eb70c/family1, priority=12, startTime=1678103762270; duration=0sec 2023-03-06 11:56:03,122 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-03-06 11:56:03,122 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-03-06 11:56:03,124 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-03-06 11:56:03,124 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HStore(1912): 2f269067b173a7b6fd05253fc30eb70c/family2 is initiating minor compaction (all files) 2023-03-06 11:56:03,124 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 2f269067b173a7b6fd05253fc30eb70c/family2 in testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c. 2023-03-06 11:56:03,124 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family2/testCompactionWithHFileLink=2f269067b173a7b6fd05253fc30eb70c-9b48e09b8f7b4159847efb67f49fece1, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family2/testCompactionWithHFileLink=2f269067b173a7b6fd05253fc30eb70c-dc963273a6794ce781fbfad08180cc0e, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family2/testCompactionWithHFileLink=2f269067b173a7b6fd05253fc30eb70c-7d0afd42878e4420b51d38de0fbcc357, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family2/testCompactionWithHFileLink=2f269067b173a7b6fd05253fc30eb70c-87dd2c76e0704c02bf5d7e6c177f51b2] into tmpdir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/.tmp, totalSize=20.4 K 2023-03-06 11:56:03,124 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=2f269067b173a7b6fd05253fc30eb70c-9b48e09b8f7b4159847efb67f49fece1, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678103737937 2023-03-06 11:56:03,125 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=2f269067b173a7b6fd05253fc30eb70c-dc963273a6794ce781fbfad08180cc0e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678103739321 2023-03-06 11:56:03,125 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=2f269067b173a7b6fd05253fc30eb70c-7d0afd42878e4420b51d38de0fbcc357, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678103741109 2023-03-06 11:56:03,125 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=2f269067b173a7b6fd05253fc30eb70c-87dd2c76e0704c02bf5d7e6c177f51b2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678103742908 2023-03-06 11:56:03,137 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] throttle.PressureAwareThroughputController(145): 2f269067b173a7b6fd05253fc30eb70c#family2#compaction#116 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-06 11:56:03,199 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/testCompactionWithHFileLink=2f269067b173a7b6fd05253fc30eb70c-306a91a6892045909bfd8d2fa20e3d07, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/testCompactionWithHFileLink=2f269067b173a7b6fd05253fc30eb70c-ef09b1b6393b418a9bae617dbb52b822, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/testCompactionWithHFileLink=2f269067b173a7b6fd05253fc30eb70c-fd5561a340c7417ebc42529da127b851, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/testCompactionWithHFileLink=2f269067b173a7b6fd05253fc30eb70c-e1d6306f346045c7a65451b81473cbf9] to archive 2023-03-06 11:56:03,200 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:56:03,201 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/testCompactionWithHFileLink=2f269067b173a7b6fd05253fc30eb70c-306a91a6892045909bfd8d2fa20e3d07 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/testCompactionWithHFileLink=2f269067b173a7b6fd05253fc30eb70c-306a91a6892045909bfd8d2fa20e3d07 2023-03-06 11:56:03,203 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/testCompactionWithHFileLink=2f269067b173a7b6fd05253fc30eb70c-ef09b1b6393b418a9bae617dbb52b822 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/testCompactionWithHFileLink=2f269067b173a7b6fd05253fc30eb70c-ef09b1b6393b418a9bae617dbb52b822 2023-03-06 11:56:03,204 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/testCompactionWithHFileLink=2f269067b173a7b6fd05253fc30eb70c-fd5561a340c7417ebc42529da127b851 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/testCompactionWithHFileLink=2f269067b173a7b6fd05253fc30eb70c-fd5561a340c7417ebc42529da127b851 2023-03-06 11:56:03,205 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/testCompactionWithHFileLink=2f269067b173a7b6fd05253fc30eb70c-e1d6306f346045c7a65451b81473cbf9 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family1/testCompactionWithHFileLink=2f269067b173a7b6fd05253fc30eb70c-e1d6306f346045c7a65451b81473cbf9 2023-03-06 11:56:03,316 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230306130d3f89461648cea26532b5e8c4fb96 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230306130d3f89461648cea26532b5e8c4fb96 2023-03-06 11:56:03,317 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303069d96ee2c883f4f91ad5a4605e500d3b9 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303069d96ee2c883f4f91ad5a4605e500d3b9 2023-03-06 11:56:03,317 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230306 table='testCompactionWithHFileLink' column='family1' 2023-03-06 11:56:03,317 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230306 table='testCompactionWithHFileLink' column='family1' 2023-03-06 11:56:03,342 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230306/family1/8e6af6539c6a4d1fb93a3447b8190f2e first=Optional[0\x00\x00\x00\x00] last=Optional[0\x00\x00\x00\x07] 2023-03-06 11:56:03,343 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d., hostname=jenkins-hbase5.apache.org,42547,1678103642479, seqNum=32 for row with hfile group [{family1,hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230306/family1/8e6af6539c6a4d1fb93a3447b8190f2e}] 2023-03-06 11:56:03,345 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(763): Validating hfile at hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230306/family1/8e6af6539c6a4d1fb93a3447b8190f2e for inclusion in c2cfe3f574de2acbbfc1556c57115d2d/family1 2023-03-06 11:56:03,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x00 last=0\x00\x00\x00\x07 2023-03-06 11:56:03,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(777): Region bounds: first= last=1 2023-03-06 11:56:03,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegion(2446): Flush status journal for c2cfe3f574de2acbbfc1556c57115d2d: 2023-03-06 11:56:03,348 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230306/family1/9ef0146376af423d85acd613a7523903 first=Optional[2\x00\x00\x00\x00] last=Optional[2\x00\x00\x00\x07] 2023-03-06 11:56:03,349 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e., hostname=jenkins-hbase5.apache.org,42547,1678103642479, seqNum=32 for row 2 with hfile group [{family1,hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230306/family1/9ef0146376af423d85acd613a7523903}] 2023-03-06 11:56:03,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230306/family1/8e6af6539c6a4d1fb93a3447b8190f2e to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testCompactionWithHFileLink__8sqoqircocq3gqjgv1r06tv2hbidfov9uh8tsbsli65lduec8875lp7nbockcgb7/family1/8e6af6539c6a4d1fb93a3447b8190f2e 2023-03-06 11:56:03,350 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42547] regionserver.HStore(763): Validating hfile at hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230306/family1/9ef0146376af423d85acd613a7523903 for inclusion in b28bd01ac58b51da722995493250192e/family1 2023-03-06 11:56:03,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testCompactionWithHFileLink__8sqoqircocq3gqjgv1r06tv2hbidfov9uh8tsbsli65lduec8875lp7nbockcgb7/family1/8e6af6539c6a4d1fb93a3447b8190f2e as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/96ce56b35aa541a287349f9b23521b73_SeqId_34_ 2023-03-06 11:56:03,352 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(849): Loaded HFile hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testCompactionWithHFileLink__8sqoqircocq3gqjgv1r06tv2hbidfov9uh8tsbsli65lduec8875lp7nbockcgb7/family1/8e6af6539c6a4d1fb93a3447b8190f2e into c2cfe3f574de2acbbfc1556c57115d2d/family1 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/96ce56b35aa541a287349f9b23521b73_SeqId_34_ - updating store file list. 2023-03-06 11:56:03,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42547] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x00 last=2\x00\x00\x00\x07 2023-03-06 11:56:03,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42547] regionserver.HStore(777): Region bounds: first=2 last= 2023-03-06 11:56:03,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42547] regionserver.HRegion(2446): Flush status journal for b28bd01ac58b51da722995493250192e: 2023-03-06 11:56:03,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42547] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230306/family1/9ef0146376af423d85acd613a7523903 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testCompactionWithHFileLink__o6nflfat0pdk1ra3c7j3on7vthe7ksspfte1nhh7b2dcqfof63obbjbkepts3046/family1/9ef0146376af423d85acd613a7523903 2023-03-06 11:56:03,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42547] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testCompactionWithHFileLink__o6nflfat0pdk1ra3c7j3on7vthe7ksspfte1nhh7b2dcqfof63obbjbkepts3046/family1/9ef0146376af423d85acd613a7523903 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/bab82ef0f4d84406b70068109237e6ae_SeqId_35_ 2023-03-06 11:56:03,355 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(882): Loaded HFile hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/96ce56b35aa541a287349f9b23521b73_SeqId_34_ into c2cfe3f574de2acbbfc1556c57115d2d/family1 2023-03-06 11:56:03,355 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(855): Successfully loaded hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testCompactionWithHFileLink__8sqoqircocq3gqjgv1r06tv2hbidfov9uh8tsbsli65lduec8875lp7nbockcgb7/family1/8e6af6539c6a4d1fb93a3447b8190f2e into c2cfe3f574de2acbbfc1556c57115d2d/family1 (new location: hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/96ce56b35aa541a287349f9b23521b73_SeqId_34_) 2023-03-06 11:56:03,355 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42547] regionserver.HStore(849): Loaded HFile hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testCompactionWithHFileLink__o6nflfat0pdk1ra3c7j3on7vthe7ksspfte1nhh7b2dcqfof63obbjbkepts3046/family1/9ef0146376af423d85acd613a7523903 into b28bd01ac58b51da722995493250192e/family1 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/bab82ef0f4d84406b70068109237e6ae_SeqId_35_ - updating store file list. 2023-03-06 11:56:03,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testCompactionWithHFileLink__8sqoqircocq3gqjgv1r06tv2hbidfov9uh8tsbsli65lduec8875lp7nbockcgb7/family1/8e6af6539c6a4d1fb93a3447b8190f2e 2023-03-06 11:56:03,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-06 11:56:03,358 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42547] regionserver.HStore(882): Loaded HFile hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/bab82ef0f4d84406b70068109237e6ae_SeqId_35_ into b28bd01ac58b51da722995493250192e/family1 2023-03-06 11:56:03,358 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42547] regionserver.HStore(855): Successfully loaded hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testCompactionWithHFileLink__o6nflfat0pdk1ra3c7j3on7vthe7ksspfte1nhh7b2dcqfof63obbjbkepts3046/family1/9ef0146376af423d85acd613a7523903 into b28bd01ac58b51da722995493250192e/family1 (new location: hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family1/bab82ef0f4d84406b70068109237e6ae_SeqId_35_) 2023-03-06 11:56:03,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-03-06 11:56:03,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42547] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testCompactionWithHFileLink__o6nflfat0pdk1ra3c7j3on7vthe7ksspfte1nhh7b2dcqfof63obbjbkepts3046/family1/9ef0146376af423d85acd613a7523903 2023-03-06 11:56:03,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(1912): c2cfe3f574de2acbbfc1556c57115d2d/family1 is initiating minor compaction (all files) 2023-03-06 11:56:03,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@3668232f; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-03-06 11:56:03,360 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230306 table='testCompactionWithHFileLink' column='family1' 2023-03-06 11:56:03,360 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230306 table='testCompactionWithHFileLink' column='family1' 2023-03-06 11:56:03,361 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:56:03,361 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:56:03,363 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023030623dafbf6b980413dac2036d2150cb244 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023030623dafbf6b980413dac2036d2150cb244 2023-03-06 11:56:03,363 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c2023030624719d5ccbd74c628d8cbe46fee355ec to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c2023030624719d5ccbd74c628d8cbe46fee355ec 2023-03-06 11:56:03,364 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202303067011e99a256540749bea0778e1de7574 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202303067011e99a256540749bea0778e1de7574 2023-03-06 11:56:03,364 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023030660002a2d456d4adc97635b1c16827677 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023030660002a2d456d4adc97635b1c16827677 2023-03-06 11:56:03,365 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230306c11f7967e9eb4cd594cabd367a739dfb to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230306c11f7967e9eb4cd594cabd367a739dfb 2023-03-06 11:56:03,365 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023030663cd81e529c54b83b1daefd26c6b83be to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023030663cd81e529c54b83b1daefd26c6b83be 2023-03-06 11:56:03,366 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230306fe59fbd6fddf403cb72ea83968b5fee0 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230306fe59fbd6fddf403cb72ea83968b5fee0 2023-03-06 11:56:03,366 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-06 11:56:03,366 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230306' 2023-03-06 11:56:03,366 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023030665e56004b53049b8816e156ba235feff to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023030665e56004b53049b8816e156ba235feff 2023-03-06 11:56:03,366 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-06 11:56:03,366 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230306' 2023-03-06 11:56:03,366 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230306 for table='testCompactionWithHFileLink' and column='family1' 2023-03-06 11:56:03,366 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230306 for table='testCompactionWithHFileLink' and column='family1' 2023-03-06 11:56:03,366 INFO [Listener at localhost/46717] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-03-06 11:56:03,369 DEBUG [Listener at localhost/46717] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-06 11:56:03,372 DEBUG [Listener at localhost/46717] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-06 11:56:03,375 DEBUG [Listener at localhost/46717] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-06 11:56:03,376 DEBUG [Listener at localhost/46717] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-06 11:56:03,381 DEBUG [Listener at localhost/46717] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-06 11:56:03,382 DEBUG [Listener at localhost/46717] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-06 11:56:03,397 INFO [Listener at localhost/46717] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=281 (was 229) - Thread LEAK? -, OpenFileDescriptor=749 (was 588) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=148 (was 182), ProcessCount=160 (was 160), AvailableMemoryMB=9558 (was 9656) 2023-03-06 11:56:03,409 INFO [Listener at localhost/46717] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompaction Thread=281, OpenFileDescriptor=749, MaxFileDescriptor=60000, SystemLoadAverage=148, ProcessCount=160, AvailableMemoryMB=9557 2023-03-06 11:56:03,414 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] master.HMaster$15(3014): Client=jenkins//172.31.10.131 creating {NAME => 'ns'} 2023-03-06 11:56:03,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=ns 2023-03-06 11:56:03,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=104 2023-03-06 11:56:03,421 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-03-06 11:56:03,423 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; CreateNamespaceProcedure, namespace=ns in 8 msec 2023-03-06 11:56:03,441 DEBUG [RS:0;jenkins-hbase5:42547-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/.tmp/family2/6153cc22ec6e486c8cb309858ace5515 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family2/6153cc22ec6e486c8cb309858ace5515 2023-03-06 11:56:03,445 INFO [RS:0;jenkins-hbase5:42547-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in b28bd01ac58b51da722995493250192e/family2 of b28bd01ac58b51da722995493250192e into 6153cc22ec6e486c8cb309858ace5515(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-06 11:56:03,445 DEBUG [RS:0;jenkins-hbase5:42547-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for b28bd01ac58b51da722995493250192e: 2023-03-06 11:56:03,445 INFO [RS:0;jenkins-hbase5:42547-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e., storeName=b28bd01ac58b51da722995493250192e/family2, priority=12, startTime=1678103762165; duration=1sec 2023-03-06 11:56:03,446 DEBUG [RS:0;jenkins-hbase5:42547-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-03-06 11:56:03,446 INFO [RS:0;jenkins-hbase5:42547-longCompactions-0] regionserver.HRegion(2259): Starting compaction of c2cfe3f574de2acbbfc1556c57115d2d/family1 in testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d. 2023-03-06 11:56:03,446 INFO [RS:0;jenkins-hbase5:42547-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/testCompactionWithHFileLink=c2cfe3f574de2acbbfc1556c57115d2d-aea0facd213e46c3ba7bc1001528645c, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/testCompactionWithHFileLink=c2cfe3f574de2acbbfc1556c57115d2d-11179992264b4611827cbb05d77aa09e, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/testCompactionWithHFileLink=c2cfe3f574de2acbbfc1556c57115d2d-8752ae0e04ef4095a93e824894aeecb8, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/testCompactionWithHFileLink=c2cfe3f574de2acbbfc1556c57115d2d-2f93a191ebca4d5c9dca411185590aa6, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/96ce56b35aa541a287349f9b23521b73_SeqId_34_] into tmpdir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/.tmp, totalSize=28.9 K 2023-03-06 11:56:03,446 DEBUG [RS:0;jenkins-hbase5:42547-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c2cfe3f574de2acbbfc1556c57115d2d-aea0facd213e46c3ba7bc1001528645c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678103737936 2023-03-06 11:56:03,447 DEBUG [RS:0;jenkins-hbase5:42547-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c2cfe3f574de2acbbfc1556c57115d2d-11179992264b4611827cbb05d77aa09e, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678103739321 2023-03-06 11:56:03,447 DEBUG [RS:0;jenkins-hbase5:42547-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c2cfe3f574de2acbbfc1556c57115d2d-8752ae0e04ef4095a93e824894aeecb8, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678103741109 2023-03-06 11:56:03,448 DEBUG [RS:0;jenkins-hbase5:42547-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c2cfe3f574de2acbbfc1556c57115d2d-2f93a191ebca4d5c9dca411185590aa6, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678103742908 2023-03-06 11:56:03,448 DEBUG [RS:0;jenkins-hbase5:42547-longCompactions-0] compactions.Compactor(207): Compacting 96ce56b35aa541a287349f9b23521b73_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1678103737936 2023-03-06 11:56:03,459 INFO [RS:0;jenkins-hbase5:42547-longCompactions-0] throttle.PressureAwareThroughputController(145): c2cfe3f574de2acbbfc1556c57115d2d#family1#compaction#117 average throughput is 1.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-06 11:56:03,499 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family2/testCompactionWithHFileLink=b28bd01ac58b51da722995493250192e-453f644748d341d69bac9afdb03542b4, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family2/testCompactionWithHFileLink=b28bd01ac58b51da722995493250192e-e34a67de00c04775a1ee3cd89ea6cfc6, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family2/testCompactionWithHFileLink=b28bd01ac58b51da722995493250192e-40ac62114b9142a1b234682618c9abaa, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family2/testCompactionWithHFileLink=b28bd01ac58b51da722995493250192e-3d762d3394994f9db9eaaa5bc78cd499] to archive 2023-03-06 11:56:03,500 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:56:03,501 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family2/testCompactionWithHFileLink=b28bd01ac58b51da722995493250192e-453f644748d341d69bac9afdb03542b4 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family2/testCompactionWithHFileLink=b28bd01ac58b51da722995493250192e-453f644748d341d69bac9afdb03542b4 2023-03-06 11:56:03,502 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family2/testCompactionWithHFileLink=b28bd01ac58b51da722995493250192e-e34a67de00c04775a1ee3cd89ea6cfc6 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family2/testCompactionWithHFileLink=b28bd01ac58b51da722995493250192e-e34a67de00c04775a1ee3cd89ea6cfc6 2023-03-06 11:56:03,503 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family2/testCompactionWithHFileLink=b28bd01ac58b51da722995493250192e-40ac62114b9142a1b234682618c9abaa to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family2/testCompactionWithHFileLink=b28bd01ac58b51da722995493250192e-40ac62114b9142a1b234682618c9abaa 2023-03-06 11:56:03,504 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family2/testCompactionWithHFileLink=b28bd01ac58b51da722995493250192e-3d762d3394994f9db9eaaa5bc78cd499 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/family2/testCompactionWithHFileLink=b28bd01ac58b51da722995493250192e-3d762d3394994f9db9eaaa5bc78cd499 2023-03-06 11:56:03,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=104 2023-03-06 11:56:03,522 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] master.HMaster$4(2112): Client=jenkins//172.31.10.131 create 'ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-03-06 11:56:03,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=ns:testMinorCompaction 2023-03-06 11:56:03,524 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-03-06 11:56:03,524 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] master.MasterRpcServices(697): Client=jenkins//172.31.10.131 procedure request for creating table: namespace: "ns" qualifier: "testMinorCompaction" procId is: 105 2023-03-06 11:56:03,525 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-06 11:56:03,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-03-06 11:56:03,526 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890 2023-03-06 11:56:03,526 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2 2023-03-06 11:56:03,526 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6 2023-03-06 11:56:03,527 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890 empty. 2023-03-06 11:56:03,527 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6 empty. 2023-03-06 11:56:03,527 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2 empty. 2023-03-06 11:56:03,527 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890 2023-03-06 11:56:03,527 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6 2023-03-06 11:56:03,527 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2 2023-03-06 11:56:03,527 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived ns:testMinorCompaction regions 2023-03-06 11:56:03,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-03-06 11:56:03,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-03-06 11:56:03,933 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/ns/testMinorCompaction/.tabledesc/.tableinfo.0000000001 2023-03-06 11:56:03,935 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(7675): creating {ENCODED => 9423a74245608132f818a8fcb1dc4ed6, NAME => 'ns:testMinorCompaction,2,1678103763522.9423a74245608132f818a8fcb1dc4ed6.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp 2023-03-06 11:56:03,935 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => 19a0eec34378d881af15151889d2e890, NAME => 'ns:testMinorCompaction,,1678103763522.19a0eec34378d881af15151889d2e890.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp 2023-03-06 11:56:03,935 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(7675): creating {ENCODED => 1bf4d18e651e20acc78c321164b94cc2, NAME => 'ns:testMinorCompaction,1,1678103763522.1bf4d18e651e20acc78c321164b94cc2.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp 2023-03-06 11:56:04,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-03-06 11:56:04,279 DEBUG [RS:0;jenkins-hbase5:42547-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/.tmp/family1/35cb650105144493b7efcecd4f9e3ea3 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/35cb650105144493b7efcecd4f9e3ea3 2023-03-06 11:56:04,283 INFO [RS:0;jenkins-hbase5:42547-longCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in c2cfe3f574de2acbbfc1556c57115d2d/family1 of c2cfe3f574de2acbbfc1556c57115d2d into 35cb650105144493b7efcecd4f9e3ea3(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-06 11:56:04,283 DEBUG [RS:0;jenkins-hbase5:42547-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for c2cfe3f574de2acbbfc1556c57115d2d: 2023-03-06 11:56:04,283 INFO [RS:0;jenkins-hbase5:42547-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1678103763358; duration=0sec 2023-03-06 11:56:04,283 DEBUG [RS:0;jenkins-hbase5:42547-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-03-06 11:56:04,283 DEBUG [RS:0;jenkins-hbase5:42547-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-03-06 11:56:04,285 DEBUG [RS:0;jenkins-hbase5:42547-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-03-06 11:56:04,285 DEBUG [RS:0;jenkins-hbase5:42547-longCompactions-0] regionserver.HStore(1912): c2cfe3f574de2acbbfc1556c57115d2d/family2 is initiating minor compaction (all files) 2023-03-06 11:56:04,285 INFO [RS:0;jenkins-hbase5:42547-longCompactions-0] regionserver.HRegion(2259): Starting compaction of c2cfe3f574de2acbbfc1556c57115d2d/family2 in testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d. 2023-03-06 11:56:04,285 INFO [RS:0;jenkins-hbase5:42547-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family2/testCompactionWithHFileLink=c2cfe3f574de2acbbfc1556c57115d2d-55c8f076991b4637ad28854f49c12c2e, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family2/testCompactionWithHFileLink=c2cfe3f574de2acbbfc1556c57115d2d-1c50ec366ebb4fa1ae19df1bcdd90ce4, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family2/testCompactionWithHFileLink=c2cfe3f574de2acbbfc1556c57115d2d-3e4f939b432142e682c697adc6d4bb4d, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family2/testCompactionWithHFileLink=c2cfe3f574de2acbbfc1556c57115d2d-5cc62b27f8ad4edf8b330b0c303b9512] into tmpdir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/.tmp, totalSize=20.4 K 2023-03-06 11:56:04,286 DEBUG [RS:0;jenkins-hbase5:42547-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c2cfe3f574de2acbbfc1556c57115d2d-55c8f076991b4637ad28854f49c12c2e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678103737936 2023-03-06 11:56:04,286 DEBUG [RS:0;jenkins-hbase5:42547-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c2cfe3f574de2acbbfc1556c57115d2d-1c50ec366ebb4fa1ae19df1bcdd90ce4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678103739321 2023-03-06 11:56:04,287 DEBUG [RS:0;jenkins-hbase5:42547-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c2cfe3f574de2acbbfc1556c57115d2d-3e4f939b432142e682c697adc6d4bb4d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678103741109 2023-03-06 11:56:04,287 DEBUG [RS:0;jenkins-hbase5:42547-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c2cfe3f574de2acbbfc1556c57115d2d-5cc62b27f8ad4edf8b330b0c303b9512, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678103742908 2023-03-06 11:56:04,297 INFO [RS:0;jenkins-hbase5:42547-longCompactions-0] throttle.PressureAwareThroughputController(145): c2cfe3f574de2acbbfc1556c57115d2d#family2#compaction#118 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-03-06 11:56:04,306 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/testCompactionWithHFileLink=c2cfe3f574de2acbbfc1556c57115d2d-aea0facd213e46c3ba7bc1001528645c, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/testCompactionWithHFileLink=c2cfe3f574de2acbbfc1556c57115d2d-11179992264b4611827cbb05d77aa09e, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/testCompactionWithHFileLink=c2cfe3f574de2acbbfc1556c57115d2d-8752ae0e04ef4095a93e824894aeecb8, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/testCompactionWithHFileLink=c2cfe3f574de2acbbfc1556c57115d2d-2f93a191ebca4d5c9dca411185590aa6, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/96ce56b35aa541a287349f9b23521b73_SeqId_34_] to archive 2023-03-06 11:56:04,307 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:56:04,308 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/testCompactionWithHFileLink=c2cfe3f574de2acbbfc1556c57115d2d-aea0facd213e46c3ba7bc1001528645c to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/testCompactionWithHFileLink=c2cfe3f574de2acbbfc1556c57115d2d-aea0facd213e46c3ba7bc1001528645c 2023-03-06 11:56:04,309 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/testCompactionWithHFileLink=c2cfe3f574de2acbbfc1556c57115d2d-11179992264b4611827cbb05d77aa09e to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/testCompactionWithHFileLink=c2cfe3f574de2acbbfc1556c57115d2d-11179992264b4611827cbb05d77aa09e 2023-03-06 11:56:04,309 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/testCompactionWithHFileLink=c2cfe3f574de2acbbfc1556c57115d2d-8752ae0e04ef4095a93e824894aeecb8 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/testCompactionWithHFileLink=c2cfe3f574de2acbbfc1556c57115d2d-8752ae0e04ef4095a93e824894aeecb8 2023-03-06 11:56:04,310 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/testCompactionWithHFileLink=c2cfe3f574de2acbbfc1556c57115d2d-2f93a191ebca4d5c9dca411185590aa6 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/testCompactionWithHFileLink=c2cfe3f574de2acbbfc1556c57115d2d-2f93a191ebca4d5c9dca411185590aa6 2023-03-06 11:56:04,311 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/96ce56b35aa541a287349f9b23521b73_SeqId_34_ to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family1/96ce56b35aa541a287349f9b23521b73_SeqId_34_ 2023-03-06 11:56:04,344 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1678103763522.9423a74245608132f818a8fcb1dc4ed6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-06 11:56:04,344 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1678103763522.19a0eec34378d881af15151889d2e890.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-06 11:56:04,344 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1604): Closing 9423a74245608132f818a8fcb1dc4ed6, disabling compactions & flushes 2023-03-06 11:56:04,344 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1604): Closing 19a0eec34378d881af15151889d2e890, disabling compactions & flushes 2023-03-06 11:56:04,344 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1678103763522.9423a74245608132f818a8fcb1dc4ed6. 2023-03-06 11:56:04,344 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1678103763522.19a0eec34378d881af15151889d2e890. 2023-03-06 11:56:04,344 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1678103763522.9423a74245608132f818a8fcb1dc4ed6. 2023-03-06 11:56:04,344 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1678103763522.19a0eec34378d881af15151889d2e890. 2023-03-06 11:56:04,344 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1678103763522.9423a74245608132f818a8fcb1dc4ed6. after waiting 0 ms 2023-03-06 11:56:04,344 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1678103763522.19a0eec34378d881af15151889d2e890. after waiting 0 ms 2023-03-06 11:56:04,344 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1678103763522.9423a74245608132f818a8fcb1dc4ed6. 2023-03-06 11:56:04,344 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1678103763522.19a0eec34378d881af15151889d2e890. 2023-03-06 11:56:04,344 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1678103763522.9423a74245608132f818a8fcb1dc4ed6. 2023-03-06 11:56:04,345 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1678103763522.19a0eec34378d881af15151889d2e890. 2023-03-06 11:56:04,345 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1558): Region close journal for 9423a74245608132f818a8fcb1dc4ed6: 2023-03-06 11:56:04,345 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1678103763522.1bf4d18e651e20acc78c321164b94cc2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-06 11:56:04,345 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1558): Region close journal for 19a0eec34378d881af15151889d2e890: 2023-03-06 11:56:04,345 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1604): Closing 1bf4d18e651e20acc78c321164b94cc2, disabling compactions & flushes 2023-03-06 11:56:04,345 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1678103763522.1bf4d18e651e20acc78c321164b94cc2. 2023-03-06 11:56:04,345 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1678103763522.1bf4d18e651e20acc78c321164b94cc2. 2023-03-06 11:56:04,345 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1678103763522.1bf4d18e651e20acc78c321164b94cc2. after waiting 0 ms 2023-03-06 11:56:04,345 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1678103763522.1bf4d18e651e20acc78c321164b94cc2. 2023-03-06 11:56:04,345 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1678103763522.1bf4d18e651e20acc78c321164b94cc2. 2023-03-06 11:56:04,345 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1558): Region close journal for 1bf4d18e651e20acc78c321164b94cc2: 2023-03-06 11:56:04,347 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-03-06 11:56:04,348 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,2,1678103763522.9423a74245608132f818a8fcb1dc4ed6.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1678103764347"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678103764347"}]},"ts":"1678103764347"} 2023-03-06 11:56:04,348 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,,1678103763522.19a0eec34378d881af15151889d2e890.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1678103764347"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678103764347"}]},"ts":"1678103764347"} 2023-03-06 11:56:04,348 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,1,1678103763522.1bf4d18e651e20acc78c321164b94cc2.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1678103764347"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678103764347"}]},"ts":"1678103764347"} 2023-03-06 11:56:04,349 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-03-06 11:56:04,350 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-06 11:56:04,350 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678103764350"}]},"ts":"1678103764350"} 2023-03-06 11:56:04,351 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLING in hbase:meta 2023-03-06 11:56:04,352 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/.tmp/family2/24dd8e0300f445f79c77b11f7cfd4f97 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family2/24dd8e0300f445f79c77b11f7cfd4f97 2023-03-06 11:56:04,356 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=19a0eec34378d881af15151889d2e890, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=1bf4d18e651e20acc78c321164b94cc2, ASSIGN}, {pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=9423a74245608132f818a8fcb1dc4ed6, ASSIGN}] 2023-03-06 11:56:04,356 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 2f269067b173a7b6fd05253fc30eb70c/family2 of 2f269067b173a7b6fd05253fc30eb70c into 24dd8e0300f445f79c77b11f7cfd4f97(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-06 11:56:04,356 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 2f269067b173a7b6fd05253fc30eb70c: 2023-03-06 11:56:04,356 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c., storeName=2f269067b173a7b6fd05253fc30eb70c/family2, priority=12, startTime=1678103762271; duration=1sec 2023-03-06 11:56:04,356 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-03-06 11:56:04,356 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-03-06 11:56:04,357 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-03-06 11:56:04,357 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-03-06 11:56:04,358 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=1bf4d18e651e20acc78c321164b94cc2, ASSIGN 2023-03-06 11:56:04,358 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d. because compaction request was cancelled 2023-03-06 11:56:04,358 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=19a0eec34378d881af15151889d2e890, ASSIGN 2023-03-06 11:56:04,358 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=9423a74245608132f818a8fcb1dc4ed6, ASSIGN 2023-03-06 11:56:04,358 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=9423a74245608132f818a8fcb1dc4ed6, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,42547,1678103642479; forceNewPlan=false, retain=false 2023-03-06 11:56:04,358 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=19a0eec34378d881af15151889d2e890, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,42547,1678103642479; forceNewPlan=false, retain=false 2023-03-06 11:56:04,358 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=1bf4d18e651e20acc78c321164b94cc2, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,42547,1678103642479; forceNewPlan=false, retain=false 2023-03-06 11:56:04,386 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-06 11:56:04,403 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family2/testCompactionWithHFileLink=2f269067b173a7b6fd05253fc30eb70c-9b48e09b8f7b4159847efb67f49fece1, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family2/testCompactionWithHFileLink=2f269067b173a7b6fd05253fc30eb70c-dc963273a6794ce781fbfad08180cc0e, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family2/testCompactionWithHFileLink=2f269067b173a7b6fd05253fc30eb70c-7d0afd42878e4420b51d38de0fbcc357, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family2/testCompactionWithHFileLink=2f269067b173a7b6fd05253fc30eb70c-87dd2c76e0704c02bf5d7e6c177f51b2] to archive 2023-03-06 11:56:04,404 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:56:04,405 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family2/testCompactionWithHFileLink=2f269067b173a7b6fd05253fc30eb70c-9b48e09b8f7b4159847efb67f49fece1 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family2/testCompactionWithHFileLink=2f269067b173a7b6fd05253fc30eb70c-9b48e09b8f7b4159847efb67f49fece1 2023-03-06 11:56:04,406 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family2/testCompactionWithHFileLink=2f269067b173a7b6fd05253fc30eb70c-dc963273a6794ce781fbfad08180cc0e to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family2/testCompactionWithHFileLink=2f269067b173a7b6fd05253fc30eb70c-dc963273a6794ce781fbfad08180cc0e 2023-03-06 11:56:04,408 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family2/testCompactionWithHFileLink=2f269067b173a7b6fd05253fc30eb70c-7d0afd42878e4420b51d38de0fbcc357 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family2/testCompactionWithHFileLink=2f269067b173a7b6fd05253fc30eb70c-7d0afd42878e4420b51d38de0fbcc357 2023-03-06 11:56:04,408 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family2/testCompactionWithHFileLink=2f269067b173a7b6fd05253fc30eb70c-87dd2c76e0704c02bf5d7e6c177f51b2 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/family2/testCompactionWithHFileLink=2f269067b173a7b6fd05253fc30eb70c-87dd2c76e0704c02bf5d7e6c177f51b2 2023-03-06 11:56:04,511 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=19a0eec34378d881af15151889d2e890, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:04,511 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=1bf4d18e651e20acc78c321164b94cc2, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:04,511 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=9423a74245608132f818a8fcb1dc4ed6, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:04,511 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,,1678103763522.19a0eec34378d881af15151889d2e890.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1678103764511"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678103764511"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678103764511"}]},"ts":"1678103764511"} 2023-03-06 11:56:04,511 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,2,1678103763522.9423a74245608132f818a8fcb1dc4ed6.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1678103764511"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678103764511"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678103764511"}]},"ts":"1678103764511"} 2023-03-06 11:56:04,511 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,1,1678103763522.1bf4d18e651e20acc78c321164b94cc2.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1678103764511"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678103764511"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678103764511"}]},"ts":"1678103764511"} 2023-03-06 11:56:04,512 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure 19a0eec34378d881af15151889d2e890, server=jenkins-hbase5.apache.org,42547,1678103642479}] 2023-03-06 11:56:04,513 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=110, ppid=108, state=RUNNABLE; OpenRegionProcedure 9423a74245608132f818a8fcb1dc4ed6, server=jenkins-hbase5.apache.org,42547,1678103642479}] 2023-03-06 11:56:04,513 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=111, ppid=107, state=RUNNABLE; OpenRegionProcedure 1bf4d18e651e20acc78c321164b94cc2, server=jenkins-hbase5.apache.org,42547,1678103642479}] 2023-03-06 11:56:04,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-03-06 11:56:04,667 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,,1678103763522.19a0eec34378d881af15151889d2e890. 2023-03-06 11:56:04,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 19a0eec34378d881af15151889d2e890, NAME => 'ns:testMinorCompaction,,1678103763522.19a0eec34378d881af15151889d2e890.', STARTKEY => '', ENDKEY => '1'} 2023-03-06 11:56:04,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 19a0eec34378d881af15151889d2e890 2023-03-06 11:56:04,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1678103763522.19a0eec34378d881af15151889d2e890.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-06 11:56:04,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 19a0eec34378d881af15151889d2e890 2023-03-06 11:56:04,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 19a0eec34378d881af15151889d2e890 2023-03-06 11:56:04,668 INFO [StoreOpener-19a0eec34378d881af15151889d2e890-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 19a0eec34378d881af15151889d2e890 2023-03-06 11:56:04,669 DEBUG [StoreOpener-19a0eec34378d881af15151889d2e890-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/family1 2023-03-06 11:56:04,669 DEBUG [StoreOpener-19a0eec34378d881af15151889d2e890-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/family1 2023-03-06 11:56:04,669 INFO [StoreOpener-19a0eec34378d881af15151889d2e890-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 19a0eec34378d881af15151889d2e890 columnFamilyName family1 2023-03-06 11:56:04,670 INFO [StoreOpener-19a0eec34378d881af15151889d2e890-1] regionserver.HStore(310): Store=19a0eec34378d881af15151889d2e890/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-06 11:56:04,671 INFO [StoreOpener-19a0eec34378d881af15151889d2e890-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 19a0eec34378d881af15151889d2e890 2023-03-06 11:56:04,671 DEBUG [StoreOpener-19a0eec34378d881af15151889d2e890-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/family2 2023-03-06 11:56:04,671 DEBUG [StoreOpener-19a0eec34378d881af15151889d2e890-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/family2 2023-03-06 11:56:04,672 INFO [StoreOpener-19a0eec34378d881af15151889d2e890-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 19a0eec34378d881af15151889d2e890 columnFamilyName family2 2023-03-06 11:56:04,672 INFO [StoreOpener-19a0eec34378d881af15151889d2e890-1] regionserver.HStore(310): Store=19a0eec34378d881af15151889d2e890/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-06 11:56:04,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890 2023-03-06 11:56:04,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890 2023-03-06 11:56:04,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-06 11:56:04,675 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 19a0eec34378d881af15151889d2e890 2023-03-06 11:56:04,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-06 11:56:04,677 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 19a0eec34378d881af15151889d2e890; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67119201, jitterRate=1.5403330326080322E-4}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-06 11:56:04,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 19a0eec34378d881af15151889d2e890: 2023-03-06 11:56:04,677 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,,1678103763522.19a0eec34378d881af15151889d2e890., pid=109, masterSystemTime=1678103764664 2023-03-06 11:56:04,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,,1678103763522.19a0eec34378d881af15151889d2e890. 2023-03-06 11:56:04,679 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,,1678103763522.19a0eec34378d881af15151889d2e890. 2023-03-06 11:56:04,679 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,1,1678103763522.1bf4d18e651e20acc78c321164b94cc2. 2023-03-06 11:56:04,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1bf4d18e651e20acc78c321164b94cc2, NAME => 'ns:testMinorCompaction,1,1678103763522.1bf4d18e651e20acc78c321164b94cc2.', STARTKEY => '1', ENDKEY => '2'} 2023-03-06 11:56:04,679 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=19a0eec34378d881af15151889d2e890, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:04,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 1bf4d18e651e20acc78c321164b94cc2 2023-03-06 11:56:04,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1678103763522.1bf4d18e651e20acc78c321164b94cc2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-06 11:56:04,679 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,,1678103763522.19a0eec34378d881af15151889d2e890.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1678103764679"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678103764679"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678103764679"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678103764679"}]},"ts":"1678103764679"} 2023-03-06 11:56:04,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 1bf4d18e651e20acc78c321164b94cc2 2023-03-06 11:56:04,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 1bf4d18e651e20acc78c321164b94cc2 2023-03-06 11:56:04,680 INFO [StoreOpener-1bf4d18e651e20acc78c321164b94cc2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 1bf4d18e651e20acc78c321164b94cc2 2023-03-06 11:56:04,681 DEBUG [StoreOpener-1bf4d18e651e20acc78c321164b94cc2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/family1 2023-03-06 11:56:04,681 DEBUG [StoreOpener-1bf4d18e651e20acc78c321164b94cc2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/family1 2023-03-06 11:56:04,681 INFO [StoreOpener-1bf4d18e651e20acc78c321164b94cc2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1bf4d18e651e20acc78c321164b94cc2 columnFamilyName family1 2023-03-06 11:56:04,682 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=106 2023-03-06 11:56:04,682 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure 19a0eec34378d881af15151889d2e890, server=jenkins-hbase5.apache.org,42547,1678103642479 in 168 msec 2023-03-06 11:56:04,682 INFO [StoreOpener-1bf4d18e651e20acc78c321164b94cc2-1] regionserver.HStore(310): Store=1bf4d18e651e20acc78c321164b94cc2/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-06 11:56:04,683 INFO [StoreOpener-1bf4d18e651e20acc78c321164b94cc2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 1bf4d18e651e20acc78c321164b94cc2 2023-03-06 11:56:04,683 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=19a0eec34378d881af15151889d2e890, ASSIGN in 326 msec 2023-03-06 11:56:04,683 DEBUG [StoreOpener-1bf4d18e651e20acc78c321164b94cc2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/family2 2023-03-06 11:56:04,684 DEBUG [StoreOpener-1bf4d18e651e20acc78c321164b94cc2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/family2 2023-03-06 11:56:04,684 INFO [StoreOpener-1bf4d18e651e20acc78c321164b94cc2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1bf4d18e651e20acc78c321164b94cc2 columnFamilyName family2 2023-03-06 11:56:04,684 INFO [StoreOpener-1bf4d18e651e20acc78c321164b94cc2-1] regionserver.HStore(310): Store=1bf4d18e651e20acc78c321164b94cc2/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-06 11:56:04,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2 2023-03-06 11:56:04,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2 2023-03-06 11:56:04,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-06 11:56:04,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 1bf4d18e651e20acc78c321164b94cc2 2023-03-06 11:56:04,689 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-06 11:56:04,690 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 1bf4d18e651e20acc78c321164b94cc2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72482639, jitterRate=0.08007548749446869}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-06 11:56:04,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 1bf4d18e651e20acc78c321164b94cc2: 2023-03-06 11:56:04,690 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,1,1678103763522.1bf4d18e651e20acc78c321164b94cc2., pid=111, masterSystemTime=1678103764664 2023-03-06 11:56:04,691 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,1,1678103763522.1bf4d18e651e20acc78c321164b94cc2. 2023-03-06 11:56:04,691 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,1,1678103763522.1bf4d18e651e20acc78c321164b94cc2. 2023-03-06 11:56:04,692 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,2,1678103763522.9423a74245608132f818a8fcb1dc4ed6. 2023-03-06 11:56:04,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9423a74245608132f818a8fcb1dc4ed6, NAME => 'ns:testMinorCompaction,2,1678103763522.9423a74245608132f818a8fcb1dc4ed6.', STARTKEY => '2', ENDKEY => ''} 2023-03-06 11:56:04,692 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=1bf4d18e651e20acc78c321164b94cc2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:04,692 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,1,1678103763522.1bf4d18e651e20acc78c321164b94cc2.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1678103764692"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678103764692"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678103764692"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678103764692"}]},"ts":"1678103764692"} 2023-03-06 11:56:04,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 9423a74245608132f818a8fcb1dc4ed6 2023-03-06 11:56:04,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1678103763522.9423a74245608132f818a8fcb1dc4ed6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-06 11:56:04,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 9423a74245608132f818a8fcb1dc4ed6 2023-03-06 11:56:04,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 9423a74245608132f818a8fcb1dc4ed6 2023-03-06 11:56:04,693 INFO [StoreOpener-9423a74245608132f818a8fcb1dc4ed6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 9423a74245608132f818a8fcb1dc4ed6 2023-03-06 11:56:04,694 DEBUG [StoreOpener-9423a74245608132f818a8fcb1dc4ed6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/family1 2023-03-06 11:56:04,694 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=111, resume processing ppid=107 2023-03-06 11:56:04,694 DEBUG [StoreOpener-9423a74245608132f818a8fcb1dc4ed6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/family1 2023-03-06 11:56:04,694 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=111, ppid=107, state=SUCCESS; OpenRegionProcedure 1bf4d18e651e20acc78c321164b94cc2, server=jenkins-hbase5.apache.org,42547,1678103642479 in 180 msec 2023-03-06 11:56:04,694 INFO [StoreOpener-9423a74245608132f818a8fcb1dc4ed6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9423a74245608132f818a8fcb1dc4ed6 columnFamilyName family1 2023-03-06 11:56:04,695 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=1bf4d18e651e20acc78c321164b94cc2, ASSIGN in 338 msec 2023-03-06 11:56:04,695 INFO [StoreOpener-9423a74245608132f818a8fcb1dc4ed6-1] regionserver.HStore(310): Store=9423a74245608132f818a8fcb1dc4ed6/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-06 11:56:04,695 INFO [StoreOpener-9423a74245608132f818a8fcb1dc4ed6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 9423a74245608132f818a8fcb1dc4ed6 2023-03-06 11:56:04,696 DEBUG [StoreOpener-9423a74245608132f818a8fcb1dc4ed6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/family2 2023-03-06 11:56:04,696 DEBUG [StoreOpener-9423a74245608132f818a8fcb1dc4ed6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/family2 2023-03-06 11:56:04,696 INFO [StoreOpener-9423a74245608132f818a8fcb1dc4ed6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9423a74245608132f818a8fcb1dc4ed6 columnFamilyName family2 2023-03-06 11:56:04,697 INFO [StoreOpener-9423a74245608132f818a8fcb1dc4ed6-1] regionserver.HStore(310): Store=9423a74245608132f818a8fcb1dc4ed6/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-06 11:56:04,698 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6 2023-03-06 11:56:04,698 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6 2023-03-06 11:56:04,699 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-06 11:56:04,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 9423a74245608132f818a8fcb1dc4ed6 2023-03-06 11:56:04,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-06 11:56:04,701 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 9423a74245608132f818a8fcb1dc4ed6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73210773, jitterRate=0.09092552959918976}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-06 11:56:04,702 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 9423a74245608132f818a8fcb1dc4ed6: 2023-03-06 11:56:04,702 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,2,1678103763522.9423a74245608132f818a8fcb1dc4ed6., pid=110, masterSystemTime=1678103764664 2023-03-06 11:56:04,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,2,1678103763522.9423a74245608132f818a8fcb1dc4ed6. 2023-03-06 11:56:04,703 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,2,1678103763522.9423a74245608132f818a8fcb1dc4ed6. 2023-03-06 11:56:04,703 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=9423a74245608132f818a8fcb1dc4ed6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:04,703 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,2,1678103763522.9423a74245608132f818a8fcb1dc4ed6.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1678103764703"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678103764703"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678103764703"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678103764703"}]},"ts":"1678103764703"} 2023-03-06 11:56:04,705 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=110, resume processing ppid=108 2023-03-06 11:56:04,706 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=110, ppid=108, state=SUCCESS; OpenRegionProcedure 9423a74245608132f818a8fcb1dc4ed6, server=jenkins-hbase5.apache.org,42547,1678103642479 in 191 msec 2023-03-06 11:56:04,707 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=105 2023-03-06 11:56:04,707 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=9423a74245608132f818a8fcb1dc4ed6, ASSIGN in 349 msec 2023-03-06 11:56:04,707 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-06 11:56:04,707 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678103764707"}]},"ts":"1678103764707"} 2023-03-06 11:56:04,708 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLED in hbase:meta 2023-03-06 11:56:04,709 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-03-06 11:56:04,710 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=ns:testMinorCompaction in 1.1880 sec 2023-03-06 11:56:05,513 DEBUG [RS:0;jenkins-hbase5:42547-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/.tmp/family2/f51bde0542cf453a8388688b2fb55a5c as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family2/f51bde0542cf453a8388688b2fb55a5c 2023-03-06 11:56:05,516 INFO [RS:0;jenkins-hbase5:42547-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in c2cfe3f574de2acbbfc1556c57115d2d/family2 of c2cfe3f574de2acbbfc1556c57115d2d into f51bde0542cf453a8388688b2fb55a5c(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-06 11:56:05,516 DEBUG [RS:0;jenkins-hbase5:42547-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for c2cfe3f574de2acbbfc1556c57115d2d: 2023-03-06 11:56:05,516 INFO [RS:0;jenkins-hbase5:42547-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d., storeName=c2cfe3f574de2acbbfc1556c57115d2d/family2, priority=12, startTime=1678103762328; duration=1sec 2023-03-06 11:56:05,517 DEBUG [RS:0;jenkins-hbase5:42547-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-06 11:56:05,605 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family2/testCompactionWithHFileLink=c2cfe3f574de2acbbfc1556c57115d2d-55c8f076991b4637ad28854f49c12c2e, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family2/testCompactionWithHFileLink=c2cfe3f574de2acbbfc1556c57115d2d-1c50ec366ebb4fa1ae19df1bcdd90ce4, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family2/testCompactionWithHFileLink=c2cfe3f574de2acbbfc1556c57115d2d-3e4f939b432142e682c697adc6d4bb4d, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family2/testCompactionWithHFileLink=c2cfe3f574de2acbbfc1556c57115d2d-5cc62b27f8ad4edf8b330b0c303b9512] to archive 2023-03-06 11:56:05,606 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:56:05,607 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family2/testCompactionWithHFileLink=c2cfe3f574de2acbbfc1556c57115d2d-55c8f076991b4637ad28854f49c12c2e to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family2/testCompactionWithHFileLink=c2cfe3f574de2acbbfc1556c57115d2d-55c8f076991b4637ad28854f49c12c2e 2023-03-06 11:56:05,608 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family2/testCompactionWithHFileLink=c2cfe3f574de2acbbfc1556c57115d2d-1c50ec366ebb4fa1ae19df1bcdd90ce4 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family2/testCompactionWithHFileLink=c2cfe3f574de2acbbfc1556c57115d2d-1c50ec366ebb4fa1ae19df1bcdd90ce4 2023-03-06 11:56:05,609 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family2/testCompactionWithHFileLink=c2cfe3f574de2acbbfc1556c57115d2d-3e4f939b432142e682c697adc6d4bb4d to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family2/testCompactionWithHFileLink=c2cfe3f574de2acbbfc1556c57115d2d-3e4f939b432142e682c697adc6d4bb4d 2023-03-06 11:56:05,610 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family2/testCompactionWithHFileLink=c2cfe3f574de2acbbfc1556c57115d2d-5cc62b27f8ad4edf8b330b0c303b9512 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/family2/testCompactionWithHFileLink=c2cfe3f574de2acbbfc1556c57115d2d-5cc62b27f8ad4edf8b330b0c303b9512 2023-03-06 11:56:05,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-03-06 11:56:05,629 INFO [Listener at localhost/46717] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: ns:testMinorCompaction, procId: 105 completed 2023-03-06 11:56:05,635 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42547] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1678103763522.19a0eec34378d881af15151889d2e890. with WAL disabled. Data may be lost in the event of a crash. 2023-03-06 11:56:05,635 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42547] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1678103763522.1bf4d18e651e20acc78c321164b94cc2. with WAL disabled. Data may be lost in the event of a crash. 2023-03-06 11:56:05,635 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42547] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1678103763522.9423a74245608132f818a8fcb1dc4ed6. with WAL disabled. Data may be lost in the event of a crash. 2023-03-06 11:56:05,637 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:56:05,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-03-06 11:56:05,638 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-03-06 11:56:05,638 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:56:05,638 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-03-06 11:56:05,639 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-03-06 11:56:05,639 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-06 11:56:05,639 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-06 11:56:05,640 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:05,640 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:56:05,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:56:05,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:56:05,640 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:05,640 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:56:05,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-06 11:56:05,641 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-06 11:56:05,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:56:05,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-06 11:56:05,641 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-03-06 11:56:05,641 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-03-06 11:56:05,641 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-03-06 11:56:05,641 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:56:05,641 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-03-06 11:56:05,641 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1678103763522.19a0eec34378d881af15151889d2e890. 2023-03-06 11:56:05,641 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1678103763522.19a0eec34378d881af15151889d2e890. started... 2023-03-06 11:56:05,641 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1678103763522.9423a74245608132f818a8fcb1dc4ed6. 2023-03-06 11:56:05,641 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-06 11:56:05,642 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:56:05,643 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 19a0eec34378d881af15151889d2e890 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-06 11:56:05,642 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1678103763522.1bf4d18e651e20acc78c321164b94cc2. 2023-03-06 11:56:05,642 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1678103763522.9423a74245608132f818a8fcb1dc4ed6. started... 2023-03-06 11:56:05,643 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1678103763522.1bf4d18e651e20acc78c321164b94cc2. started... 2023-03-06 11:56:05,643 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 9423a74245608132f818a8fcb1dc4ed6 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-06 11:56:05,643 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 1bf4d18e651e20acc78c321164b94cc2 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-06 11:56:06,055 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230306b837e935bc0149d0b7f3d34949ac216b to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230306b837e935bc0149d0b7f3d34949ac216b 2023-03-06 11:56:06,055 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230306605f04bce38c4c88beb89a6c1de513e8 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230306605f04bce38c4c88beb89a6c1de513e8 2023-03-06 11:56:06,055 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230306f0b854efc5ef416a8ed2bb1aac769ddf to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230306f0b854efc5ef416a8ed2bb1aac769ddf 2023-03-06 11:56:06,061 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/.tmp/family1/bb023f11a31045108db4e42c0dce2e23 2023-03-06 11:56:06,460 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/.tmp/family1/7542e3c0e4d443d5addbdf8e03be31a6 2023-03-06 11:56:06,460 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/.tmp/family1/7351f908791748dcade61fb0d9b82aef 2023-03-06 11:56:06,478 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303069f53316f5f8f4f15a6e7ddda38d4fb0b to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202303069f53316f5f8f4f15a6e7ddda38d4fb0b 2023-03-06 11:56:06,479 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230306d04d0e3a4e2f4c48afe3138be3db10c1 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230306d04d0e3a4e2f4c48afe3138be3db10c1 2023-03-06 11:56:06,484 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/.tmp/family2/addd393b24654cbbb3a3a4a8a5f815dc 2023-03-06 11:56:06,487 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/.tmp/family1/7351f908791748dcade61fb0d9b82aef as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/family1/7351f908791748dcade61fb0d9b82aef 2023-03-06 11:56:06,491 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/family1/7351f908791748dcade61fb0d9b82aef, entries=4, sequenceid=5, filesize=5.4 K 2023-03-06 11:56:06,491 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/.tmp/family2/addd393b24654cbbb3a3a4a8a5f815dc as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/family2/addd393b24654cbbb3a3a4a8a5f815dc 2023-03-06 11:56:06,495 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/family2/addd393b24654cbbb3a3a4a8a5f815dc, entries=2, sequenceid=5, filesize=5.1 K 2023-03-06 11:56:06,495 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 1bf4d18e651e20acc78c321164b94cc2 in 852ms, sequenceid=5, compaction requested=false 2023-03-06 11:56:06,495 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-03-06 11:56:06,496 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 1bf4d18e651e20acc78c321164b94cc2: 2023-03-06 11:56:06,496 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1678103763522.1bf4d18e651e20acc78c321164b94cc2. 2023-03-06 11:56:06,496 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-06 11:56:06,880 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230306bf16ae1c123e4e3d90c3aa6c6955026d to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230306bf16ae1c123e4e3d90c3aa6c6955026d 2023-03-06 11:56:06,883 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/.tmp/family2/e392278c5f7941d78ff2fe4b53cdec65 2023-03-06 11:56:06,884 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/.tmp/family2/025c94843cbd4537886620f83a825814 2023-03-06 11:56:06,887 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/.tmp/family1/bb023f11a31045108db4e42c0dce2e23 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/family1/bb023f11a31045108db4e42c0dce2e23 2023-03-06 11:56:06,888 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/.tmp/family1/7542e3c0e4d443d5addbdf8e03be31a6 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/family1/7542e3c0e4d443d5addbdf8e03be31a6 2023-03-06 11:56:06,891 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/family1/bb023f11a31045108db4e42c0dce2e23, entries=4, sequenceid=5, filesize=5.4 K 2023-03-06 11:56:06,891 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/.tmp/family2/e392278c5f7941d78ff2fe4b53cdec65 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/family2/e392278c5f7941d78ff2fe4b53cdec65 2023-03-06 11:56:06,891 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/family1/7542e3c0e4d443d5addbdf8e03be31a6, entries=4, sequenceid=5, filesize=5.4 K 2023-03-06 11:56:06,892 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/.tmp/family2/025c94843cbd4537886620f83a825814 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/family2/025c94843cbd4537886620f83a825814 2023-03-06 11:56:06,894 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/family2/e392278c5f7941d78ff2fe4b53cdec65, entries=2, sequenceid=5, filesize=5.1 K 2023-03-06 11:56:06,895 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/family2/025c94843cbd4537886620f83a825814, entries=2, sequenceid=5, filesize=5.1 K 2023-03-06 11:56:06,895 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 9423a74245608132f818a8fcb1dc4ed6 in 1252ms, sequenceid=5, compaction requested=false 2023-03-06 11:56:06,896 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 9423a74245608132f818a8fcb1dc4ed6: 2023-03-06 11:56:06,896 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1678103763522.9423a74245608132f818a8fcb1dc4ed6. 2023-03-06 11:56:06,896 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-06 11:56:06,896 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 19a0eec34378d881af15151889d2e890 in 1253ms, sequenceid=5, compaction requested=false 2023-03-06 11:56:06,896 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 19a0eec34378d881af15151889d2e890: 2023-03-06 11:56:06,896 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1678103763522.19a0eec34378d881af15151889d2e890. 2023-03-06 11:56:06,896 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-06 11:56:06,896 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-06 11:56:06,896 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:06,896 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-03-06 11:56:06,897 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-03-06 11:56:06,899 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:06,899 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-06 11:56:06,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:06,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:56:06,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:56:06,899 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-06 11:56:06,899 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:56:06,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:56:06,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:56:06,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-06 11:56:06,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:06,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:56:06,900 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-03-06 11:56:06,900 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@37725d11[Count = 0] remaining members to acquire global barrier 2023-03-06 11:56:06,900 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-03-06 11:56:06,901 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-06 11:56:06,902 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-06 11:56:06,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-06 11:56:06,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-06 11:56:06,902 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-03-06 11:56:06,902 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-03-06 11:56:06,902 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:56:06,902 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:06,902 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:56:06,903 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-03-06 11:56:06,903 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:56:06,903 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:06,903 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-03-06 11:56:06,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:06,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:56:06,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:56:06,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:56:06,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:56:06,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-06 11:56:06,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:06,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:56:06,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-06 11:56:06,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:06,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:56:06,905 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-03-06 11:56:06,905 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-03-06 11:56:06,905 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:56:06,905 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:56:06,905 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-03-06 11:56:06,905 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:56:06,906 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-06 11:56:06,906 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-06 11:56:06,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-06 11:56:06,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:56:06,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:56:06,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-06 11:56:06,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-06 11:56:06,906 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:56:06,907 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:06,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:56:06,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:56:06,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:56:06,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-06 11:56:06,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-06 11:56:06,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:56:06,908 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:06,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-06 11:56:06,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:06,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:56:06,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-06 11:56:06,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:06,911 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:06,911 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:56:06,911 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-06 11:56:06,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:56:06,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:56:06,911 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:56:06,911 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-03-06 11:56:06,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:56:06,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:56:06,911 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:56:06,911 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-06 11:56:06,912 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:06,912 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-06 11:56:06,912 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-06 11:56:06,912 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-06 11:56:06,912 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:56:06,912 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-03-06 11:56:06,912 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:56:07,012 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:56:07,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:56:07,015 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42547] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1678103763522.19a0eec34378d881af15151889d2e890. with WAL disabled. Data may be lost in the event of a crash. 2023-03-06 11:56:07,015 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42547] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1678103763522.1bf4d18e651e20acc78c321164b94cc2. with WAL disabled. Data may be lost in the event of a crash. 2023-03-06 11:56:07,015 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42547] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1678103763522.9423a74245608132f818a8fcb1dc4ed6. with WAL disabled. Data may be lost in the event of a crash. 2023-03-06 11:56:07,018 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:56:07,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-03-06 11:56:07,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-03-06 11:56:07,020 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-03-06 11:56:07,020 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:56:07,020 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-03-06 11:56:07,020 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-03-06 11:56:07,020 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-06 11:56:07,021 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-06 11:56:07,022 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:56:07,022 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:07,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:56:07,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:56:07,022 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:07,022 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:56:07,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-06 11:56:07,022 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-06 11:56:07,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:56:07,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-06 11:56:07,023 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-03-06 11:56:07,023 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-03-06 11:56:07,023 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-03-06 11:56:07,023 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-03-06 11:56:07,023 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:56:07,023 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-03-06 11:56:07,023 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1678103763522.19a0eec34378d881af15151889d2e890. 2023-03-06 11:56:07,023 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-06 11:56:07,023 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:56:07,023 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1678103763522.19a0eec34378d881af15151889d2e890. started... 2023-03-06 11:56:07,023 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1678103763522.1bf4d18e651e20acc78c321164b94cc2. 2023-03-06 11:56:07,023 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1678103763522.9423a74245608132f818a8fcb1dc4ed6. 2023-03-06 11:56:07,023 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 19a0eec34378d881af15151889d2e890 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-06 11:56:07,023 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1678103763522.1bf4d18e651e20acc78c321164b94cc2. started... 2023-03-06 11:56:07,024 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1678103763522.9423a74245608132f818a8fcb1dc4ed6. started... 2023-03-06 11:56:07,024 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 1bf4d18e651e20acc78c321164b94cc2 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-06 11:56:07,024 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 9423a74245608132f818a8fcb1dc4ed6 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-06 11:56:07,039 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303061c853626f1f045458e2f70abea5d08b0 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202303061c853626f1f045458e2f70abea5d08b0 2023-03-06 11:56:07,439 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303065c1578790db04a578d5f054221e7a191 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202303065c1578790db04a578d5f054221e7a191 2023-03-06 11:56:07,439 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303067bd086b5a03347219c39c720024690e6 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202303067bd086b5a03347219c39c720024690e6 2023-03-06 11:56:07,444 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/.tmp/family1/84a113362beb470e8270dfdbbedd6fe0 2023-03-06 11:56:07,845 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/.tmp/family1/b19e550098284a39bcafcedf39ecd24d 2023-03-06 11:56:07,845 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/.tmp/family1/5669d1f2ffa2401ebdcf91dfd9ec5852 2023-03-06 11:56:07,855 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303063d897a2c4e54471bad8e45d6f09ca729 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202303063d897a2c4e54471bad8e45d6f09ca729 2023-03-06 11:56:08,263 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/.tmp/family2/f4ede7bebe3846b08e7a8c1da12066a1 2023-03-06 11:56:08,266 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023030617b8dc3b854044e48813e7e3b9e8af09 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b2023030617b8dc3b854044e48813e7e3b9e8af09 2023-03-06 11:56:08,266 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303066dee058151174d9eba8ddcf2479531f7 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202303066dee058151174d9eba8ddcf2479531f7 2023-03-06 11:56:08,267 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/.tmp/family1/84a113362beb470e8270dfdbbedd6fe0 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/family1/84a113362beb470e8270dfdbbedd6fe0 2023-03-06 11:56:08,270 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/family1/84a113362beb470e8270dfdbbedd6fe0, entries=4, sequenceid=9, filesize=5.4 K 2023-03-06 11:56:08,271 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/.tmp/family2/f4ede7bebe3846b08e7a8c1da12066a1 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/family2/f4ede7bebe3846b08e7a8c1da12066a1 2023-03-06 11:56:08,278 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/family2/f4ede7bebe3846b08e7a8c1da12066a1, entries=2, sequenceid=9, filesize=5.1 K 2023-03-06 11:56:08,279 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 9423a74245608132f818a8fcb1dc4ed6 in 1255ms, sequenceid=9, compaction requested=false 2023-03-06 11:56:08,279 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 9423a74245608132f818a8fcb1dc4ed6: 2023-03-06 11:56:08,279 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1678103763522.9423a74245608132f818a8fcb1dc4ed6. 2023-03-06 11:56:08,279 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-06 11:56:08,674 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/.tmp/family2/a7c229268df44783a87cb0dade9ff03c 2023-03-06 11:56:08,674 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/.tmp/family2/fff1350797d6482eaec4be93c5fcfb45 2023-03-06 11:56:08,678 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/.tmp/family1/5669d1f2ffa2401ebdcf91dfd9ec5852 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/family1/5669d1f2ffa2401ebdcf91dfd9ec5852 2023-03-06 11:56:08,678 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/.tmp/family1/b19e550098284a39bcafcedf39ecd24d as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/family1/b19e550098284a39bcafcedf39ecd24d 2023-03-06 11:56:08,682 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/family1/b19e550098284a39bcafcedf39ecd24d, entries=4, sequenceid=9, filesize=5.4 K 2023-03-06 11:56:08,682 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/family1/5669d1f2ffa2401ebdcf91dfd9ec5852, entries=4, sequenceid=9, filesize=5.4 K 2023-03-06 11:56:08,683 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/.tmp/family2/a7c229268df44783a87cb0dade9ff03c as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/family2/a7c229268df44783a87cb0dade9ff03c 2023-03-06 11:56:08,683 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/.tmp/family2/fff1350797d6482eaec4be93c5fcfb45 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/family2/fff1350797d6482eaec4be93c5fcfb45 2023-03-06 11:56:08,687 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/family2/a7c229268df44783a87cb0dade9ff03c, entries=2, sequenceid=9, filesize=5.1 K 2023-03-06 11:56:08,687 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/family2/fff1350797d6482eaec4be93c5fcfb45, entries=2, sequenceid=9, filesize=5.1 K 2023-03-06 11:56:08,688 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 1bf4d18e651e20acc78c321164b94cc2 in 1664ms, sequenceid=9, compaction requested=false 2023-03-06 11:56:08,688 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 19a0eec34378d881af15151889d2e890 in 1665ms, sequenceid=9, compaction requested=false 2023-03-06 11:56:08,688 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 1bf4d18e651e20acc78c321164b94cc2: 2023-03-06 11:56:08,688 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 19a0eec34378d881af15151889d2e890: 2023-03-06 11:56:08,688 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1678103763522.1bf4d18e651e20acc78c321164b94cc2. 2023-03-06 11:56:08,688 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1678103763522.19a0eec34378d881af15151889d2e890. 2023-03-06 11:56:08,688 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-06 11:56:08,688 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-06 11:56:08,688 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-06 11:56:08,688 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:08,688 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-03-06 11:56:08,688 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-03-06 11:56:08,691 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:08,691 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-06 11:56:08,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:08,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:56:08,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:56:08,691 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-06 11:56:08,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:56:08,691 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:56:08,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:56:08,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-06 11:56:08,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:08,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:56:08,692 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-03-06 11:56:08,692 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@29c52340[Count = 0] remaining members to acquire global barrier 2023-03-06 11:56:08,692 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-03-06 11:56:08,692 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-06 11:56:08,693 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-06 11:56:08,693 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-06 11:56:08,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-06 11:56:08,693 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-03-06 11:56:08,694 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:08,694 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-03-06 11:56:08,694 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:56:08,694 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:56:08,697 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-03-06 11:56:08,697 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:08,697 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:56:08,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:08,697 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-03-06 11:56:08,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:56:08,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:56:08,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:56:08,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:56:08,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-06 11:56:08,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:08,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:56:08,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-06 11:56:08,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:08,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:56:08,699 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-03-06 11:56:08,699 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-03-06 11:56:08,699 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:56:08,699 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:56:08,699 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-03-06 11:56:08,699 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:56:08,701 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-06 11:56:08,701 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-06 11:56:08,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-06 11:56:08,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:56:08,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:56:08,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-06 11:56:08,701 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:56:08,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-06 11:56:08,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:56:08,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:56:08,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:56:08,702 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:08,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-06 11:56:08,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-06 11:56:08,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:56:08,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-06 11:56:08,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:08,703 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:08,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:56:08,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-06 11:56:08,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:08,705 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:56:08,705 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:08,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:56:08,705 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:56:08,705 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:56:08,705 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-03-06 11:56:08,705 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:56:08,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:56:08,705 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-06 11:56:08,706 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-06 11:56:08,706 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:08,706 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-06 11:56:08,706 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-06 11:56:08,706 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-06 11:56:08,706 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-03-06 11:56:08,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:56:08,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:56:08,706 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:56:08,806 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:56:08,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:56:08,808 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42547] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1678103763522.19a0eec34378d881af15151889d2e890. with WAL disabled. Data may be lost in the event of a crash. 2023-03-06 11:56:08,808 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42547] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1678103763522.1bf4d18e651e20acc78c321164b94cc2. with WAL disabled. Data may be lost in the event of a crash. 2023-03-06 11:56:08,808 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42547] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1678103763522.9423a74245608132f818a8fcb1dc4ed6. with WAL disabled. Data may be lost in the event of a crash. 2023-03-06 11:56:08,810 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:56:08,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-03-06 11:56:08,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-03-06 11:56:08,812 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-03-06 11:56:08,812 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:56:08,812 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-03-06 11:56:08,812 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-03-06 11:56:08,812 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-06 11:56:08,813 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-06 11:56:08,814 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:56:08,814 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:08,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:56:08,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:56:08,814 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:08,814 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:56:08,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-06 11:56:08,814 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-06 11:56:08,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:56:08,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-06 11:56:08,815 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-03-06 11:56:08,815 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-03-06 11:56:08,815 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-03-06 11:56:08,815 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-03-06 11:56:08,815 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:56:08,815 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-03-06 11:56:08,815 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1678103763522.19a0eec34378d881af15151889d2e890. 2023-03-06 11:56:08,815 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1678103763522.19a0eec34378d881af15151889d2e890. started... 2023-03-06 11:56:08,815 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1678103763522.9423a74245608132f818a8fcb1dc4ed6. 2023-03-06 11:56:08,815 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1678103763522.1bf4d18e651e20acc78c321164b94cc2. 2023-03-06 11:56:08,815 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1678103763522.1bf4d18e651e20acc78c321164b94cc2. started... 2023-03-06 11:56:08,815 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 19a0eec34378d881af15151889d2e890 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-06 11:56:08,815 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-06 11:56:08,815 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:56:08,815 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 1bf4d18e651e20acc78c321164b94cc2 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-06 11:56:08,815 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1678103763522.9423a74245608132f818a8fcb1dc4ed6. started... 2023-03-06 11:56:08,816 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 9423a74245608132f818a8fcb1dc4ed6 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-06 11:56:09,228 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303061793f000de114c69a478d6781cde52e1 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202303061793f000de114c69a478d6781cde52e1 2023-03-06 11:56:09,228 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023030607d65e469e8849a7b68fb206248ed3e1 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023030607d65e469e8849a7b68fb206248ed3e1 2023-03-06 11:56:09,228 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303064a3357ccd79940d7ada62f87b4bbd452 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202303064a3357ccd79940d7ada62f87b4bbd452 2023-03-06 11:56:09,637 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/.tmp/family1/e40205f642754ae5a4d27ee18463560e 2023-03-06 11:56:09,637 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/.tmp/family1/a65b5a183b1f43cdad6236245579906c 2023-03-06 11:56:09,637 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/.tmp/family1/0e54cd94c4654acfb93659ae683e7dd8 2023-03-06 11:56:10,054 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303060fcb4f6a7c724ddcb291828a969fbfd3 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202303060fcb4f6a7c724ddcb291828a969fbfd3 2023-03-06 11:56:10,058 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023030670460e2e16314a2f85eed6a4c7e2534f to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b2023030670460e2e16314a2f85eed6a4c7e2534f 2023-03-06 11:56:10,062 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230306b629550723fe4b2a8d809fcf34ebdd0e to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230306b629550723fe4b2a8d809fcf34ebdd0e 2023-03-06 11:56:10,063 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/.tmp/family2/dcdc54a5a7c2461f9b47198c9feeba73 2023-03-06 11:56:10,066 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/.tmp/family1/a65b5a183b1f43cdad6236245579906c as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/family1/a65b5a183b1f43cdad6236245579906c 2023-03-06 11:56:10,069 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/family1/a65b5a183b1f43cdad6236245579906c, entries=4, sequenceid=13, filesize=5.4 K 2023-03-06 11:56:10,070 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/.tmp/family2/dcdc54a5a7c2461f9b47198c9feeba73 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/family2/dcdc54a5a7c2461f9b47198c9feeba73 2023-03-06 11:56:10,072 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/family2/dcdc54a5a7c2461f9b47198c9feeba73, entries=2, sequenceid=13, filesize=5.1 K 2023-03-06 11:56:10,073 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 1bf4d18e651e20acc78c321164b94cc2 in 1258ms, sequenceid=13, compaction requested=true 2023-03-06 11:56:10,073 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 1bf4d18e651e20acc78c321164b94cc2: 2023-03-06 11:56:10,073 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1678103763522.1bf4d18e651e20acc78c321164b94cc2. 2023-03-06 11:56:10,073 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-06 11:56:10,169 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-06 11:56:10,459 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/.tmp/family2/a68fa6401ae9416dbaaa664fede4a54b 2023-03-06 11:56:10,463 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/.tmp/family1/e40205f642754ae5a4d27ee18463560e as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/family1/e40205f642754ae5a4d27ee18463560e 2023-03-06 11:56:10,466 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/family1/e40205f642754ae5a4d27ee18463560e, entries=4, sequenceid=13, filesize=5.4 K 2023-03-06 11:56:10,466 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/.tmp/family2/1c8275b6de444eb796424a553c3bcbfd 2023-03-06 11:56:10,467 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/.tmp/family2/a68fa6401ae9416dbaaa664fede4a54b as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/family2/a68fa6401ae9416dbaaa664fede4a54b 2023-03-06 11:56:10,475 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/family2/a68fa6401ae9416dbaaa664fede4a54b, entries=2, sequenceid=13, filesize=5.1 K 2023-03-06 11:56:10,475 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/.tmp/family1/0e54cd94c4654acfb93659ae683e7dd8 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/family1/0e54cd94c4654acfb93659ae683e7dd8 2023-03-06 11:56:10,476 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 9423a74245608132f818a8fcb1dc4ed6 in 1660ms, sequenceid=13, compaction requested=true 2023-03-06 11:56:10,476 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 9423a74245608132f818a8fcb1dc4ed6: 2023-03-06 11:56:10,476 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1678103763522.9423a74245608132f818a8fcb1dc4ed6. 2023-03-06 11:56:10,476 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-06 11:56:10,479 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/family1/0e54cd94c4654acfb93659ae683e7dd8, entries=4, sequenceid=13, filesize=5.4 K 2023-03-06 11:56:10,479 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/.tmp/family2/1c8275b6de444eb796424a553c3bcbfd as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/family2/1c8275b6de444eb796424a553c3bcbfd 2023-03-06 11:56:10,482 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/family2/1c8275b6de444eb796424a553c3bcbfd, entries=2, sequenceid=13, filesize=5.1 K 2023-03-06 11:56:10,483 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 19a0eec34378d881af15151889d2e890 in 1668ms, sequenceid=13, compaction requested=true 2023-03-06 11:56:10,483 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 19a0eec34378d881af15151889d2e890: 2023-03-06 11:56:10,483 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1678103763522.19a0eec34378d881af15151889d2e890. 2023-03-06 11:56:10,483 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-06 11:56:10,483 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-06 11:56:10,483 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:10,483 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-03-06 11:56:10,483 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-03-06 11:56:10,485 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:10,485 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-06 11:56:10,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:10,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:56:10,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:56:10,485 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-06 11:56:10,485 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:56:10,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:56:10,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:56:10,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-06 11:56:10,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:10,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:56:10,486 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-03-06 11:56:10,486 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@54715f07[Count = 0] remaining members to acquire global barrier 2023-03-06 11:56:10,486 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-03-06 11:56:10,486 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-06 11:56:10,488 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-06 11:56:10,488 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-06 11:56:10,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-06 11:56:10,488 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-03-06 11:56:10,488 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:10,488 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:56:10,488 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-03-06 11:56:10,488 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:56:10,489 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:10,490 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-03-06 11:56:10,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:10,490 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:56:10,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:56:10,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:56:10,490 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-03-06 11:56:10,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:56:10,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:56:10,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-06 11:56:10,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:10,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:56:10,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-06 11:56:10,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:10,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:56:10,492 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-03-06 11:56:10,492 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-03-06 11:56:10,492 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:56:10,492 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:56:10,492 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-03-06 11:56:10,492 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:56:10,493 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-06 11:56:10,493 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-06 11:56:10,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-06 11:56:10,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-06 11:56:10,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:56:10,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:56:10,493 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:56:10,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-06 11:56:10,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:56:10,493 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:10,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:56:10,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:56:10,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-06 11:56:10,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-06 11:56:10,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:56:10,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-06 11:56:10,494 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:10,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:10,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:56:10,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-06 11:56:10,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:10,496 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:10,496 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:56:10,496 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-06 11:56:10,496 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:56:10,496 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-03-06 11:56:10,496 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:56:10,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:56:10,496 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-06 11:56:10,496 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:56:10,496 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-03-06 11:56:10,496 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:56:10,496 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:10,496 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-06 11:56:10,496 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-06 11:56:10,497 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-06 11:56:10,497 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-03-06 11:56:10,497 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:56:10,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:56:10,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:56:10,597 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:56:10,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:56:10,599 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42547] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1678103763522.19a0eec34378d881af15151889d2e890. with WAL disabled. Data may be lost in the event of a crash. 2023-03-06 11:56:10,599 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42547] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1678103763522.1bf4d18e651e20acc78c321164b94cc2. with WAL disabled. Data may be lost in the event of a crash. 2023-03-06 11:56:10,599 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42547] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1678103763522.9423a74245608132f818a8fcb1dc4ed6. with WAL disabled. Data may be lost in the event of a crash. 2023-03-06 11:56:10,601 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:56:10,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-03-06 11:56:10,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-03-06 11:56:10,603 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-03-06 11:56:10,603 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:56:10,603 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-03-06 11:56:10,603 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-03-06 11:56:10,603 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-06 11:56:10,603 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-06 11:56:10,606 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:10,606 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:56:10,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:56:10,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:56:10,607 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:10,607 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:56:10,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-06 11:56:10,607 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-06 11:56:10,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:56:10,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-06 11:56:10,607 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-03-06 11:56:10,608 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-03-06 11:56:10,608 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-03-06 11:56:10,608 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-03-06 11:56:10,608 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:56:10,608 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-03-06 11:56:10,608 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1678103763522.19a0eec34378d881af15151889d2e890. 2023-03-06 11:56:10,608 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1678103763522.19a0eec34378d881af15151889d2e890. started... 2023-03-06 11:56:10,608 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1678103763522.9423a74245608132f818a8fcb1dc4ed6. 2023-03-06 11:56:10,608 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1678103763522.9423a74245608132f818a8fcb1dc4ed6. started... 2023-03-06 11:56:10,608 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 19a0eec34378d881af15151889d2e890 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-06 11:56:10,608 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-06 11:56:10,608 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:56:10,608 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 9423a74245608132f818a8fcb1dc4ed6 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-06 11:56:10,608 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1678103763522.1bf4d18e651e20acc78c321164b94cc2. 2023-03-06 11:56:10,608 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1678103763522.1bf4d18e651e20acc78c321164b94cc2. started... 2023-03-06 11:56:10,608 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 1bf4d18e651e20acc78c321164b94cc2 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-06 11:56:11,021 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230306e7359a5b500347e5ad0f526746fc8441 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230306e7359a5b500347e5ad0f526746fc8441 2023-03-06 11:56:11,021 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230306bd29cf55f4394a84936ccaed973cfa0d to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230306bd29cf55f4394a84936ccaed973cfa0d 2023-03-06 11:56:11,021 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230306cfb5bd736f014447aade7e8538c26d6e to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230306cfb5bd736f014447aade7e8538c26d6e 2023-03-06 11:56:11,428 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/.tmp/family1/0fd06864f4344e94b651d6e313cc2ed5 2023-03-06 11:56:11,428 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/.tmp/family1/d4a22a2bce154e9480c2d262b3a670b4 2023-03-06 11:56:11,428 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/.tmp/family1/329c4c7b073940fbaf5ebbd2862e0adb 2023-03-06 11:56:11,844 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303068b1b4daa668c42589637e0c61d0cd863 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202303068b1b4daa668c42589637e0c61d0cd863 2023-03-06 11:56:11,844 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303060638cc84990b45e39cf7eb5c1381aba8 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202303060638cc84990b45e39cf7eb5c1381aba8 2023-03-06 11:56:11,844 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303061ec7b32bc335473bb510cfe83195afb0 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202303061ec7b32bc335473bb510cfe83195afb0 2023-03-06 11:56:12,249 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/.tmp/family2/820f842e1b614edfa595c4024a68cadd 2023-03-06 11:56:12,249 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/.tmp/family2/bd59905140ff4e208671a52faebaacff 2023-03-06 11:56:12,249 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/.tmp/family2/8bdb67ef99df449584c0b3df661e32d8 2023-03-06 11:56:12,253 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/.tmp/family1/d4a22a2bce154e9480c2d262b3a670b4 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/family1/d4a22a2bce154e9480c2d262b3a670b4 2023-03-06 11:56:12,253 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/.tmp/family1/329c4c7b073940fbaf5ebbd2862e0adb as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/family1/329c4c7b073940fbaf5ebbd2862e0adb 2023-03-06 11:56:12,253 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/.tmp/family1/0fd06864f4344e94b651d6e313cc2ed5 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/family1/0fd06864f4344e94b651d6e313cc2ed5 2023-03-06 11:56:12,256 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/family1/d4a22a2bce154e9480c2d262b3a670b4, entries=4, sequenceid=17, filesize=5.4 K 2023-03-06 11:56:12,256 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/family1/329c4c7b073940fbaf5ebbd2862e0adb, entries=4, sequenceid=17, filesize=5.4 K 2023-03-06 11:56:12,256 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/family1/0fd06864f4344e94b651d6e313cc2ed5, entries=4, sequenceid=17, filesize=5.4 K 2023-03-06 11:56:12,256 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/.tmp/family2/bd59905140ff4e208671a52faebaacff as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/family2/bd59905140ff4e208671a52faebaacff 2023-03-06 11:56:12,257 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/.tmp/family2/8bdb67ef99df449584c0b3df661e32d8 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/family2/8bdb67ef99df449584c0b3df661e32d8 2023-03-06 11:56:12,257 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/.tmp/family2/820f842e1b614edfa595c4024a68cadd as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/family2/820f842e1b614edfa595c4024a68cadd 2023-03-06 11:56:12,260 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/family2/bd59905140ff4e208671a52faebaacff, entries=2, sequenceid=17, filesize=5.1 K 2023-03-06 11:56:12,260 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/family2/8bdb67ef99df449584c0b3df661e32d8, entries=2, sequenceid=17, filesize=5.1 K 2023-03-06 11:56:12,260 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/family2/820f842e1b614edfa595c4024a68cadd, entries=2, sequenceid=17, filesize=5.1 K 2023-03-06 11:56:12,261 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 9423a74245608132f818a8fcb1dc4ed6 in 1653ms, sequenceid=17, compaction requested=true 2023-03-06 11:56:12,261 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 1bf4d18e651e20acc78c321164b94cc2 in 1653ms, sequenceid=17, compaction requested=true 2023-03-06 11:56:12,261 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 19a0eec34378d881af15151889d2e890 in 1653ms, sequenceid=17, compaction requested=true 2023-03-06 11:56:12,261 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 9423a74245608132f818a8fcb1dc4ed6: 2023-03-06 11:56:12,261 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 19a0eec34378d881af15151889d2e890: 2023-03-06 11:56:12,261 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 1bf4d18e651e20acc78c321164b94cc2: 2023-03-06 11:56:12,261 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1678103763522.19a0eec34378d881af15151889d2e890. 2023-03-06 11:56:12,261 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1678103763522.1bf4d18e651e20acc78c321164b94cc2. 2023-03-06 11:56:12,261 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-06 11:56:12,261 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1678103763522.9423a74245608132f818a8fcb1dc4ed6. 2023-03-06 11:56:12,261 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-06 11:56:12,261 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-06 11:56:12,261 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-06 11:56:12,261 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:12,261 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-03-06 11:56:12,262 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-03-06 11:56:12,263 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-06 11:56:12,263 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:12,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:12,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:56:12,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:56:12,263 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-06 11:56:12,263 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:56:12,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:56:12,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:56:12,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-06 11:56:12,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:12,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:56:12,265 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-03-06 11:56:12,265 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@67ad4711[Count = 0] remaining members to acquire global barrier 2023-03-06 11:56:12,265 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-03-06 11:56:12,265 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-06 11:56:12,266 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-06 11:56:12,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-06 11:56:12,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-06 11:56:12,266 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-03-06 11:56:12,266 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-03-06 11:56:12,266 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:56:12,266 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:12,266 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:56:12,267 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:12,267 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-03-06 11:56:12,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:12,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:56:12,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:56:12,267 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:56:12,267 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-03-06 11:56:12,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:56:12,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:56:12,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-06 11:56:12,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:12,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:56:12,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-06 11:56:12,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:12,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:56:12,269 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-03-06 11:56:12,269 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-03-06 11:56:12,269 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:56:12,269 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:56:12,269 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-03-06 11:56:12,269 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:56:12,272 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-06 11:56:12,273 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-06 11:56:12,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-06 11:56:12,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:56:12,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:56:12,273 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:56:12,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-06 11:56:12,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-06 11:56:12,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:56:12,273 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:12,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:56:12,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:56:12,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-06 11:56:12,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-06 11:56:12,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:56:12,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-06 11:56:12,274 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:12,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:12,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:56:12,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-06 11:56:12,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:12,276 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:12,276 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:56:12,276 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-06 11:56:12,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:56:12,276 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-03-06 11:56:12,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:56:12,276 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-03-06 11:56:12,276 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:56:12,276 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:56:12,276 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-06 11:56:12,276 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:56:12,276 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:12,277 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:56:12,277 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-03-06 11:56:12,277 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-06 11:56:12,277 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:56:12,277 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-06 11:56:12,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:56:12,277 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-06 11:56:12,377 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:56:12,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:56:12,388 DEBUG [Listener at localhost/46717] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-06 11:56:12,396 DEBUG [Listener at localhost/46717] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-06 11:56:12,403 DEBUG [Listener at localhost/46717] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-06 11:56:12,404 DEBUG [Listener at localhost/46717] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-06 11:56:12,431 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:56:12,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-03-06 11:56:12,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-03-06 11:56:12,432 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-03-06 11:56:12,432 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:56:12,432 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-03-06 11:56:12,432 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-03-06 11:56:12,433 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-06 11:56:12,433 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-06 11:56:12,434 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:56:12,434 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:12,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:56:12,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:56:12,434 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:12,434 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:56:12,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-06 11:56:12,435 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-06 11:56:12,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:56:12,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-06 11:56:12,435 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-03-06 11:56:12,445 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-03-06 11:56:12,445 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-03-06 11:56:12,445 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-03-06 11:56:12,445 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:56:12,445 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-03-06 11:56:12,445 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1678103763522.19a0eec34378d881af15151889d2e890. 2023-03-06 11:56:12,445 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1678103763522.19a0eec34378d881af15151889d2e890. started... 2023-03-06 11:56:12,445 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1678103763522.9423a74245608132f818a8fcb1dc4ed6. 2023-03-06 11:56:12,445 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 19a0eec34378d881af15151889d2e890 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-06 11:56:12,445 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-06 11:56:12,445 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:56:12,445 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1678103763522.9423a74245608132f818a8fcb1dc4ed6. started... 2023-03-06 11:56:12,445 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1678103763522.1bf4d18e651e20acc78c321164b94cc2. 2023-03-06 11:56:12,445 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 9423a74245608132f818a8fcb1dc4ed6 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-06 11:56:12,445 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1678103763522.1bf4d18e651e20acc78c321164b94cc2. started... 2023-03-06 11:56:12,445 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 1bf4d18e651e20acc78c321164b94cc2 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-06 11:56:12,480 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/.tmp/family1/3ba0f04613c44c819dc3c37937d4580c 2023-03-06 11:56:12,483 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3ba0f04613c44c819dc3c37937d4580c 2023-03-06 11:56:12,874 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/.tmp/family1/2095c020e99547db9f4b244aa814389a 2023-03-06 11:56:12,877 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2095c020e99547db9f4b244aa814389a 2023-03-06 11:56:13,271 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/.tmp/family1/43ecdd22c9ba4cca8eaae129cf951c67 2023-03-06 11:56:13,275 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 43ecdd22c9ba4cca8eaae129cf951c67 2023-03-06 11:56:13,286 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/.tmp/family2/6707ee2dfc9f4f73a9ca0983cc08dc9b 2023-03-06 11:56:13,289 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6707ee2dfc9f4f73a9ca0983cc08dc9b 2023-03-06 11:56:13,290 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/.tmp/family1/2095c020e99547db9f4b244aa814389a as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/family1/2095c020e99547db9f4b244aa814389a 2023-03-06 11:56:13,292 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2095c020e99547db9f4b244aa814389a 2023-03-06 11:56:13,292 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/family1/2095c020e99547db9f4b244aa814389a, entries=3, sequenceid=23, filesize=5.0 K 2023-03-06 11:56:13,293 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/.tmp/family2/6707ee2dfc9f4f73a9ca0983cc08dc9b as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/family2/6707ee2dfc9f4f73a9ca0983cc08dc9b 2023-03-06 11:56:13,295 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/.tmp/family2/ecd652937aeb4bec828766018668019a 2023-03-06 11:56:13,296 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6707ee2dfc9f4f73a9ca0983cc08dc9b 2023-03-06 11:56:13,296 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/family2/6707ee2dfc9f4f73a9ca0983cc08dc9b, entries=1, sequenceid=23, filesize=5.0 K 2023-03-06 11:56:13,297 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 9423a74245608132f818a8fcb1dc4ed6 in 852ms, sequenceid=23, compaction requested=true 2023-03-06 11:56:13,297 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 9423a74245608132f818a8fcb1dc4ed6: 2023-03-06 11:56:13,297 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1678103763522.9423a74245608132f818a8fcb1dc4ed6. 2023-03-06 11:56:13,297 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-06 11:56:13,298 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ecd652937aeb4bec828766018668019a 2023-03-06 11:56:13,298 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/.tmp/family1/3ba0f04613c44c819dc3c37937d4580c as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/family1/3ba0f04613c44c819dc3c37937d4580c 2023-03-06 11:56:13,301 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3ba0f04613c44c819dc3c37937d4580c 2023-03-06 11:56:13,301 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/family1/3ba0f04613c44c819dc3c37937d4580c, entries=3, sequenceid=23, filesize=5.0 K 2023-03-06 11:56:13,302 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/.tmp/family2/ecd652937aeb4bec828766018668019a as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/family2/ecd652937aeb4bec828766018668019a 2023-03-06 11:56:13,305 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ecd652937aeb4bec828766018668019a 2023-03-06 11:56:13,305 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/family2/ecd652937aeb4bec828766018668019a, entries=1, sequenceid=23, filesize=5.0 K 2023-03-06 11:56:13,306 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 19a0eec34378d881af15151889d2e890 in 861ms, sequenceid=23, compaction requested=true 2023-03-06 11:56:13,306 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 19a0eec34378d881af15151889d2e890: 2023-03-06 11:56:13,306 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1678103763522.19a0eec34378d881af15151889d2e890. 2023-03-06 11:56:13,306 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-06 11:56:14,086 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/.tmp/family2/2dcb5cffbe7942059043ced6de23c194 2023-03-06 11:56:14,090 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2dcb5cffbe7942059043ced6de23c194 2023-03-06 11:56:14,090 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/.tmp/family1/43ecdd22c9ba4cca8eaae129cf951c67 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/family1/43ecdd22c9ba4cca8eaae129cf951c67 2023-03-06 11:56:14,093 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 43ecdd22c9ba4cca8eaae129cf951c67 2023-03-06 11:56:14,093 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/family1/43ecdd22c9ba4cca8eaae129cf951c67, entries=3, sequenceid=23, filesize=5.0 K 2023-03-06 11:56:14,094 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/.tmp/family2/2dcb5cffbe7942059043ced6de23c194 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/family2/2dcb5cffbe7942059043ced6de23c194 2023-03-06 11:56:14,097 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2dcb5cffbe7942059043ced6de23c194 2023-03-06 11:56:14,097 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/family2/2dcb5cffbe7942059043ced6de23c194, entries=1, sequenceid=23, filesize=5.0 K 2023-03-06 11:56:14,098 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 1bf4d18e651e20acc78c321164b94cc2 in 1653ms, sequenceid=23, compaction requested=true 2023-03-06 11:56:14,098 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 1bf4d18e651e20acc78c321164b94cc2: 2023-03-06 11:56:14,098 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1678103763522.1bf4d18e651e20acc78c321164b94cc2. 2023-03-06 11:56:14,098 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-06 11:56:14,098 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-06 11:56:14,098 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:14,098 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-03-06 11:56:14,098 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-03-06 11:56:14,099 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-06 11:56:14,099 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:14,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:14,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:56:14,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:56:14,100 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-06 11:56:14,100 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:56:14,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:56:14,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:56:14,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-06 11:56:14,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:14,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:56:14,101 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-03-06 11:56:14,101 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@42121420[Count = 0] remaining members to acquire global barrier 2023-03-06 11:56:14,101 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-03-06 11:56:14,101 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-06 11:56:14,102 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-06 11:56:14,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-06 11:56:14,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-06 11:56:14,102 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-03-06 11:56:14,102 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-03-06 11:56:14,102 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:56:14,102 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:14,102 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:56:14,103 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:14,103 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-03-06 11:56:14,103 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:56:14,103 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-03-06 11:56:14,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:14,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:56:14,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:56:14,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:56:14,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:56:14,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-06 11:56:14,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:14,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:56:14,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-06 11:56:14,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:14,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:56:14,106 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-03-06 11:56:14,106 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-03-06 11:56:14,106 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:56:14,106 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:56:14,106 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-03-06 11:56:14,106 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:56:14,116 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-06 11:56:14,116 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-06 11:56:14,116 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:56:14,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-06 11:56:14,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:56:14,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:56:14,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-06 11:56:14,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-06 11:56:14,116 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:14,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:56:14,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:56:14,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:56:14,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-06 11:56:14,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-06 11:56:14,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:56:14,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-06 11:56:14,117 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:14,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:14,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:56:14,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-06 11:56:14,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:14,119 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:14,119 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-06 11:56:14,120 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-06 11:56:14,120 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:14,120 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:56:14,120 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-03-06 11:56:14,120 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:56:14,120 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-06 11:56:14,120 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:56:14,120 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-06 11:56:14,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:56:14,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:56:14,120 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:56:14,120 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-03-06 11:56:14,120 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-06 11:56:14,120 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:56:14,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:56:14,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:56:14,220 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:56:14,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:56:14,221 DEBUG [Listener at localhost/46717] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-06 11:56:14,222 DEBUG [Listener at localhost/46717] regionserver.HStore(1912): 19a0eec34378d881af15151889d2e890/family1 is initiating major compaction (all files) 2023-03-06 11:56:14,222 INFO [Listener at localhost/46717] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-06 11:56:14,222 INFO [Listener at localhost/46717] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-06 11:56:14,222 INFO [Listener at localhost/46717] regionserver.HRegion(2259): Starting compaction of 19a0eec34378d881af15151889d2e890/family1 in ns:testMinorCompaction,,1678103763522.19a0eec34378d881af15151889d2e890. 2023-03-06 11:56:14,222 INFO [Listener at localhost/46717] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/family1/7542e3c0e4d443d5addbdf8e03be31a6, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/family1/b19e550098284a39bcafcedf39ecd24d, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/family1/0e54cd94c4654acfb93659ae683e7dd8, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/family1/0fd06864f4344e94b651d6e313cc2ed5, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/family1/3ba0f04613c44c819dc3c37937d4580c] into tmpdir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/.tmp, totalSize=26.6 K 2023-03-06 11:56:14,223 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting 7542e3c0e4d443d5addbdf8e03be31a6, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678103765635 2023-03-06 11:56:14,223 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting b19e550098284a39bcafcedf39ecd24d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678103767015 2023-03-06 11:56:14,223 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting 0e54cd94c4654acfb93659ae683e7dd8, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678103768808 2023-03-06 11:56:14,224 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting 0fd06864f4344e94b651d6e313cc2ed5, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678103770599 2023-03-06 11:56:14,224 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting 3ba0f04613c44c819dc3c37937d4580c, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-06 11:56:14,234 INFO [Listener at localhost/46717] throttle.PressureAwareThroughputController(145): 19a0eec34378d881af15151889d2e890#family1#compaction#149 average throughput is 0.41 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-06 11:56:14,642 INFO [Listener at localhost/46717] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202303067f9a1f16eea24314ba9d5a66d6c85902_del 2023-03-06 11:56:14,642 INFO [Listener at localhost/46717] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303067f9a1f16eea24314ba9d5a66d6c85902_del to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202303067f9a1f16eea24314ba9d5a66d6c85902_del 2023-03-06 11:56:14,810 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-06 11:56:14,810 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6f8fe831 to 127.0.0.1:62659 2023-03-06 11:56:14,810 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-06 11:56:14,811 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-06 11:56:14,811 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3eac4e78 to 127.0.0.1:62659 2023-03-06 11:56:14,811 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-06 11:56:15,454 INFO [Listener at localhost/46717] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0f255ef98a904d1cb60f1fb9f13570e5 2023-03-06 11:56:15,455 DEBUG [Listener at localhost/46717] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/.tmp/family1/0f255ef98a904d1cb60f1fb9f13570e5 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/family1/0f255ef98a904d1cb60f1fb9f13570e5 2023-03-06 11:56:15,458 INFO [Listener at localhost/46717] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0f255ef98a904d1cb60f1fb9f13570e5 2023-03-06 11:56:15,459 INFO [Listener at localhost/46717] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 19a0eec34378d881af15151889d2e890/family1 of 19a0eec34378d881af15151889d2e890 into 0f255ef98a904d1cb60f1fb9f13570e5(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-06 11:56:15,459 DEBUG [Listener at localhost/46717] regionserver.HRegion(2289): Compaction status journal for 19a0eec34378d881af15151889d2e890: 2023-03-06 11:56:15,460 DEBUG [Listener at localhost/46717] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-06 11:56:15,460 DEBUG [Listener at localhost/46717] regionserver.HStore(1912): 19a0eec34378d881af15151889d2e890/family2 is initiating major compaction (all files) 2023-03-06 11:56:15,460 INFO [Listener at localhost/46717] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-06 11:56:15,460 INFO [Listener at localhost/46717] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-06 11:56:15,461 INFO [Listener at localhost/46717] regionserver.HRegion(2259): Starting compaction of 19a0eec34378d881af15151889d2e890/family2 in ns:testMinorCompaction,,1678103763522.19a0eec34378d881af15151889d2e890. 2023-03-06 11:56:15,461 INFO [Listener at localhost/46717] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/family2/025c94843cbd4537886620f83a825814, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/family2/fff1350797d6482eaec4be93c5fcfb45, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/family2/1c8275b6de444eb796424a553c3bcbfd, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/family2/820f842e1b614edfa595c4024a68cadd, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/family2/ecd652937aeb4bec828766018668019a] into tmpdir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/.tmp, totalSize=25.3 K 2023-03-06 11:56:15,461 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting 025c94843cbd4537886620f83a825814, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678103765635 2023-03-06 11:56:15,461 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting fff1350797d6482eaec4be93c5fcfb45, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678103767015 2023-03-06 11:56:15,462 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting 1c8275b6de444eb796424a553c3bcbfd, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678103768808 2023-03-06 11:56:15,462 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting 820f842e1b614edfa595c4024a68cadd, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678103770599 2023-03-06 11:56:15,462 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting ecd652937aeb4bec828766018668019a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-06 11:56:15,469 INFO [Listener at localhost/46717] throttle.PressureAwareThroughputController(145): 19a0eec34378d881af15151889d2e890#family2#compaction#150 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-06 11:56:15,503 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/family1/7542e3c0e4d443d5addbdf8e03be31a6, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/family1/b19e550098284a39bcafcedf39ecd24d, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/family1/0e54cd94c4654acfb93659ae683e7dd8, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/family1/0fd06864f4344e94b651d6e313cc2ed5, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/family1/3ba0f04613c44c819dc3c37937d4580c] to archive 2023-03-06 11:56:15,503 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:56:15,505 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/family1/7542e3c0e4d443d5addbdf8e03be31a6 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/family1/7542e3c0e4d443d5addbdf8e03be31a6 2023-03-06 11:56:15,506 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/family1/b19e550098284a39bcafcedf39ecd24d to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/family1/b19e550098284a39bcafcedf39ecd24d 2023-03-06 11:56:15,506 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/family1/0e54cd94c4654acfb93659ae683e7dd8 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/family1/0e54cd94c4654acfb93659ae683e7dd8 2023-03-06 11:56:15,507 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/family1/0fd06864f4344e94b651d6e313cc2ed5 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/family1/0fd06864f4344e94b651d6e313cc2ed5 2023-03-06 11:56:15,508 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/family1/3ba0f04613c44c819dc3c37937d4580c to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/family1/3ba0f04613c44c819dc3c37937d4580c 2023-03-06 11:56:15,877 INFO [Listener at localhost/46717] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230306f4ea385012d14cf4b9b6c00ed9b3bae4_del 2023-03-06 11:56:15,877 INFO [Listener at localhost/46717] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230306f4ea385012d14cf4b9b6c00ed9b3bae4_del to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230306f4ea385012d14cf4b9b6c00ed9b3bae4_del 2023-03-06 11:56:16,690 INFO [Listener at localhost/46717] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2e6fb6e492c9444998f2e0cfabea39f3 2023-03-06 11:56:16,691 DEBUG [Listener at localhost/46717] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/.tmp/family2/2e6fb6e492c9444998f2e0cfabea39f3 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/family2/2e6fb6e492c9444998f2e0cfabea39f3 2023-03-06 11:56:16,694 INFO [Listener at localhost/46717] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2e6fb6e492c9444998f2e0cfabea39f3 2023-03-06 11:56:16,694 INFO [Listener at localhost/46717] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 19a0eec34378d881af15151889d2e890/family2 of 19a0eec34378d881af15151889d2e890 into 2e6fb6e492c9444998f2e0cfabea39f3(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-06 11:56:16,695 DEBUG [Listener at localhost/46717] regionserver.HRegion(2289): Compaction status journal for 19a0eec34378d881af15151889d2e890: 2023-03-06 11:56:16,695 DEBUG [Listener at localhost/46717] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-06 11:56:16,695 DEBUG [Listener at localhost/46717] regionserver.HStore(1912): 9423a74245608132f818a8fcb1dc4ed6/family1 is initiating major compaction (all files) 2023-03-06 11:56:16,695 INFO [Listener at localhost/46717] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-06 11:56:16,695 INFO [Listener at localhost/46717] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-06 11:56:16,695 INFO [Listener at localhost/46717] regionserver.HRegion(2259): Starting compaction of 9423a74245608132f818a8fcb1dc4ed6/family1 in ns:testMinorCompaction,2,1678103763522.9423a74245608132f818a8fcb1dc4ed6. 2023-03-06 11:56:16,695 INFO [Listener at localhost/46717] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/family1/bb023f11a31045108db4e42c0dce2e23, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/family1/84a113362beb470e8270dfdbbedd6fe0, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/family1/e40205f642754ae5a4d27ee18463560e, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/family1/d4a22a2bce154e9480c2d262b3a670b4, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/family1/2095c020e99547db9f4b244aa814389a] into tmpdir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/.tmp, totalSize=26.6 K 2023-03-06 11:56:16,695 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting bb023f11a31045108db4e42c0dce2e23, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678103765635 2023-03-06 11:56:16,696 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting 84a113362beb470e8270dfdbbedd6fe0, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678103767015 2023-03-06 11:56:16,696 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting e40205f642754ae5a4d27ee18463560e, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678103768808 2023-03-06 11:56:16,696 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting d4a22a2bce154e9480c2d262b3a670b4, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678103770599 2023-03-06 11:56:16,696 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting 2095c020e99547db9f4b244aa814389a, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-06 11:56:16,699 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/family2/025c94843cbd4537886620f83a825814, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/family2/fff1350797d6482eaec4be93c5fcfb45, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/family2/1c8275b6de444eb796424a553c3bcbfd, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/family2/820f842e1b614edfa595c4024a68cadd, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/family2/ecd652937aeb4bec828766018668019a] to archive 2023-03-06 11:56:16,700 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:56:16,701 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/family2/025c94843cbd4537886620f83a825814 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/family2/025c94843cbd4537886620f83a825814 2023-03-06 11:56:16,702 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/family2/fff1350797d6482eaec4be93c5fcfb45 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/family2/fff1350797d6482eaec4be93c5fcfb45 2023-03-06 11:56:16,703 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/family2/1c8275b6de444eb796424a553c3bcbfd to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/family2/1c8275b6de444eb796424a553c3bcbfd 2023-03-06 11:56:16,704 INFO [Listener at localhost/46717] throttle.PressureAwareThroughputController(145): 9423a74245608132f818a8fcb1dc4ed6#family1#compaction#151 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-06 11:56:16,704 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/family2/820f842e1b614edfa595c4024a68cadd to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/family2/820f842e1b614edfa595c4024a68cadd 2023-03-06 11:56:16,706 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/family2/ecd652937aeb4bec828766018668019a to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/family2/ecd652937aeb4bec828766018668019a 2023-03-06 11:56:17,112 INFO [Listener at localhost/46717] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023030685ca0f36e9c14172958cc30e51cac7df_del 2023-03-06 11:56:17,112 INFO [Listener at localhost/46717] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023030685ca0f36e9c14172958cc30e51cac7df_del to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023030685ca0f36e9c14172958cc30e51cac7df_del 2023-03-06 11:56:17,925 INFO [Listener at localhost/46717] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9026defb273a4de89df4aa866dea0b0e 2023-03-06 11:56:17,926 DEBUG [Listener at localhost/46717] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/.tmp/family1/9026defb273a4de89df4aa866dea0b0e as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/family1/9026defb273a4de89df4aa866dea0b0e 2023-03-06 11:56:17,929 INFO [Listener at localhost/46717] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9026defb273a4de89df4aa866dea0b0e 2023-03-06 11:56:17,930 INFO [Listener at localhost/46717] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 9423a74245608132f818a8fcb1dc4ed6/family1 of 9423a74245608132f818a8fcb1dc4ed6 into 9026defb273a4de89df4aa866dea0b0e(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-06 11:56:17,930 DEBUG [Listener at localhost/46717] regionserver.HRegion(2289): Compaction status journal for 9423a74245608132f818a8fcb1dc4ed6: 2023-03-06 11:56:17,930 DEBUG [Listener at localhost/46717] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-06 11:56:17,930 DEBUG [Listener at localhost/46717] regionserver.HStore(1912): 9423a74245608132f818a8fcb1dc4ed6/family2 is initiating major compaction (all files) 2023-03-06 11:56:17,931 INFO [Listener at localhost/46717] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-06 11:56:17,931 INFO [Listener at localhost/46717] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-06 11:56:17,931 INFO [Listener at localhost/46717] regionserver.HRegion(2259): Starting compaction of 9423a74245608132f818a8fcb1dc4ed6/family2 in ns:testMinorCompaction,2,1678103763522.9423a74245608132f818a8fcb1dc4ed6. 2023-03-06 11:56:17,932 INFO [Listener at localhost/46717] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/family2/e392278c5f7941d78ff2fe4b53cdec65, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/family2/f4ede7bebe3846b08e7a8c1da12066a1, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/family2/a68fa6401ae9416dbaaa664fede4a54b, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/family2/bd59905140ff4e208671a52faebaacff, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/family2/6707ee2dfc9f4f73a9ca0983cc08dc9b] into tmpdir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/.tmp, totalSize=25.3 K 2023-03-06 11:56:17,932 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting e392278c5f7941d78ff2fe4b53cdec65, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678103765635 2023-03-06 11:56:17,932 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting f4ede7bebe3846b08e7a8c1da12066a1, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678103767015 2023-03-06 11:56:17,933 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting a68fa6401ae9416dbaaa664fede4a54b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678103768808 2023-03-06 11:56:17,933 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting bd59905140ff4e208671a52faebaacff, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678103770599 2023-03-06 11:56:17,933 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting 6707ee2dfc9f4f73a9ca0983cc08dc9b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-06 11:56:17,941 INFO [Listener at localhost/46717] throttle.PressureAwareThroughputController(145): 9423a74245608132f818a8fcb1dc4ed6#family2#compaction#152 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-06 11:56:18,003 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/family1/bb023f11a31045108db4e42c0dce2e23, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/family1/84a113362beb470e8270dfdbbedd6fe0, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/family1/e40205f642754ae5a4d27ee18463560e, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/family1/d4a22a2bce154e9480c2d262b3a670b4, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/family1/2095c020e99547db9f4b244aa814389a] to archive 2023-03-06 11:56:18,004 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:56:18,006 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/family1/bb023f11a31045108db4e42c0dce2e23 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/family1/bb023f11a31045108db4e42c0dce2e23 2023-03-06 11:56:18,007 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/family1/84a113362beb470e8270dfdbbedd6fe0 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/family1/84a113362beb470e8270dfdbbedd6fe0 2023-03-06 11:56:18,008 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/family1/e40205f642754ae5a4d27ee18463560e to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/family1/e40205f642754ae5a4d27ee18463560e 2023-03-06 11:56:18,008 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/family1/d4a22a2bce154e9480c2d262b3a670b4 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/family1/d4a22a2bce154e9480c2d262b3a670b4 2023-03-06 11:56:18,009 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/family1/2095c020e99547db9f4b244aa814389a to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/family1/2095c020e99547db9f4b244aa814389a 2023-03-06 11:56:18,349 INFO [Listener at localhost/46717] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230306b3663d63c0c247488e306b3ede6feecb_del 2023-03-06 11:56:18,349 INFO [Listener at localhost/46717] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230306b3663d63c0c247488e306b3ede6feecb_del to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230306b3663d63c0c247488e306b3ede6feecb_del 2023-03-06 11:56:19,162 INFO [Listener at localhost/46717] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3535fa49770b43a396777b01ce5c1144 2023-03-06 11:56:19,163 DEBUG [Listener at localhost/46717] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/.tmp/family2/3535fa49770b43a396777b01ce5c1144 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/family2/3535fa49770b43a396777b01ce5c1144 2023-03-06 11:56:19,166 INFO [Listener at localhost/46717] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3535fa49770b43a396777b01ce5c1144 2023-03-06 11:56:19,166 INFO [Listener at localhost/46717] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 9423a74245608132f818a8fcb1dc4ed6/family2 of 9423a74245608132f818a8fcb1dc4ed6 into 3535fa49770b43a396777b01ce5c1144(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-06 11:56:19,167 DEBUG [Listener at localhost/46717] regionserver.HRegion(2289): Compaction status journal for 9423a74245608132f818a8fcb1dc4ed6: 2023-03-06 11:56:19,167 DEBUG [Listener at localhost/46717] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-06 11:56:19,167 DEBUG [Listener at localhost/46717] regionserver.HStore(1912): 1bf4d18e651e20acc78c321164b94cc2/family1 is initiating major compaction (all files) 2023-03-06 11:56:19,167 INFO [Listener at localhost/46717] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-06 11:56:19,167 INFO [Listener at localhost/46717] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-06 11:56:19,168 INFO [Listener at localhost/46717] regionserver.HRegion(2259): Starting compaction of 1bf4d18e651e20acc78c321164b94cc2/family1 in ns:testMinorCompaction,1,1678103763522.1bf4d18e651e20acc78c321164b94cc2. 2023-03-06 11:56:19,168 INFO [Listener at localhost/46717] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/family1/7351f908791748dcade61fb0d9b82aef, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/family1/5669d1f2ffa2401ebdcf91dfd9ec5852, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/family1/a65b5a183b1f43cdad6236245579906c, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/family1/329c4c7b073940fbaf5ebbd2862e0adb, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/family1/43ecdd22c9ba4cca8eaae129cf951c67] into tmpdir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/.tmp, totalSize=26.6 K 2023-03-06 11:56:19,168 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting 7351f908791748dcade61fb0d9b82aef, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678103765635 2023-03-06 11:56:19,168 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting 5669d1f2ffa2401ebdcf91dfd9ec5852, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678103767015 2023-03-06 11:56:19,169 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting a65b5a183b1f43cdad6236245579906c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678103768808 2023-03-06 11:56:19,169 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting 329c4c7b073940fbaf5ebbd2862e0adb, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678103770599 2023-03-06 11:56:19,169 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting 43ecdd22c9ba4cca8eaae129cf951c67, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-06 11:56:19,176 INFO [Listener at localhost/46717] throttle.PressureAwareThroughputController(145): 1bf4d18e651e20acc78c321164b94cc2#family1#compaction#153 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-06 11:56:19,199 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/family2/e392278c5f7941d78ff2fe4b53cdec65, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/family2/f4ede7bebe3846b08e7a8c1da12066a1, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/family2/a68fa6401ae9416dbaaa664fede4a54b, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/family2/bd59905140ff4e208671a52faebaacff, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/family2/6707ee2dfc9f4f73a9ca0983cc08dc9b] to archive 2023-03-06 11:56:19,200 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:56:19,201 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/family2/e392278c5f7941d78ff2fe4b53cdec65 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/family2/e392278c5f7941d78ff2fe4b53cdec65 2023-03-06 11:56:19,202 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/family2/f4ede7bebe3846b08e7a8c1da12066a1 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/family2/f4ede7bebe3846b08e7a8c1da12066a1 2023-03-06 11:56:19,203 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/family2/a68fa6401ae9416dbaaa664fede4a54b to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/family2/a68fa6401ae9416dbaaa664fede4a54b 2023-03-06 11:56:19,204 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/family2/bd59905140ff4e208671a52faebaacff to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/family2/bd59905140ff4e208671a52faebaacff 2023-03-06 11:56:19,205 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/family2/6707ee2dfc9f4f73a9ca0983cc08dc9b to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/family2/6707ee2dfc9f4f73a9ca0983cc08dc9b 2023-03-06 11:56:19,585 INFO [Listener at localhost/46717] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202303069c94b205a3be4f4daec0bb6a7219c769_del 2023-03-06 11:56:19,585 INFO [Listener at localhost/46717] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303069c94b205a3be4f4daec0bb6a7219c769_del to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202303069c94b205a3be4f4daec0bb6a7219c769_del 2023-03-06 11:56:20,398 INFO [Listener at localhost/46717] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 08e67b3e05c24371970dbf4bd89d9463 2023-03-06 11:56:20,398 DEBUG [Listener at localhost/46717] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/.tmp/family1/08e67b3e05c24371970dbf4bd89d9463 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/family1/08e67b3e05c24371970dbf4bd89d9463 2023-03-06 11:56:20,401 INFO [Listener at localhost/46717] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 08e67b3e05c24371970dbf4bd89d9463 2023-03-06 11:56:20,402 INFO [Listener at localhost/46717] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 1bf4d18e651e20acc78c321164b94cc2/family1 of 1bf4d18e651e20acc78c321164b94cc2 into 08e67b3e05c24371970dbf4bd89d9463(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-06 11:56:20,402 DEBUG [Listener at localhost/46717] regionserver.HRegion(2289): Compaction status journal for 1bf4d18e651e20acc78c321164b94cc2: 2023-03-06 11:56:20,403 DEBUG [Listener at localhost/46717] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-06 11:56:20,403 DEBUG [Listener at localhost/46717] regionserver.HStore(1912): 1bf4d18e651e20acc78c321164b94cc2/family2 is initiating major compaction (all files) 2023-03-06 11:56:20,403 INFO [Listener at localhost/46717] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-06 11:56:20,403 INFO [Listener at localhost/46717] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-06 11:56:20,403 INFO [Listener at localhost/46717] regionserver.HRegion(2259): Starting compaction of 1bf4d18e651e20acc78c321164b94cc2/family2 in ns:testMinorCompaction,1,1678103763522.1bf4d18e651e20acc78c321164b94cc2. 2023-03-06 11:56:20,404 INFO [Listener at localhost/46717] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/family2/addd393b24654cbbb3a3a4a8a5f815dc, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/family2/a7c229268df44783a87cb0dade9ff03c, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/family2/dcdc54a5a7c2461f9b47198c9feeba73, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/family2/8bdb67ef99df449584c0b3df661e32d8, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/family2/2dcb5cffbe7942059043ced6de23c194] into tmpdir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/.tmp, totalSize=25.3 K 2023-03-06 11:56:20,404 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting addd393b24654cbbb3a3a4a8a5f815dc, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678103765635 2023-03-06 11:56:20,404 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting a7c229268df44783a87cb0dade9ff03c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678103767015 2023-03-06 11:56:20,404 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting dcdc54a5a7c2461f9b47198c9feeba73, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678103768808 2023-03-06 11:56:20,405 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting 8bdb67ef99df449584c0b3df661e32d8, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678103770599 2023-03-06 11:56:20,405 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting 2dcb5cffbe7942059043ced6de23c194, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-06 11:56:20,413 INFO [Listener at localhost/46717] throttle.PressureAwareThroughputController(145): 1bf4d18e651e20acc78c321164b94cc2#family2#compaction#154 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-06 11:56:20,499 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/family1/7351f908791748dcade61fb0d9b82aef, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/family1/5669d1f2ffa2401ebdcf91dfd9ec5852, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/family1/a65b5a183b1f43cdad6236245579906c, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/family1/329c4c7b073940fbaf5ebbd2862e0adb, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/family1/43ecdd22c9ba4cca8eaae129cf951c67] to archive 2023-03-06 11:56:20,500 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:56:20,502 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/family1/7351f908791748dcade61fb0d9b82aef to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/family1/7351f908791748dcade61fb0d9b82aef 2023-03-06 11:56:20,503 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/family1/5669d1f2ffa2401ebdcf91dfd9ec5852 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/family1/5669d1f2ffa2401ebdcf91dfd9ec5852 2023-03-06 11:56:20,505 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/family1/a65b5a183b1f43cdad6236245579906c to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/family1/a65b5a183b1f43cdad6236245579906c 2023-03-06 11:56:20,506 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/family1/329c4c7b073940fbaf5ebbd2862e0adb to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/family1/329c4c7b073940fbaf5ebbd2862e0adb 2023-03-06 11:56:20,508 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/family1/43ecdd22c9ba4cca8eaae129cf951c67 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/family1/43ecdd22c9ba4cca8eaae129cf951c67 2023-03-06 11:56:20,820 INFO [Listener at localhost/46717] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202303061cb5f896968d42ccbeefe77bc50a98f2_del 2023-03-06 11:56:20,820 INFO [Listener at localhost/46717] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303061cb5f896968d42ccbeefe77bc50a98f2_del to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202303061cb5f896968d42ccbeefe77bc50a98f2_del 2023-03-06 11:56:21,634 INFO [Listener at localhost/46717] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 585b4127a6134c8bb320c297a7fbd67a 2023-03-06 11:56:21,635 DEBUG [Listener at localhost/46717] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/.tmp/family2/585b4127a6134c8bb320c297a7fbd67a as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/family2/585b4127a6134c8bb320c297a7fbd67a 2023-03-06 11:56:21,638 INFO [Listener at localhost/46717] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 585b4127a6134c8bb320c297a7fbd67a 2023-03-06 11:56:21,639 INFO [Listener at localhost/46717] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 1bf4d18e651e20acc78c321164b94cc2/family2 of 1bf4d18e651e20acc78c321164b94cc2 into 585b4127a6134c8bb320c297a7fbd67a(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-06 11:56:21,639 DEBUG [Listener at localhost/46717] regionserver.HRegion(2289): Compaction status journal for 1bf4d18e651e20acc78c321164b94cc2: 2023-03-06 11:56:21,643 DEBUG [Listener at localhost/46717] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-06 11:56:21,645 DEBUG [Listener at localhost/46717] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-06 11:56:21,649 DEBUG [Listener at localhost/46717] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-06 11:56:21,650 DEBUG [Listener at localhost/46717] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-06 11:56:21,655 INFO [Listener at localhost/46717] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-06 11:56:21,670 INFO [Listener at localhost/46717] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 3 del files, 3 selected files, and 0 irrelevant files table 'ns:testMinorCompaction' and column 'family1' 2023-03-06 11:56:21,673 INFO [Listener at localhost/46717] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202303067f9a1f16eea24314ba9d5a66d6c85902_del 2023-03-06 11:56:21,676 INFO [Listener at localhost/46717] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202303069c94b205a3be4f4daec0bb6a7219c769_del 2023-03-06 11:56:21,679 INFO [Listener at localhost/46717] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023030685ca0f36e9c14172958cc30e51cac7df_del 2023-03-06 11:56:21,679 INFO [Listener at localhost/46717] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='ns:testMinorCompaction' column='family1' 2023-03-06 11:56:21,679 DEBUG [Listener at localhost/46717] zookeeper.ReadOnlyZKClient(139): Connect 0x2c3f2136 to 127.0.0.1:62659 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-06 11:56:21,689 DEBUG [Listener at localhost/46717] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3215ecc8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-06 11:56:21,690 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230306 for table='ns:testMinorCompaction' and column='family1' 2023-03-06 11:56:21,690 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230306 for table='ns:testMinorCompaction' and column='family1' 2023-03-06 11:56:21,690 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230306 for table='ns:testMinorCompaction' and column='family1' 2023-03-06 11:56:21,706 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/family2/addd393b24654cbbb3a3a4a8a5f815dc, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/family2/a7c229268df44783a87cb0dade9ff03c, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/family2/dcdc54a5a7c2461f9b47198c9feeba73, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/family2/8bdb67ef99df449584c0b3df661e32d8, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/family2/2dcb5cffbe7942059043ced6de23c194] to archive 2023-03-06 11:56:21,707 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:56:21,708 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/family2/addd393b24654cbbb3a3a4a8a5f815dc to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/family2/addd393b24654cbbb3a3a4a8a5f815dc 2023-03-06 11:56:21,710 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/family2/a7c229268df44783a87cb0dade9ff03c to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/family2/a7c229268df44783a87cb0dade9ff03c 2023-03-06 11:56:21,712 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/family2/dcdc54a5a7c2461f9b47198c9feeba73 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/family2/dcdc54a5a7c2461f9b47198c9feeba73 2023-03-06 11:56:21,713 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/family2/8bdb67ef99df449584c0b3df661e32d8 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/family2/8bdb67ef99df449584c0b3df661e32d8 2023-03-06 11:56:21,715 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/family2/2dcb5cffbe7942059043ced6de23c194 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/family2/2dcb5cffbe7942059043ced6de23c194 2023-03-06 11:56:22,151 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230306ccd32d0b295a4b9fa27d337d4968baed to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230306ccd32d0b295a4b9fa27d337d4968baed 2023-03-06 11:56:22,152 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230306 table='ns:testMinorCompaction' column='family1' 2023-03-06 11:56:22,154 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303065340aaf19dc5470c8c6c2966d4cf5b74 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202303065340aaf19dc5470c8c6c2966d4cf5b74 2023-03-06 11:56:22,154 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230306 table='ns:testMinorCompaction' column='family1' 2023-03-06 11:56:22,165 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-06 11:56:22,168 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:51934, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-06 11:56:22,173 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-06 11:56:22,176 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:37566, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-06 11:56:22,188 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230306/family1/c11eff05ca274e0ba12394acec177bc3 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x01] 2023-03-06 11:56:22,188 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=ns:testMinorCompaction,,1678103763522.19a0eec34378d881af15151889d2e890., hostname=jenkins-hbase5.apache.org,42547,1678103642479, seqNum=2 for row with hfile group [{family1,hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230306/family1/c11eff05ca274e0ba12394acec177bc3}] 2023-03-06 11:56:22,190 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230306/family1/0eabf9b4bea2482d8c42c64a579f954f first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x01] 2023-03-06 11:56:22,191 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=ns:testMinorCompaction,1,1678103763522.1bf4d18e651e20acc78c321164b94cc2., hostname=jenkins-hbase5.apache.org,42547,1678103642479, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230306/family1/0eabf9b4bea2482d8c42c64a579f954f}] 2023-03-06 11:56:22,201 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(763): Validating hfile at hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230306/family1/c11eff05ca274e0ba12394acec177bc3 for inclusion in 19a0eec34378d881af15151889d2e890/family1 2023-03-06 11:56:22,202 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42547] regionserver.HStore(763): Validating hfile at hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230306/family1/0eabf9b4bea2482d8c42c64a579f954f for inclusion in 1bf4d18e651e20acc78c321164b94cc2/family1 2023-03-06 11:56:22,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x01 2023-03-06 11:56:22,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(777): Region bounds: first= last=1 2023-03-06 11:56:22,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegion(2446): Flush status journal for 19a0eec34378d881af15151889d2e890: 2023-03-06 11:56:22,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42547] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x01 2023-03-06 11:56:22,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42547] regionserver.HStore(777): Region bounds: first=1 last=2 2023-03-06 11:56:22,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42547] regionserver.HRegion(2446): Flush status journal for 1bf4d18e651e20acc78c321164b94cc2: 2023-03-06 11:56:22,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230306/family1/c11eff05ca274e0ba12394acec177bc3 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__ns_testMinorCompaction__c6j7od845erod8o6e66787blbmke71bd2856vlnifm23i54m8hd0v9hen3i75rdr/family1/c11eff05ca274e0ba12394acec177bc3 2023-03-06 11:56:22,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42547] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230306/family1/0eabf9b4bea2482d8c42c64a579f954f to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__ns_testMinorCompaction__cogkhfagom0csov28ujhgb9f2sc61j2qdab9st55gp0uhtr1td6i1vptbr67lfaf/family1/0eabf9b4bea2482d8c42c64a579f954f 2023-03-06 11:56:22,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__ns_testMinorCompaction__c6j7od845erod8o6e66787blbmke71bd2856vlnifm23i54m8hd0v9hen3i75rdr/family1/c11eff05ca274e0ba12394acec177bc3 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/family1/451fad614e4d4ef1b28f95324bcca9d1_SeqId_28_ 2023-03-06 11:56:22,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42547] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__ns_testMinorCompaction__cogkhfagom0csov28ujhgb9f2sc61j2qdab9st55gp0uhtr1td6i1vptbr67lfaf/family1/0eabf9b4bea2482d8c42c64a579f954f as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/family1/4082d09b1f1b4fe4b0069754943812a5_SeqId_28_ 2023-03-06 11:56:22,207 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(849): Loaded HFile hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__ns_testMinorCompaction__c6j7od845erod8o6e66787blbmke71bd2856vlnifm23i54m8hd0v9hen3i75rdr/family1/c11eff05ca274e0ba12394acec177bc3 into 19a0eec34378d881af15151889d2e890/family1 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/family1/451fad614e4d4ef1b28f95324bcca9d1_SeqId_28_ - updating store file list. 2023-03-06 11:56:22,207 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42547] regionserver.HStore(849): Loaded HFile hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__ns_testMinorCompaction__cogkhfagom0csov28ujhgb9f2sc61j2qdab9st55gp0uhtr1td6i1vptbr67lfaf/family1/0eabf9b4bea2482d8c42c64a579f954f into 1bf4d18e651e20acc78c321164b94cc2/family1 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/family1/4082d09b1f1b4fe4b0069754943812a5_SeqId_28_ - updating store file list. 2023-03-06 11:56:22,211 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(882): Loaded HFile hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/family1/451fad614e4d4ef1b28f95324bcca9d1_SeqId_28_ into 19a0eec34378d881af15151889d2e890/family1 2023-03-06 11:56:22,211 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(855): Successfully loaded hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__ns_testMinorCompaction__c6j7od845erod8o6e66787blbmke71bd2856vlnifm23i54m8hd0v9hen3i75rdr/family1/c11eff05ca274e0ba12394acec177bc3 into 19a0eec34378d881af15151889d2e890/family1 (new location: hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/family1/451fad614e4d4ef1b28f95324bcca9d1_SeqId_28_) 2023-03-06 11:56:22,211 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42547] regionserver.HStore(882): Loaded HFile hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/family1/4082d09b1f1b4fe4b0069754943812a5_SeqId_28_ into 1bf4d18e651e20acc78c321164b94cc2/family1 2023-03-06 11:56:22,211 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42547] regionserver.HStore(855): Successfully loaded hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__ns_testMinorCompaction__cogkhfagom0csov28ujhgb9f2sc61j2qdab9st55gp0uhtr1td6i1vptbr67lfaf/family1/0eabf9b4bea2482d8c42c64a579f954f into 1bf4d18e651e20acc78c321164b94cc2/family1 (new location: hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/family1/4082d09b1f1b4fe4b0069754943812a5_SeqId_28_) 2023-03-06 11:56:22,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__ns_testMinorCompaction__c6j7od845erod8o6e66787blbmke71bd2856vlnifm23i54m8hd0v9hen3i75rdr/family1/c11eff05ca274e0ba12394acec177bc3 2023-03-06 11:56:22,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42547] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__ns_testMinorCompaction__cogkhfagom0csov28ujhgb9f2sc61j2qdab9st55gp0uhtr1td6i1vptbr67lfaf/family1/0eabf9b4bea2482d8c42c64a579f954f 2023-03-06 11:56:22,221 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230306 table='ns:testMinorCompaction' column='family1' 2023-03-06 11:56:22,221 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230306 table='ns:testMinorCompaction' column='family1' 2023-03-06 11:56:22,221 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:56:22,221 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:56:22,223 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230306b837e935bc0149d0b7f3d34949ac216b to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230306b837e935bc0149d0b7f3d34949ac216b 2023-03-06 11:56:22,223 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230306605f04bce38c4c88beb89a6c1de513e8 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230306605f04bce38c4c88beb89a6c1de513e8 2023-03-06 11:56:22,223 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-03-06 11:56:22,223 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-03-06 11:56:22,223 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230306' 2023-03-06 11:56:22,223 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230306' 2023-03-06 11:56:22,224 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230306 for table='ns:testMinorCompaction' and column='family1' 2023-03-06 11:56:22,224 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230306 for table='ns:testMinorCompaction' and column='family1' 2023-03-06 11:56:22,550 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230306a4c3dfd6d1eb4dcb9d4e5d2fa611f028 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230306a4c3dfd6d1eb4dcb9d4e5d2fa611f028 2023-03-06 11:56:22,551 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230306 table='ns:testMinorCompaction' column='family1' 2023-03-06 11:56:22,580 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230306/family1/404f1c52514b48b1acc7ac7d7f4c8a34 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x01] 2023-03-06 11:56:22,581 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=ns:testMinorCompaction,2,1678103763522.9423a74245608132f818a8fcb1dc4ed6., hostname=jenkins-hbase5.apache.org,42547,1678103642479, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230306/family1/404f1c52514b48b1acc7ac7d7f4c8a34}] 2023-03-06 11:56:22,582 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(763): Validating hfile at hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230306/family1/404f1c52514b48b1acc7ac7d7f4c8a34 for inclusion in 9423a74245608132f818a8fcb1dc4ed6/family1 2023-03-06 11:56:22,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x01 2023-03-06 11:56:22,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(777): Region bounds: first=2 last= 2023-03-06 11:56:22,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegion(2446): Flush status journal for 9423a74245608132f818a8fcb1dc4ed6: 2023-03-06 11:56:22,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230306/family1/404f1c52514b48b1acc7ac7d7f4c8a34 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__ns_testMinorCompaction__q8rv54sls6e3pikp3hiqs1pi87d4sp1t6bvva4913vc70qvvbaig7fnjvo76e036/family1/404f1c52514b48b1acc7ac7d7f4c8a34 2023-03-06 11:56:22,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__ns_testMinorCompaction__q8rv54sls6e3pikp3hiqs1pi87d4sp1t6bvva4913vc70qvvbaig7fnjvo76e036/family1/404f1c52514b48b1acc7ac7d7f4c8a34 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/family1/5608b68f5fe84b70b868041beeea9643_SeqId_28_ 2023-03-06 11:56:22,587 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(849): Loaded HFile hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__ns_testMinorCompaction__q8rv54sls6e3pikp3hiqs1pi87d4sp1t6bvva4913vc70qvvbaig7fnjvo76e036/family1/404f1c52514b48b1acc7ac7d7f4c8a34 into 9423a74245608132f818a8fcb1dc4ed6/family1 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/family1/5608b68f5fe84b70b868041beeea9643_SeqId_28_ - updating store file list. 2023-03-06 11:56:22,589 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(882): Loaded HFile hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/family1/5608b68f5fe84b70b868041beeea9643_SeqId_28_ into 9423a74245608132f818a8fcb1dc4ed6/family1 2023-03-06 11:56:22,589 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(855): Successfully loaded hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__ns_testMinorCompaction__q8rv54sls6e3pikp3hiqs1pi87d4sp1t6bvva4913vc70qvvbaig7fnjvo76e036/family1/404f1c52514b48b1acc7ac7d7f4c8a34 into 9423a74245608132f818a8fcb1dc4ed6/family1 (new location: hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/family1/5608b68f5fe84b70b868041beeea9643_SeqId_28_) 2023-03-06 11:56:22,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__ns_testMinorCompaction__q8rv54sls6e3pikp3hiqs1pi87d4sp1t6bvva4913vc70qvvbaig7fnjvo76e036/family1/404f1c52514b48b1acc7ac7d7f4c8a34 2023-03-06 11:56:22,591 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230306 table='ns:testMinorCompaction' column='family1' 2023-03-06 11:56:22,592 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:56:22,593 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230306f0b854efc5ef416a8ed2bb1aac769ddf to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230306f0b854efc5ef416a8ed2bb1aac769ddf 2023-03-06 11:56:22,593 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-03-06 11:56:22,593 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230306' 2023-03-06 11:56:22,593 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230306 for table='ns:testMinorCompaction' and column='family1' 2023-03-06 11:56:22,593 INFO [Listener at localhost/46717] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='ns:testMinorCompaction' column='family1' 2023-03-06 11:56:22,595 DEBUG [Listener at localhost/46717] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-06 11:56:22,597 DEBUG [Listener at localhost/46717] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-06 11:56:22,599 DEBUG [Listener at localhost/46717] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-06 11:56:22,599 DEBUG [Listener at localhost/46717] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-06 11:56:22,614 INFO [Listener at localhost/46717] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompaction Thread=247 (was 281), OpenFileDescriptor=618 (was 749), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=150 (was 148) - SystemLoadAverage LEAK? -, ProcessCount=160 (was 160), AvailableMemoryMB=9538 (was 9557) 2023-03-06 11:56:22,624 INFO [Listener at localhost/46717] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=247, OpenFileDescriptor=618, MaxFileDescriptor=60000, SystemLoadAverage=150, ProcessCount=160, AvailableMemoryMB=9537 2023-03-06 11:56:22,626 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.HMaster$4(2112): Client=jenkins//172.31.10.131 create 'testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-03-06 11:56:22,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:22,628 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-03-06 11:56:22,628 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(697): Client=jenkins//172.31.10.131 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithMonthlyPolicy" procId is: 112 2023-03-06 11:56:22,629 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-06 11:56:22,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-03-06 11:56:22,630 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61 2023-03-06 11:56:22,630 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61 empty. 2023-03-06 11:56:22,631 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61 2023-03-06 11:56:22,631 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithMonthlyPolicy regions 2023-03-06 11:56:22,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-03-06 11:56:22,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-03-06 11:56:23,039 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-03-06 11:56:23,040 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 37fd6ec3f6ee6e4f1f1f2a7f528dfd61, NAME => 'testMinorCompactionWithMonthlyPolicy,,1678103782626.37fd6ec3f6ee6e4f1f1f2a7f528dfd61.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp 2023-03-06 11:56:23,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-03-06 11:56:23,445 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1678103782626.37fd6ec3f6ee6e4f1f1f2a7f528dfd61.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-06 11:56:23,445 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing 37fd6ec3f6ee6e4f1f1f2a7f528dfd61, disabling compactions & flushes 2023-03-06 11:56:23,445 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1678103782626.37fd6ec3f6ee6e4f1f1f2a7f528dfd61. 2023-03-06 11:56:23,445 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1678103782626.37fd6ec3f6ee6e4f1f1f2a7f528dfd61. 2023-03-06 11:56:23,445 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1678103782626.37fd6ec3f6ee6e4f1f1f2a7f528dfd61. after waiting 0 ms 2023-03-06 11:56:23,445 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1678103782626.37fd6ec3f6ee6e4f1f1f2a7f528dfd61. 2023-03-06 11:56:23,445 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1678103782626.37fd6ec3f6ee6e4f1f1f2a7f528dfd61. 2023-03-06 11:56:23,445 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 37fd6ec3f6ee6e4f1f1f2a7f528dfd61: 2023-03-06 11:56:23,447 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-03-06 11:56:23,448 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithMonthlyPolicy,,1678103782626.37fd6ec3f6ee6e4f1f1f2a7f528dfd61.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1678103783448"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678103783448"}]},"ts":"1678103783448"} 2023-03-06 11:56:23,449 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-06 11:56:23,450 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-06 11:56:23,450 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678103783450"}]},"ts":"1678103783450"} 2023-03-06 11:56:23,451 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-03-06 11:56:23,454 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=37fd6ec3f6ee6e4f1f1f2a7f528dfd61, ASSIGN}] 2023-03-06 11:56:23,455 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=37fd6ec3f6ee6e4f1f1f2a7f528dfd61, ASSIGN 2023-03-06 11:56:23,456 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=37fd6ec3f6ee6e4f1f1f2a7f528dfd61, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,42547,1678103642479; forceNewPlan=false, retain=false 2023-03-06 11:56:23,607 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=37fd6ec3f6ee6e4f1f1f2a7f528dfd61, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:23,607 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithMonthlyPolicy,,1678103782626.37fd6ec3f6ee6e4f1f1f2a7f528dfd61.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1678103783607"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678103783607"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678103783607"}]},"ts":"1678103783607"} 2023-03-06 11:56:23,608 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=114, ppid=113, state=RUNNABLE; OpenRegionProcedure 37fd6ec3f6ee6e4f1f1f2a7f528dfd61, server=jenkins-hbase5.apache.org,42547,1678103642479}] 2023-03-06 11:56:23,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-03-06 11:56:23,762 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(128): Open testMinorCompactionWithMonthlyPolicy,,1678103782626.37fd6ec3f6ee6e4f1f1f2a7f528dfd61. 2023-03-06 11:56:23,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 37fd6ec3f6ee6e4f1f1f2a7f528dfd61, NAME => 'testMinorCompactionWithMonthlyPolicy,,1678103782626.37fd6ec3f6ee6e4f1f1f2a7f528dfd61.', STARTKEY => '', ENDKEY => ''} 2023-03-06 11:56:23,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithMonthlyPolicy 37fd6ec3f6ee6e4f1f1f2a7f528dfd61 2023-03-06 11:56:23,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1678103782626.37fd6ec3f6ee6e4f1f1f2a7f528dfd61.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-06 11:56:23,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 37fd6ec3f6ee6e4f1f1f2a7f528dfd61 2023-03-06 11:56:23,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 37fd6ec3f6ee6e4f1f1f2a7f528dfd61 2023-03-06 11:56:23,764 INFO [StoreOpener-37fd6ec3f6ee6e4f1f1f2a7f528dfd61-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 37fd6ec3f6ee6e4f1f1f2a7f528dfd61 2023-03-06 11:56:23,765 DEBUG [StoreOpener-37fd6ec3f6ee6e4f1f1f2a7f528dfd61-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1 2023-03-06 11:56:23,765 DEBUG [StoreOpener-37fd6ec3f6ee6e4f1f1f2a7f528dfd61-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1 2023-03-06 11:56:23,765 INFO [StoreOpener-37fd6ec3f6ee6e4f1f1f2a7f528dfd61-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 37fd6ec3f6ee6e4f1f1f2a7f528dfd61 columnFamilyName family1 2023-03-06 11:56:23,767 INFO [StoreOpener-37fd6ec3f6ee6e4f1f1f2a7f528dfd61-1] regionserver.HStore(310): Store=37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-06 11:56:23,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61 2023-03-06 11:56:23,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61 2023-03-06 11:56:23,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 37fd6ec3f6ee6e4f1f1f2a7f528dfd61 2023-03-06 11:56:23,771 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-06 11:56:23,771 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 37fd6ec3f6ee6e4f1f1f2a7f528dfd61; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70370183, jitterRate=0.048597440123558044}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-06 11:56:23,771 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 37fd6ec3f6ee6e4f1f1f2a7f528dfd61: 2023-03-06 11:56:23,772 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMinorCompactionWithMonthlyPolicy,,1678103782626.37fd6ec3f6ee6e4f1f1f2a7f528dfd61., pid=114, masterSystemTime=1678103783760 2023-03-06 11:56:23,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMinorCompactionWithMonthlyPolicy,,1678103782626.37fd6ec3f6ee6e4f1f1f2a7f528dfd61. 2023-03-06 11:56:23,773 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(156): Opened testMinorCompactionWithMonthlyPolicy,,1678103782626.37fd6ec3f6ee6e4f1f1f2a7f528dfd61. 2023-03-06 11:56:23,773 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=37fd6ec3f6ee6e4f1f1f2a7f528dfd61, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:23,774 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithMonthlyPolicy,,1678103782626.37fd6ec3f6ee6e4f1f1f2a7f528dfd61.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1678103783773"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678103783773"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678103783773"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678103783773"}]},"ts":"1678103783773"} 2023-03-06 11:56:23,776 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=114, resume processing ppid=113 2023-03-06 11:56:23,776 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=114, ppid=113, state=SUCCESS; OpenRegionProcedure 37fd6ec3f6ee6e4f1f1f2a7f528dfd61, server=jenkins-hbase5.apache.org,42547,1678103642479 in 167 msec 2023-03-06 11:56:23,777 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=113, resume processing ppid=112 2023-03-06 11:56:23,777 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=113, ppid=112, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=37fd6ec3f6ee6e4f1f1f2a7f528dfd61, ASSIGN in 322 msec 2023-03-06 11:56:23,777 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-06 11:56:23,777 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678103783777"}]},"ts":"1678103783777"} 2023-03-06 11:56:23,778 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-03-06 11:56:23,780 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-03-06 11:56:23,781 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy in 1.1540 sec 2023-03-06 11:56:24,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-03-06 11:56:24,734 INFO [Listener at localhost/46717] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithMonthlyPolicy, procId: 112 completed 2023-03-06 11:56:24,755 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:56:24,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:24,756 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-06 11:56:24,756 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:56:24,756 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-06 11:56:24,756 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-06 11:56:24,757 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:24,757 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:24,758 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:56:24,758 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:24,758 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:56:24,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:56:24,758 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:24,758 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:56:24,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:24,759 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:24,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:56:24,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:24,759 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:24,759 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:24,759 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-06 11:56:24,759 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:56:24,759 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-06 11:56:24,761 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-06 11:56:24,761 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:56:24,761 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1678103782626.37fd6ec3f6ee6e4f1f1f2a7f528dfd61. 2023-03-06 11:56:24,761 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1678103782626.37fd6ec3f6ee6e4f1f1f2a7f528dfd61. started... 2023-03-06 11:56:24,762 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 37fd6ec3f6ee6e4f1f1f2a7f528dfd61 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-06 11:56:25,185 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130c9d3fe73f848480bbf495eb52f55c780 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130c9d3fe73f848480bbf495eb52f55c780 2023-03-06 11:56:25,589 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/.tmp/family1/fc97ac99a6f540f78b9747e8c0bf56e1 2023-03-06 11:56:25,593 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/.tmp/family1/fc97ac99a6f540f78b9747e8c0bf56e1 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/fc97ac99a6f540f78b9747e8c0bf56e1 2023-03-06 11:56:25,596 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/fc97ac99a6f540f78b9747e8c0bf56e1, entries=1000, sequenceid=5, filesize=166.0 K 2023-03-06 11:56:25,597 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 37fd6ec3f6ee6e4f1f1f2a7f528dfd61 in 835ms, sequenceid=5, compaction requested=false 2023-03-06 11:56:25,597 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithMonthlyPolicy' 2023-03-06 11:56:25,598 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 37fd6ec3f6ee6e4f1f1f2a7f528dfd61: 2023-03-06 11:56:25,598 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1678103782626.37fd6ec3f6ee6e4f1f1f2a7f528dfd61. 2023-03-06 11:56:25,598 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-06 11:56:25,598 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-06 11:56:25,598 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:25,598 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-06 11:56:25,598 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-06 11:56:25,599 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:25,599 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:25,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:25,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:56:25,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:56:25,600 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:25,600 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:56:25,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:56:25,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:56:25,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:25,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:25,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:56:25,601 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-06 11:56:25,601 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@424df001[Count = 0] remaining members to acquire global barrier 2023-03-06 11:56:25,601 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-06 11:56:25,601 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:25,603 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:25,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:25,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:25,603 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-06 11:56:25,603 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-06 11:56:25,603 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:56:25,604 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:25,604 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:56:25,605 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-06 11:56:25,605 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:25,605 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:56:25,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:25,605 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-06 11:56:25,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:56:25,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:56:25,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:56:25,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:56:25,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:25,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:25,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:56:25,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:25,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:25,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:56:25,607 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-06 11:56:25,607 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-06 11:56:25,607 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:56:25,608 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:56:25,608 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:25,608 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:56:25,609 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:25,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:25,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:56:25,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:56:25,609 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:25,609 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:56:25,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:25,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:25,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:56:25,609 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:25,610 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:56:25,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:56:25,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:25,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:25,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:56:25,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:25,611 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:25,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:25,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:56:25,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:25,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:25,613 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:25,613 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:56:25,613 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:25,613 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:56:25,613 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-06 11:56:25,613 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:56:25,613 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-06 11:56:25,613 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:25,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:56:25,613 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:25,613 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:56:25,613 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:25,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:56:25,614 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:25,614 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:25,614 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-06 11:56:25,614 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:56:25,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:56:25,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:56:25,714 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:56:25,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:56:25,719 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:56:25,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-06 11:56:25,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:25,721 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-06 11:56:25,721 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:56:25,721 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-06 11:56:25,721 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-06 11:56:25,722 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:25,722 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:25,724 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:56:25,724 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:25,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:56:25,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:56:25,725 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:25,725 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:56:25,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:25,725 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:25,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:56:25,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:25,725 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:25,725 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-06 11:56:25,726 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:25,726 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-06 11:56:25,726 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:56:25,726 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-06 11:56:25,728 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-06 11:56:25,728 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:56:25,728 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1678103782626.37fd6ec3f6ee6e4f1f1f2a7f528dfd61. 2023-03-06 11:56:25,728 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1678103782626.37fd6ec3f6ee6e4f1f1f2a7f528dfd61. started... 2023-03-06 11:56:25,729 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 37fd6ec3f6ee6e4f1f1f2a7f528dfd61 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-06 11:56:25,750 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128205407f236f4414eb42b6428b5e265b3 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128205407f236f4414eb42b6428b5e265b3 2023-03-06 11:56:25,759 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/.tmp/family1/79e56a8c2f8241279631a23718aed630 2023-03-06 11:56:25,764 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/.tmp/family1/79e56a8c2f8241279631a23718aed630 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/79e56a8c2f8241279631a23718aed630 2023-03-06 11:56:25,767 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/79e56a8c2f8241279631a23718aed630, entries=1, sequenceid=9, filesize=5.0 K 2023-03-06 11:56:25,768 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 37fd6ec3f6ee6e4f1f1f2a7f528dfd61 in 39ms, sequenceid=9, compaction requested=false 2023-03-06 11:56:25,768 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 37fd6ec3f6ee6e4f1f1f2a7f528dfd61: 2023-03-06 11:56:25,768 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1678103782626.37fd6ec3f6ee6e4f1f1f2a7f528dfd61. 2023-03-06 11:56:25,768 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-06 11:56:25,768 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-06 11:56:25,768 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:25,768 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-06 11:56:25,768 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-06 11:56:25,770 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:25,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:25,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:56:25,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:56:25,770 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:25,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:56:25,770 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:25,770 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:56:25,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:56:25,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:25,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:25,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:56:25,771 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-06 11:56:25,772 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1c1a1628[Count = 0] remaining members to acquire global barrier 2023-03-06 11:56:25,772 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-06 11:56:25,772 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:25,773 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:25,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:25,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:25,773 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-06 11:56:25,773 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-06 11:56:25,773 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:56:25,773 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:25,773 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:56:25,774 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-06 11:56:25,774 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:56:25,774 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:25,774 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-06 11:56:25,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:25,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:56:25,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:56:25,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:56:25,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:56:25,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:25,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:25,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:56:25,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:25,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:25,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:56:25,776 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-06 11:56:25,777 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-06 11:56:25,777 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:56:25,777 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:56:25,777 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:25,777 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:56:25,779 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:25,779 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:25,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:25,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:25,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:56:25,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:56:25,779 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:56:25,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:25,780 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:25,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:56:25,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:56:25,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:56:25,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:25,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:25,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:56:25,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:25,781 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:25,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:25,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:56:25,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:25,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:25,783 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:25,783 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:25,783 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:25,783 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:25,783 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:25,783 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:25,783 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:56:25,783 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:56:25,783 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-06 11:56:25,783 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:56:25,783 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:25,783 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:56:25,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:56:25,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:56:25,784 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-06 11:56:25,784 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-06 11:56:25,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:56:25,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:56:25,784 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:56:25,884 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:56:25,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:56:25,890 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:56:25,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-06 11:56:25,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:25,895 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-06 11:56:25,895 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:56:25,895 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-06 11:56:25,895 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-06 11:56:25,895 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:25,895 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:25,900 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:56:25,900 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:25,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:56:25,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:56:25,900 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:25,900 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:56:25,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:25,901 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:25,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:56:25,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:25,901 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:25,902 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-06 11:56:25,902 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:25,902 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-06 11:56:25,902 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:56:25,902 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-06 11:56:25,903 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-06 11:56:25,903 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:56:25,904 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1678103782626.37fd6ec3f6ee6e4f1f1f2a7f528dfd61. 2023-03-06 11:56:25,904 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1678103782626.37fd6ec3f6ee6e4f1f1f2a7f528dfd61. started... 2023-03-06 11:56:25,904 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 37fd6ec3f6ee6e4f1f1f2a7f528dfd61 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-06 11:56:26,321 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512017bd688aa168e4dfc8b2f3ef458d6175d to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512017bd688aa168e4dfc8b2f3ef458d6175d 2023-03-06 11:56:26,726 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/.tmp/family1/b0cb8b20d227461ca30817f8149bfed3 2023-03-06 11:56:26,731 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/.tmp/family1/b0cb8b20d227461ca30817f8149bfed3 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/b0cb8b20d227461ca30817f8149bfed3 2023-03-06 11:56:26,734 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/b0cb8b20d227461ca30817f8149bfed3, entries=1, sequenceid=13, filesize=4.9 K 2023-03-06 11:56:26,735 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 37fd6ec3f6ee6e4f1f1f2a7f528dfd61 in 831ms, sequenceid=13, compaction requested=true 2023-03-06 11:56:26,735 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 37fd6ec3f6ee6e4f1f1f2a7f528dfd61: 2023-03-06 11:56:26,735 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1678103782626.37fd6ec3f6ee6e4f1f1f2a7f528dfd61. 2023-03-06 11:56:26,735 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-06 11:56:26,735 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-06 11:56:26,735 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:26,735 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-06 11:56:26,735 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-06 11:56:26,737 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:26,737 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:26,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:26,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:56:26,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:56:26,737 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:26,737 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:56:26,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:56:26,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:56:26,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:26,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:26,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:56:26,738 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-06 11:56:26,738 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@11025f75[Count = 0] remaining members to acquire global barrier 2023-03-06 11:56:26,738 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-06 11:56:26,738 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:26,739 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:26,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:26,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:26,740 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-06 11:56:26,740 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-06 11:56:26,740 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:56:26,740 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:26,740 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:56:26,742 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:26,742 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-06 11:56:26,742 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:56:26,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:26,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:56:26,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:56:26,742 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-06 11:56:26,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:56:26,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:56:26,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:26,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:26,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:56:26,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:26,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:26,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:56:26,744 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-06 11:56:26,744 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-06 11:56:26,744 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:56:26,744 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:56:26,744 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:26,744 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:56:26,745 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:26,745 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:26,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:26,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:56:26,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:56:26,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:26,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:26,745 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:56:26,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:56:26,746 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:26,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:56:26,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:56:26,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:26,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:26,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:56:26,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:26,747 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:26,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:26,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:56:26,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:26,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:26,748 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:26,748 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:56:26,748 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:26,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:56:26,748 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:26,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:56:26,748 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:56:26,748 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-06 11:56:26,749 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:56:26,748 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:56:26,748 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:26,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:56:26,749 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:26,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:56:26,749 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:26,749 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:26,749 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-06 11:56:26,749 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:56:26,849 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:56:26,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:56:26,853 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:56:26,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-06 11:56:26,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:26,854 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-06 11:56:26,854 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:56:26,854 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-06 11:56:26,854 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-06 11:56:26,855 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:26,855 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:26,856 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:26,856 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:56:26,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:56:26,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:56:26,856 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:26,856 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:56:26,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:26,856 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:26,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:56:26,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:26,857 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:26,857 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-06 11:56:26,857 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:26,857 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-06 11:56:26,857 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:56:26,857 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-06 11:56:26,857 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-06 11:56:26,858 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:56:26,858 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1678103782626.37fd6ec3f6ee6e4f1f1f2a7f528dfd61. 2023-03-06 11:56:26,858 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1678103782626.37fd6ec3f6ee6e4f1f1f2a7f528dfd61. started... 2023-03-06 11:56:26,858 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 37fd6ec3f6ee6e4f1f1f2a7f528dfd61 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-06 11:56:27,269 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205e293562485334f87bc2c7b998ec1d28f to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205e293562485334f87bc2c7b998ec1d28f 2023-03-06 11:56:27,674 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/.tmp/family1/0a8e429edd684dd8b112af71ecbd39f2 2023-03-06 11:56:27,677 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/.tmp/family1/0a8e429edd684dd8b112af71ecbd39f2 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/0a8e429edd684dd8b112af71ecbd39f2 2023-03-06 11:56:27,680 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/0a8e429edd684dd8b112af71ecbd39f2, entries=1, sequenceid=17, filesize=4.9 K 2023-03-06 11:56:27,681 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 37fd6ec3f6ee6e4f1f1f2a7f528dfd61 in 823ms, sequenceid=17, compaction requested=true 2023-03-06 11:56:27,681 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 37fd6ec3f6ee6e4f1f1f2a7f528dfd61: 2023-03-06 11:56:27,681 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1678103782626.37fd6ec3f6ee6e4f1f1f2a7f528dfd61. 2023-03-06 11:56:27,681 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-06 11:56:27,681 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-06 11:56:27,681 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:27,682 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-06 11:56:27,682 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-06 11:56:27,684 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:27,685 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:27,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:27,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:56:27,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:56:27,685 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:27,685 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:56:27,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:56:27,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:56:27,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:27,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:27,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:56:27,686 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-06 11:56:27,686 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43e3fa61[Count = 0] remaining members to acquire global barrier 2023-03-06 11:56:27,686 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-06 11:56:27,686 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:27,687 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:27,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:27,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:27,688 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-06 11:56:27,688 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-06 11:56:27,688 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:27,688 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:56:27,688 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:56:27,689 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-06 11:56:27,689 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:27,689 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:56:27,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:27,689 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-06 11:56:27,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:56:27,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:56:27,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:56:27,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:56:27,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:27,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:27,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:56:27,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:27,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:27,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:56:27,691 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-06 11:56:27,691 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-06 11:56:27,691 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:56:27,691 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:56:27,691 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:27,691 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:56:27,692 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:27,692 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:27,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:27,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:56:27,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:56:27,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:27,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:27,692 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:56:27,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:56:27,693 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:56:27,693 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:27,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:56:27,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:27,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:27,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:56:27,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:27,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:27,694 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:27,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:56:27,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:27,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:27,697 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:27,697 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:56:27,697 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:27,697 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:56:27,697 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-06 11:56:27,698 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:56:27,697 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:27,697 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:56:27,697 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:56:27,698 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:27,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:56:27,698 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:27,698 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-06 11:56:27,698 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:56:27,698 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:27,698 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:27,698 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:56:27,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:56:27,798 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:56:27,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:56:27,802 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:56:27,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-06 11:56:27,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:27,803 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-06 11:56:27,804 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:56:27,804 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-06 11:56:27,804 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-06 11:56:27,804 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:27,804 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:27,805 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:27,805 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:56:27,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:56:27,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:56:27,805 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:27,805 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:56:27,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:27,806 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:27,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:56:27,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:27,806 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:27,806 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-06 11:56:27,806 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:27,806 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-06 11:56:27,806 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:56:27,806 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-06 11:56:27,806 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-06 11:56:27,806 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:56:27,806 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1678103782626.37fd6ec3f6ee6e4f1f1f2a7f528dfd61. 2023-03-06 11:56:27,806 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1678103782626.37fd6ec3f6ee6e4f1f1f2a7f528dfd61. started... 2023-03-06 11:56:27,806 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 37fd6ec3f6ee6e4f1f1f2a7f528dfd61 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-06 11:56:28,216 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228086cdcc66e784c5d85d0547d488fb505 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228086cdcc66e784c5d85d0547d488fb505 2023-03-06 11:56:28,621 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/.tmp/family1/4dfad985f2114e0aa2a1f0f32b48f35e 2023-03-06 11:56:28,626 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/.tmp/family1/4dfad985f2114e0aa2a1f0f32b48f35e as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/4dfad985f2114e0aa2a1f0f32b48f35e 2023-03-06 11:56:28,630 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/4dfad985f2114e0aa2a1f0f32b48f35e, entries=1, sequenceid=21, filesize=4.9 K 2023-03-06 11:56:28,631 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 37fd6ec3f6ee6e4f1f1f2a7f528dfd61 in 824ms, sequenceid=21, compaction requested=true 2023-03-06 11:56:28,631 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 37fd6ec3f6ee6e4f1f1f2a7f528dfd61: 2023-03-06 11:56:28,631 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1678103782626.37fd6ec3f6ee6e4f1f1f2a7f528dfd61. 2023-03-06 11:56:28,631 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-06 11:56:28,631 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-06 11:56:28,631 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:28,631 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-06 11:56:28,631 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-06 11:56:28,634 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:28,634 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:28,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:28,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:56:28,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:56:28,635 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:28,635 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:56:28,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:56:28,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:56:28,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:28,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:28,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:56:28,636 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-06 11:56:28,636 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6e03c7e4[Count = 0] remaining members to acquire global barrier 2023-03-06 11:56:28,636 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-06 11:56:28,636 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:28,637 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:28,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:28,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:28,637 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-06 11:56:28,637 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-06 11:56:28,637 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:56:28,637 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:28,638 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:56:28,639 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-06 11:56:28,639 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:28,639 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:56:28,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:28,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:56:28,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:56:28,639 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-06 11:56:28,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:56:28,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:56:28,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:28,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:28,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:56:28,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:28,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:28,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:56:28,641 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-06 11:56:28,641 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-06 11:56:28,641 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:56:28,641 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:56:28,641 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:28,641 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:56:28,643 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:28,643 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:28,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:28,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:28,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:56:28,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:56:28,643 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:56:28,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:28,643 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:28,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:56:28,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:56:28,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:56:28,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:28,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:28,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:56:28,644 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:28,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:28,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:28,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:56:28,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:28,654 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:28,654 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:56:28,654 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:56:28,654 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:56:28,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:56:28,654 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:56:28,654 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-06 11:56:28,654 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:56:28,654 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:28,654 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:28,654 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:28,654 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:28,654 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-06 11:56:28,654 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:28,654 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:28,654 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:56:28,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:56:28,654 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-06 11:56:28,655 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:56:28,755 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:56:28,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:56:28,759 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:56:28,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-06 11:56:28,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:28,762 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-06 11:56:28,763 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:56:28,763 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-06 11:56:28,763 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-06 11:56:28,763 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:28,763 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:28,764 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:56:28,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:56:28,765 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:28,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:56:28,765 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:28,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:28,765 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:56:28,766 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:28,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:56:28,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:28,766 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:28,766 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-06 11:56:28,767 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:28,767 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-06 11:56:28,767 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:56:28,767 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-06 11:56:28,768 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-06 11:56:28,768 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:56:28,776 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1678103782626.37fd6ec3f6ee6e4f1f1f2a7f528dfd61. 2023-03-06 11:56:28,776 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1678103782626.37fd6ec3f6ee6e4f1f1f2a7f528dfd61. started... 2023-03-06 11:56:28,776 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 37fd6ec3f6ee6e4f1f1f2a7f528dfd61 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-06 11:56:28,799 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231e4df9dcb5a7e4eff96ccf66c5fcac2aa to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231e4df9dcb5a7e4eff96ccf66c5fcac2aa 2023-03-06 11:56:29,204 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/.tmp/family1/d6aa619f39a44136ab1b435ff57298ec 2023-03-06 11:56:29,208 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/.tmp/family1/d6aa619f39a44136ab1b435ff57298ec as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/d6aa619f39a44136ab1b435ff57298ec 2023-03-06 11:56:29,211 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/d6aa619f39a44136ab1b435ff57298ec, entries=1, sequenceid=25, filesize=4.9 K 2023-03-06 11:56:29,212 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 37fd6ec3f6ee6e4f1f1f2a7f528dfd61 in 436ms, sequenceid=25, compaction requested=true 2023-03-06 11:56:29,212 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 37fd6ec3f6ee6e4f1f1f2a7f528dfd61: 2023-03-06 11:56:29,212 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1678103782626.37fd6ec3f6ee6e4f1f1f2a7f528dfd61. 2023-03-06 11:56:29,212 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-06 11:56:29,212 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-06 11:56:29,212 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:29,212 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-06 11:56:29,212 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-06 11:56:29,213 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:29,213 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:29,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:29,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:56:29,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:56:29,214 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:29,214 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:56:29,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:56:29,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:56:29,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:29,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:29,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:56:29,215 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-06 11:56:29,215 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@22e4375a[Count = 0] remaining members to acquire global barrier 2023-03-06 11:56:29,215 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-06 11:56:29,215 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:29,217 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:29,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:29,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:29,217 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-06 11:56:29,217 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-06 11:56:29,217 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:29,217 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:56:29,217 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:56:29,218 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-06 11:56:29,218 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:56:29,218 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:29,218 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-06 11:56:29,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:29,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:56:29,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:56:29,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:56:29,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:56:29,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:29,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:29,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:56:29,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:29,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:29,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:56:29,220 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-06 11:56:29,220 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-06 11:56:29,220 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:56:29,220 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:56:29,220 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:29,220 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:56:29,222 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:29,222 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:29,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:29,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:56:29,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:56:29,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:29,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:29,222 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:56:29,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:56:29,222 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:29,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:56:29,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:56:29,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:29,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:29,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:56:29,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:29,223 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:29,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:29,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:56:29,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:29,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:29,225 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:29,225 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:56:29,225 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:29,225 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-06 11:56:29,225 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:56:29,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:56:29,225 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:56:29,225 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:56:29,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:56:29,225 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:29,225 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:29,225 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-06 11:56:29,225 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:56:29,225 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:29,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:56:29,225 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:29,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:56:29,226 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:29,314 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-06 11:56:29,325 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:56:29,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:56:29,330 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:56:29,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-06 11:56:29,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:29,332 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-06 11:56:29,332 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:56:29,332 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-06 11:56:29,332 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-06 11:56:29,332 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:29,332 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:29,335 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:56:29,335 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:29,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:56:29,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:56:29,335 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:29,335 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:56:29,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:29,336 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:29,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:56:29,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:29,336 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:29,336 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-06 11:56:29,336 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:29,336 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-06 11:56:29,336 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:56:29,336 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-06 11:56:29,336 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-06 11:56:29,337 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:56:29,337 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1678103782626.37fd6ec3f6ee6e4f1f1f2a7f528dfd61. 2023-03-06 11:56:29,337 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1678103782626.37fd6ec3f6ee6e4f1f1f2a7f528dfd61. started... 2023-03-06 11:56:29,337 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 37fd6ec3f6ee6e4f1f1f2a7f528dfd61 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-06 11:56:29,757 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101a854ab2c56a4415b86b5081f92b4e5d3 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160101a854ab2c56a4415b86b5081f92b4e5d3 2023-03-06 11:56:30,162 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/.tmp/family1/6b6764015d75428397eda6fb87af8cbd 2023-03-06 11:56:30,166 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/.tmp/family1/6b6764015d75428397eda6fb87af8cbd as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/6b6764015d75428397eda6fb87af8cbd 2023-03-06 11:56:30,169 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/6b6764015d75428397eda6fb87af8cbd, entries=1, sequenceid=29, filesize=4.9 K 2023-03-06 11:56:30,170 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 37fd6ec3f6ee6e4f1f1f2a7f528dfd61 in 833ms, sequenceid=29, compaction requested=true 2023-03-06 11:56:30,170 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 37fd6ec3f6ee6e4f1f1f2a7f528dfd61: 2023-03-06 11:56:30,170 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1678103782626.37fd6ec3f6ee6e4f1f1f2a7f528dfd61. 2023-03-06 11:56:30,170 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-06 11:56:30,170 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-06 11:56:30,170 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:30,170 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-06 11:56:30,170 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-06 11:56:30,172 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:30,172 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:30,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:30,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:56:30,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:56:30,172 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:30,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:56:30,172 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:56:30,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:56:30,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:30,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:30,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:56:30,173 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-06 11:56:30,173 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@211e3d84[Count = 0] remaining members to acquire global barrier 2023-03-06 11:56:30,173 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-06 11:56:30,173 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:30,174 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:30,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:30,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:30,175 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-06 11:56:30,175 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-06 11:56:30,175 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:56:30,175 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:30,175 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:56:30,176 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-06 11:56:30,176 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:30,176 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:56:30,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:30,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:56:30,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:56:30,176 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-06 11:56:30,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:56:30,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:56:30,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:30,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:30,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:56:30,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:30,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:30,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:56:30,178 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-06 11:56:30,178 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-06 11:56:30,178 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:56:30,178 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:56:30,178 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:30,178 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:56:30,181 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:30,181 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:30,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:30,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:30,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:56:30,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:56:30,181 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:56:30,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:30,181 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:30,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:56:30,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:56:30,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:56:30,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:30,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:30,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:56:30,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:30,183 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:30,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:30,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:56:30,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:30,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:30,185 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:30,185 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:56:30,185 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:30,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:56:30,185 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-06 11:56:30,185 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:56:30,185 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:56:30,185 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:30,185 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:30,185 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:30,185 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:30,185 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:30,185 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:56:30,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:56:30,185 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-06 11:56:30,185 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-06 11:56:30,185 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:56:30,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:56:30,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:56:30,285 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:56:30,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:56:30,290 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:56:30,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-06 11:56:30,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:30,291 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-06 11:56:30,291 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:56:30,291 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-06 11:56:30,291 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-06 11:56:30,291 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:30,292 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:30,293 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:30,293 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:56:30,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:56:30,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:56:30,293 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:30,293 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:56:30,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:30,293 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:30,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:56:30,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:30,294 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:30,294 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-06 11:56:30,294 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:30,294 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-06 11:56:30,294 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:56:30,294 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-06 11:56:30,294 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-06 11:56:30,294 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:56:30,294 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1678103782626.37fd6ec3f6ee6e4f1f1f2a7f528dfd61. 2023-03-06 11:56:30,294 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1678103782626.37fd6ec3f6ee6e4f1f1f2a7f528dfd61. started... 2023-03-06 11:56:30,294 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 37fd6ec3f6ee6e4f1f1f2a7f528dfd61 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-06 11:56:30,706 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103353e0a0aa82249aa900fbc2a5173189c to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103353e0a0aa82249aa900fbc2a5173189c 2023-03-06 11:56:31,114 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/.tmp/family1/bc0a4edd97e142de9b93e868c83ae1ea 2023-03-06 11:56:31,119 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/.tmp/family1/bc0a4edd97e142de9b93e868c83ae1ea as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/bc0a4edd97e142de9b93e868c83ae1ea 2023-03-06 11:56:31,122 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/bc0a4edd97e142de9b93e868c83ae1ea, entries=1, sequenceid=33, filesize=4.9 K 2023-03-06 11:56:31,122 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 37fd6ec3f6ee6e4f1f1f2a7f528dfd61 in 828ms, sequenceid=33, compaction requested=true 2023-03-06 11:56:31,123 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 37fd6ec3f6ee6e4f1f1f2a7f528dfd61: 2023-03-06 11:56:31,123 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1678103782626.37fd6ec3f6ee6e4f1f1f2a7f528dfd61. 2023-03-06 11:56:31,123 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-06 11:56:31,123 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-06 11:56:31,123 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:31,123 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-06 11:56:31,123 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-06 11:56:31,124 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:31,124 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:31,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:31,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:56:31,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:56:31,124 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:31,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:56:31,124 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:56:31,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:56:31,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:31,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:31,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:56:31,126 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-06 11:56:31,126 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7d72fb34[Count = 0] remaining members to acquire global barrier 2023-03-06 11:56:31,126 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-06 11:56:31,126 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:31,127 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:31,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:31,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:31,127 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-06 11:56:31,127 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-06 11:56:31,127 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:31,127 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:56:31,127 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:56:31,129 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-06 11:56:31,129 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:31,129 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:56:31,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:31,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:56:31,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:56:31,129 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-06 11:56:31,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:56:31,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:56:31,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:31,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:31,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:56:31,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:31,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:31,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:56:31,131 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-06 11:56:31,131 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-06 11:56:31,132 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:56:31,132 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:56:31,132 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:31,132 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:56:31,133 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:31,133 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:31,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:31,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:56:31,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:56:31,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:31,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:31,133 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:56:31,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:56:31,134 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:31,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:56:31,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:56:31,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:31,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:31,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:56:31,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:31,134 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:31,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:31,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:56:31,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:31,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:31,139 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:31,139 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:56:31,139 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:56:31,139 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:31,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:56:31,139 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:31,139 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:31,139 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-06 11:56:31,140 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-06 11:56:31,139 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:56:31,140 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:56:31,140 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:31,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:56:31,140 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:31,140 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:31,140 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-06 11:56:31,140 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:56:31,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:56:31,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:56:31,240 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:56:31,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:56:31,244 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:56:31,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-06 11:56:31,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:31,246 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-06 11:56:31,246 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:56:31,246 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-06 11:56:31,246 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-06 11:56:31,247 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:31,247 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:31,248 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:31,248 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:56:31,248 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:56:31,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:56:31,248 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:31,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:31,248 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:56:31,248 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:31,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:56:31,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:31,249 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:31,249 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-06 11:56:31,249 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:31,249 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-06 11:56:31,249 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:56:31,249 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-06 11:56:31,249 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-06 11:56:31,250 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:56:31,250 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1678103782626.37fd6ec3f6ee6e4f1f1f2a7f528dfd61. 2023-03-06 11:56:31,250 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1678103782626.37fd6ec3f6ee6e4f1f1f2a7f528dfd61. started... 2023-03-06 11:56:31,250 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 37fd6ec3f6ee6e4f1f1f2a7f528dfd61 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-06 11:56:31,660 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509076912859337794668bc4f18db1d1cbc15 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201509076912859337794668bc4f18db1d1cbc15 2023-03-06 11:56:32,065 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/.tmp/family1/753800252b1e45db9ddd6da0e988d985 2023-03-06 11:56:32,068 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/.tmp/family1/753800252b1e45db9ddd6da0e988d985 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/753800252b1e45db9ddd6da0e988d985 2023-03-06 11:56:32,071 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/753800252b1e45db9ddd6da0e988d985, entries=1, sequenceid=37, filesize=4.9 K 2023-03-06 11:56:32,072 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 37fd6ec3f6ee6e4f1f1f2a7f528dfd61 in 822ms, sequenceid=37, compaction requested=true 2023-03-06 11:56:32,072 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 37fd6ec3f6ee6e4f1f1f2a7f528dfd61: 2023-03-06 11:56:32,072 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1678103782626.37fd6ec3f6ee6e4f1f1f2a7f528dfd61. 2023-03-06 11:56:32,072 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-06 11:56:32,072 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-06 11:56:32,072 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:32,072 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-06 11:56:32,072 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-06 11:56:32,074 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:32,074 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:32,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:32,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:56:32,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:56:32,074 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:32,074 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:56:32,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:56:32,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:56:32,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:32,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:32,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:56:32,075 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-06 11:56:32,075 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@d3e2f99[Count = 0] remaining members to acquire global barrier 2023-03-06 11:56:32,075 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-06 11:56:32,075 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:32,076 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:32,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:32,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:32,076 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-06 11:56:32,076 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-06 11:56:32,076 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:56:32,076 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:32,076 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:56:32,079 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:32,079 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-06 11:56:32,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:32,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:56:32,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:56:32,079 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:56:32,079 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-06 11:56:32,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:56:32,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:56:32,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:32,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:32,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:56:32,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:32,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:32,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:56:32,081 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-06 11:56:32,081 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-06 11:56:32,081 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:56:32,081 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:56:32,081 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:32,081 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:56:32,082 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:32,082 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:32,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:32,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:56:32,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:56:32,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:32,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:32,082 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:56:32,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:56:32,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:56:32,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:56:32,083 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:32,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:32,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:32,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:56:32,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:32,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:32,084 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:32,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:56:32,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:32,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:32,086 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:32,086 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:56:32,086 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:56:32,086 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:32,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:56:32,086 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-06 11:56:32,086 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:56:32,086 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:56:32,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:56:32,086 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:32,086 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:32,086 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:32,086 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:32,086 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:32,086 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-06 11:56:32,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:56:32,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:56:32,086 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:56:32,186 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:56:32,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:56:32,192 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:56:32,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-06 11:56:32,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:32,197 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-06 11:56:32,197 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:56:32,197 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-06 11:56:32,197 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-06 11:56:32,197 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:32,198 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:32,199 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:56:32,199 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:32,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:56:32,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:56:32,199 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:32,199 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:56:32,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:32,199 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:32,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:56:32,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:32,200 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:32,200 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-06 11:56:32,200 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:32,200 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-06 11:56:32,200 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:56:32,200 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-06 11:56:32,201 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-06 11:56:32,201 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:56:32,201 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1678103782626.37fd6ec3f6ee6e4f1f1f2a7f528dfd61. 2023-03-06 11:56:32,201 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1678103782626.37fd6ec3f6ee6e4f1f1f2a7f528dfd61. started... 2023-03-06 11:56:32,201 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 37fd6ec3f6ee6e4f1f1f2a7f528dfd61 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-06 11:56:32,224 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120727d54604f0849898eada133ea805f1b to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120727d54604f0849898eada133ea805f1b 2023-03-06 11:56:32,238 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/.tmp/family1/7294f8177a60431f8bc846b4d457d46b 2023-03-06 11:56:32,242 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/.tmp/family1/7294f8177a60431f8bc846b4d457d46b as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/7294f8177a60431f8bc846b4d457d46b 2023-03-06 11:56:32,245 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/7294f8177a60431f8bc846b4d457d46b, entries=1, sequenceid=41, filesize=4.9 K 2023-03-06 11:56:32,246 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 37fd6ec3f6ee6e4f1f1f2a7f528dfd61 in 45ms, sequenceid=41, compaction requested=true 2023-03-06 11:56:32,246 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 37fd6ec3f6ee6e4f1f1f2a7f528dfd61: 2023-03-06 11:56:32,246 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1678103782626.37fd6ec3f6ee6e4f1f1f2a7f528dfd61. 2023-03-06 11:56:32,246 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-06 11:56:32,247 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-06 11:56:32,247 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:32,247 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-06 11:56:32,247 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-06 11:56:32,253 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:32,253 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:32,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:32,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:56:32,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:56:32,254 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:32,254 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:56:32,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:56:32,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:56:32,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:32,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:32,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:56:32,255 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-06 11:56:32,255 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@e639783[Count = 0] remaining members to acquire global barrier 2023-03-06 11:56:32,255 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-06 11:56:32,255 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:32,256 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:32,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:32,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:32,257 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-06 11:56:32,257 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-06 11:56:32,257 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:56:32,257 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:32,257 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:56:32,258 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-06 11:56:32,258 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:56:32,258 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:32,258 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-06 11:56:32,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:32,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:56:32,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:56:32,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:56:32,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:56:32,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:32,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:32,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:56:32,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:32,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:32,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:56:32,261 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-06 11:56:32,261 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-06 11:56:32,261 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:56:32,261 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:56:32,261 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:32,261 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:56:32,263 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:32,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:32,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:56:32,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:56:32,263 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:32,263 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:56:32,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:32,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:32,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:56:32,264 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:32,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:56:32,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:56:32,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:32,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:32,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:56:32,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:32,265 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:32,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:32,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:56:32,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:32,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:32,268 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:32,268 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:56:32,268 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:32,268 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:32,269 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:32,269 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:32,269 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:56:32,268 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:56:32,269 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-06 11:56:32,269 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:56:32,269 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:32,269 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:32,269 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-06 11:56:32,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:56:32,269 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:56:32,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:56:32,270 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-06 11:56:32,270 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:56:32,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:56:32,369 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:56:32,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:56:32,371 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=36301] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMinorCompactionWithMonthlyPolicy 2023-03-06 11:56:32,373 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] procedure2.ProcedureExecutor(1029): Stored pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-06 11:56:32,374 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-06 11:56:32,375 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-06 11:56:32,375 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=115, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678104392375 2023-03-06 11:56:32,376 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-06 11:56:32,376 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMinorCompactionWithMonthlyPolicy' and column 'family1' 2023-03-06 11:56:32,377 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-06 11:56:32,377 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] zookeeper.ReadOnlyZKClient(139): Connect 0x1b0d336b to 127.0.0.1:62659 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-06 11:56:32,384 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1acd76cd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-06 11:56:32,384 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-06 11:56:33,205 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103b6f278b0115745c896ab394ec469c961 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103b6f278b0115745c896ab394ec469c961 2023-03-06 11:56:33,206 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-06 11:56:33,218 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-06 11:56:33,220 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:56686, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-06 11:56:33,225 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-06 11:56:33,226 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:58286, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-06 11:56:33,234 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/d4588521542d4f4786e4024a35248995 first=Optional[r5] last=Optional[r6] 2023-03-06 11:56:33,235 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1678103782626.37fd6ec3f6ee6e4f1f1f2a7f528dfd61., hostname=jenkins-hbase5.apache.org,42547,1678103642479, seqNum=2 for row with hfile group [{family1,hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/d4588521542d4f4786e4024a35248995}] 2023-03-06 11:56:33,241 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(763): Validating hfile at hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/d4588521542d4f4786e4024a35248995 for inclusion in 37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1 2023-03-06 11:56:33,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-03-06 11:56:33,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(777): Region bounds: first= last= 2023-03-06 11:56:33,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegion(2446): Flush status journal for 37fd6ec3f6ee6e4f1f1f2a7f528dfd61: 2023-03-06 11:56:33,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/d4588521542d4f4786e4024a35248995 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMinorCompactionWithMonthlyPolicy__h1trpnf3qranp8g82s2h7ojfc2l4jq8io5i1qfaehl8q9v0nn0msrsg9mfsbp1sa/family1/d4588521542d4f4786e4024a35248995 2023-03-06 11:56:33,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMinorCompactionWithMonthlyPolicy__h1trpnf3qranp8g82s2h7ojfc2l4jq8io5i1qfaehl8q9v0nn0msrsg9mfsbp1sa/family1/d4588521542d4f4786e4024a35248995 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/0e5d61007d2444a8bd34a8933b5c6ca9_SeqId_44_ 2023-03-06 11:56:33,246 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(849): Loaded HFile hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMinorCompactionWithMonthlyPolicy__h1trpnf3qranp8g82s2h7ojfc2l4jq8io5i1qfaehl8q9v0nn0msrsg9mfsbp1sa/family1/d4588521542d4f4786e4024a35248995 into 37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/0e5d61007d2444a8bd34a8933b5c6ca9_SeqId_44_ - updating store file list. 2023-03-06 11:56:33,248 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(882): Loaded HFile hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/0e5d61007d2444a8bd34a8933b5c6ca9_SeqId_44_ into 37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1 2023-03-06 11:56:33,248 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(855): Successfully loaded hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMinorCompactionWithMonthlyPolicy__h1trpnf3qranp8g82s2h7ojfc2l4jq8io5i1qfaehl8q9v0nn0msrsg9mfsbp1sa/family1/d4588521542d4f4786e4024a35248995 into 37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1 (new location: hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/0e5d61007d2444a8bd34a8933b5c6ca9_SeqId_44_) 2023-03-06 11:56:33,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMinorCompactionWithMonthlyPolicy__h1trpnf3qranp8g82s2h7ojfc2l4jq8io5i1qfaehl8q9v0nn0msrsg9mfsbp1sa/family1/d4588521542d4f4786e4024a35248995 2023-03-06 11:56:33,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-06 11:56:33,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-06 11:56:33,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(1912): 37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1 is initiating minor compaction 2023-03-06 11:56:33,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@353bda48; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-06 11:56:33,251 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1 in testMinorCompactionWithMonthlyPolicy,,1678103782626.37fd6ec3f6ee6e4f1f1f2a7f528dfd61. 2023-03-06 11:56:33,251 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/79e56a8c2f8241279631a23718aed630, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/b0cb8b20d227461ca30817f8149bfed3, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/0a8e429edd684dd8b112af71ecbd39f2, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/4dfad985f2114e0aa2a1f0f32b48f35e, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/d6aa619f39a44136ab1b435ff57298ec, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/6b6764015d75428397eda6fb87af8cbd, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/bc0a4edd97e142de9b93e868c83ae1ea, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/753800252b1e45db9ddd6da0e988d985, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/7294f8177a60431f8bc846b4d457d46b, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/0e5d61007d2444a8bd34a8933b5c6ca9_SeqId_44_] into tmpdir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/.tmp, totalSize=49.7 K 2023-03-06 11:56:33,251 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting 79e56a8c2f8241279631a23718aed630, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-06 11:56:33,252 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting b0cb8b20d227461ca30817f8149bfed3, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-06 11:56:33,252 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting 0a8e429edd684dd8b112af71ecbd39f2, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-06 11:56:33,252 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting 4dfad985f2114e0aa2a1f0f32b48f35e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-06 11:56:33,252 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting d6aa619f39a44136ab1b435ff57298ec, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-06 11:56:33,252 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting 6b6764015d75428397eda6fb87af8cbd, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-06 11:56:33,252 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting bc0a4edd97e142de9b93e868c83ae1ea, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-06 11:56:33,252 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting 753800252b1e45db9ddd6da0e988d985, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-06 11:56:33,252 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting 7294f8177a60431f8bc846b4d457d46b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-06 11:56:33,252 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting 0e5d61007d2444a8bd34a8933b5c6ca9_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-06 11:56:33,253 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-06 11:56:33,254 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:56:33,255 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160101a854ab2c56a4415b86b5081f92b4e5d3 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160101a854ab2c56a4415b86b5081f92b4e5d3 2023-03-06 11:56:33,256 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103353e0a0aa82249aa900fbc2a5173189c to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103353e0a0aa82249aa900fbc2a5173189c 2023-03-06 11:56:33,256 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-03-06 11:56:33,256 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-03-06 11:56:33,257 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-06 11:56:33,257 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-06 11:56:33,297 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] throttle.PressureAwareThroughputController(145): 37fd6ec3f6ee6e4f1f1f2a7f528dfd61#family1#compaction#165 average throughput is 0.11 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-03-06 11:56:33,726 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512314721b3a73ebe4b7c920dc96a79798614 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512314721b3a73ebe4b7c920dc96a79798614 2023-03-06 11:56:33,726 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-06 11:56:33,748 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/6fc93709df7946799dbb8777ab51f819 first=Optional[r1] last=Optional[r4] 2023-03-06 11:56:33,749 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1678103782626.37fd6ec3f6ee6e4f1f1f2a7f528dfd61., hostname=jenkins-hbase5.apache.org,42547,1678103642479, seqNum=2 for row with hfile group [{family1,hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/6fc93709df7946799dbb8777ab51f819}] 2023-03-06 11:56:33,751 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(763): Validating hfile at hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/6fc93709df7946799dbb8777ab51f819 for inclusion in 37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1 2023-03-06 11:56:33,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-03-06 11:56:33,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(777): Region bounds: first= last= 2023-03-06 11:56:33,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegion(2446): Flush status journal for 37fd6ec3f6ee6e4f1f1f2a7f528dfd61: 2023-03-06 11:56:33,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/6fc93709df7946799dbb8777ab51f819 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMinorCompactionWithMonthlyPolicy__vjirl0k0brstpn16agg9reu7mp4fn9filnbej9e50bvadsqc9v8utvnedkhslpco/family1/6fc93709df7946799dbb8777ab51f819 2023-03-06 11:56:33,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMinorCompactionWithMonthlyPolicy__vjirl0k0brstpn16agg9reu7mp4fn9filnbej9e50bvadsqc9v8utvnedkhslpco/family1/6fc93709df7946799dbb8777ab51f819 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/56d37dd17fb24a4293c0729ef800c7be_SeqId_46_ 2023-03-06 11:56:33,757 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(849): Loaded HFile hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMinorCompactionWithMonthlyPolicy__vjirl0k0brstpn16agg9reu7mp4fn9filnbej9e50bvadsqc9v8utvnedkhslpco/family1/6fc93709df7946799dbb8777ab51f819 into 37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/56d37dd17fb24a4293c0729ef800c7be_SeqId_46_ - updating store file list. 2023-03-06 11:56:33,760 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(882): Loaded HFile hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/56d37dd17fb24a4293c0729ef800c7be_SeqId_46_ into 37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1 2023-03-06 11:56:33,760 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(855): Successfully loaded hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMinorCompactionWithMonthlyPolicy__vjirl0k0brstpn16agg9reu7mp4fn9filnbej9e50bvadsqc9v8utvnedkhslpco/family1/6fc93709df7946799dbb8777ab51f819 into 37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1 (new location: hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/56d37dd17fb24a4293c0729ef800c7be_SeqId_46_) 2023-03-06 11:56:33,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMinorCompactionWithMonthlyPolicy__vjirl0k0brstpn16agg9reu7mp4fn9filnbej9e50bvadsqc9v8utvnedkhslpco/family1/6fc93709df7946799dbb8777ab51f819 2023-03-06 11:56:33,762 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-06 11:56:33,762 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:56:33,763 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512017bd688aa168e4dfc8b2f3ef458d6175d to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512017bd688aa168e4dfc8b2f3ef458d6175d 2023-03-06 11:56:33,764 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205e293562485334f87bc2c7b998ec1d28f to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205e293562485334f87bc2c7b998ec1d28f 2023-03-06 11:56:33,765 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228086cdcc66e784c5d85d0547d488fb505 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228086cdcc66e784c5d85d0547d488fb505 2023-03-06 11:56:33,766 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231e4df9dcb5a7e4eff96ccf66c5fcac2aa to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231e4df9dcb5a7e4eff96ccf66c5fcac2aa 2023-03-06 11:56:33,766 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-03-06 11:56:33,766 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-03-06 11:56:33,766 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-06 11:56:33,766 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-06 11:56:34,117 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/.tmp/family1/e770fffdb0634de396b55e79293e1f56 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/e770fffdb0634de396b55e79293e1f56 2023-03-06 11:56:34,122 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1 of 37fd6ec3f6ee6e4f1f1f2a7f528dfd61 into e770fffdb0634de396b55e79293e1f56(size=6.6 K), total size for store is 178.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-06 11:56:34,122 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 37fd6ec3f6ee6e4f1f1f2a7f528dfd61: 2023-03-06 11:56:34,122 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1678103782626.37fd6ec3f6ee6e4f1f1f2a7f528dfd61., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1678103793251; duration=0sec 2023-03-06 11:56:34,122 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-06 11:56:34,200 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/79e56a8c2f8241279631a23718aed630, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/b0cb8b20d227461ca30817f8149bfed3, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/0a8e429edd684dd8b112af71ecbd39f2, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/4dfad985f2114e0aa2a1f0f32b48f35e, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/d6aa619f39a44136ab1b435ff57298ec, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/6b6764015d75428397eda6fb87af8cbd, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/bc0a4edd97e142de9b93e868c83ae1ea, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/753800252b1e45db9ddd6da0e988d985, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/7294f8177a60431f8bc846b4d457d46b, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/0e5d61007d2444a8bd34a8933b5c6ca9_SeqId_44_] to archive 2023-03-06 11:56:34,201 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:56:34,203 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/79e56a8c2f8241279631a23718aed630 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/79e56a8c2f8241279631a23718aed630 2023-03-06 11:56:34,204 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/b0cb8b20d227461ca30817f8149bfed3 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/b0cb8b20d227461ca30817f8149bfed3 2023-03-06 11:56:34,205 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/0a8e429edd684dd8b112af71ecbd39f2 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/0a8e429edd684dd8b112af71ecbd39f2 2023-03-06 11:56:34,206 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/4dfad985f2114e0aa2a1f0f32b48f35e to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/4dfad985f2114e0aa2a1f0f32b48f35e 2023-03-06 11:56:34,207 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/d6aa619f39a44136ab1b435ff57298ec to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/d6aa619f39a44136ab1b435ff57298ec 2023-03-06 11:56:34,209 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/6b6764015d75428397eda6fb87af8cbd to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/6b6764015d75428397eda6fb87af8cbd 2023-03-06 11:56:34,210 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/bc0a4edd97e142de9b93e868c83ae1ea to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/bc0a4edd97e142de9b93e868c83ae1ea 2023-03-06 11:56:34,211 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/753800252b1e45db9ddd6da0e988d985 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/753800252b1e45db9ddd6da0e988d985 2023-03-06 11:56:34,212 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/7294f8177a60431f8bc846b4d457d46b to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/7294f8177a60431f8bc846b4d457d46b 2023-03-06 11:56:34,213 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/0e5d61007d2444a8bd34a8933b5c6ca9_SeqId_44_ to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/0e5d61007d2444a8bd34a8933b5c6ca9_SeqId_44_ 2023-03-06 11:56:34,600 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511301ec1a4dec49f41c2b2156fa4efd8c008 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511301ec1a4dec49f41c2b2156fa4efd8c008 2023-03-06 11:56:34,602 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-06 11:56:34,624 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/2642629fb2c348fe8283d910a3239232 first=Optional[r00] last=Optional[r8] 2023-03-06 11:56:34,625 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1678103782626.37fd6ec3f6ee6e4f1f1f2a7f528dfd61., hostname=jenkins-hbase5.apache.org,42547,1678103642479, seqNum=2 for row with hfile group [{family1,hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/2642629fb2c348fe8283d910a3239232}] 2023-03-06 11:56:34,626 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(763): Validating hfile at hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/2642629fb2c348fe8283d910a3239232 for inclusion in 37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1 2023-03-06 11:56:34,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-03-06 11:56:34,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(777): Region bounds: first= last= 2023-03-06 11:56:34,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegion(2446): Flush status journal for 37fd6ec3f6ee6e4f1f1f2a7f528dfd61: 2023-03-06 11:56:34,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/2642629fb2c348fe8283d910a3239232 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMinorCompactionWithMonthlyPolicy__akmspupq9au4lquhm31f7ovi2hqf5eqcvgk60l4de04ilp1c7f6n0u2u5seft76t/family1/2642629fb2c348fe8283d910a3239232 2023-03-06 11:56:34,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMinorCompactionWithMonthlyPolicy__akmspupq9au4lquhm31f7ovi2hqf5eqcvgk60l4de04ilp1c7f6n0u2u5seft76t/family1/2642629fb2c348fe8283d910a3239232 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/fa633304868746d3973a3d7fe18fffd5_SeqId_49_ 2023-03-06 11:56:34,633 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(849): Loaded HFile hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMinorCompactionWithMonthlyPolicy__akmspupq9au4lquhm31f7ovi2hqf5eqcvgk60l4de04ilp1c7f6n0u2u5seft76t/family1/2642629fb2c348fe8283d910a3239232 into 37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/fa633304868746d3973a3d7fe18fffd5_SeqId_49_ - updating store file list. 2023-03-06 11:56:34,636 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(882): Loaded HFile hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/fa633304868746d3973a3d7fe18fffd5_SeqId_49_ into 37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1 2023-03-06 11:56:34,636 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(855): Successfully loaded hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMinorCompactionWithMonthlyPolicy__akmspupq9au4lquhm31f7ovi2hqf5eqcvgk60l4de04ilp1c7f6n0u2u5seft76t/family1/2642629fb2c348fe8283d910a3239232 into 37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1 (new location: hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/fa633304868746d3973a3d7fe18fffd5_SeqId_49_) 2023-03-06 11:56:34,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMinorCompactionWithMonthlyPolicy__akmspupq9au4lquhm31f7ovi2hqf5eqcvgk60l4de04ilp1c7f6n0u2u5seft76t/family1/2642629fb2c348fe8283d910a3239232 2023-03-06 11:56:34,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-03-06 11:56:34,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 352581 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-03-06 11:56:34,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(1912): 37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1 is initiating minor compaction (all files) 2023-03-06 11:56:34,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@766d953d; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-06 11:56:34,638 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1 in testMinorCompactionWithMonthlyPolicy,,1678103782626.37fd6ec3f6ee6e4f1f1f2a7f528dfd61. 2023-03-06 11:56:34,638 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/fc97ac99a6f540f78b9747e8c0bf56e1, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/e770fffdb0634de396b55e79293e1f56, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/56d37dd17fb24a4293c0729ef800c7be_SeqId_46_, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/fa633304868746d3973a3d7fe18fffd5_SeqId_49_] into tmpdir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/.tmp, totalSize=344.3 K 2023-03-06 11:56:34,638 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting fc97ac99a6f540f78b9747e8c0bf56e1, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878806372 2023-03-06 11:56:34,639 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting e770fffdb0634de396b55e79293e1f56, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621206372 2023-03-06 11:56:34,639 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting 56d37dd17fb24a4293c0729ef800c7be_SeqId_46_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=47, earliestPutTs=1448965206372 2023-03-06 11:56:34,639 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-06 11:56:34,639 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] compactions.Compactor(207): Compacting fa633304868746d3973a3d7fe18fffd5_SeqId_49_, keycount=1001, bloomtype=ROW, size=166.2 K, encoding=NONE, compression=NONE, seqNum=50, earliestPutTs=1448014806372 2023-03-06 11:56:34,640 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:56:34,642 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120727d54604f0849898eada133ea805f1b to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120727d54604f0849898eada133ea805f1b 2023-03-06 11:56:34,643 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128205407f236f4414eb42b6428b5e265b3 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128205407f236f4414eb42b6428b5e265b3 2023-03-06 11:56:34,644 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130c9d3fe73f848480bbf495eb52f55c780 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130c9d3fe73f848480bbf495eb52f55c780 2023-03-06 11:56:34,644 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-03-06 11:56:34,644 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-03-06 11:56:34,644 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-06 11:56:34,644 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-06 11:56:34,644 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-06 11:56:34,644 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-06 11:56:34,644 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-06 11:56:34,646 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=115, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-06 11:56:34,648 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=115, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 2.2740 sec 2023-03-06 11:56:34,656 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] throttle.PressureAwareThroughputController(145): 37fd6ec3f6ee6e4f1f1f2a7f528dfd61#family1#compaction#166 average throughput is 22.23 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-03-06 11:56:34,880 INFO [Listener at localhost/46717] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=260 (was 247) - Thread LEAK? -, OpenFileDescriptor=653 (was 618) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=133 (was 150), ProcessCount=160 (was 160), AvailableMemoryMB=9479 (was 9537) 2023-03-06 11:56:34,891 INFO [Listener at localhost/46717] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=260, OpenFileDescriptor=653, MaxFileDescriptor=60000, SystemLoadAverage=133, ProcessCount=160, AvailableMemoryMB=9478 2023-03-06 11:56:34,911 DEBUG [Listener at localhost/46717] crypto.Encryption(565): Installed org.apache.hadoop.hbase.io.crypto.KeyProviderForTesting into key provider cache 2023-03-06 11:56:34,972 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.HMaster$4(2112): Client=jenkins//172.31.10.131 create 'testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10Pwn\x1D\x01\xA6\x94\x89\xE0\x17\x81\xA0\x9D\xEF\x0B\xA5"\x10\xC3^z\xB0O\x87\x04\xE2\xE8\xBF\x19W\x00o9\x86*\x1077\xDD\xD7?\xAEN\x13\xA0\x06R\xF8\xE7:\xDC\xC52\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-03-06 11:56:34,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure2.ProcedureExecutor(1029): Stored pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionFromAdmin 2023-03-06 11:56:34,975 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_PRE_OPERATION 2023-03-06 11:56:34,975 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(697): Client=jenkins//172.31.10.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionFromAdmin" procId is: 116 2023-03-06 11:56:34,975 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-06 11:56:34,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-03-06 11:56:34,978 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde 2023-03-06 11:56:34,978 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128 2023-03-06 11:56:34,978 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc 2023-03-06 11:56:34,979 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde empty. 2023-03-06 11:56:34,979 DEBUG [HFileArchiver-21] backup.HFileArchiver(153): Directory hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128 empty. 2023-03-06 11:56:34,979 DEBUG [HFileArchiver-22] backup.HFileArchiver(153): Directory hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc empty. 2023-03-06 11:56:34,979 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde 2023-03-06 11:56:34,979 DEBUG [HFileArchiver-21] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128 2023-03-06 11:56:34,979 DEBUG [HFileArchiver-22] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc 2023-03-06 11:56:34,979 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMajorCompactionFromAdmin regions 2023-03-06 11:56:34,985 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp/data/default/testMajorCompactionFromAdmin/.tabledesc/.tableinfo.0000000001 2023-03-06 11:56:34,987 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(7675): creating {ENCODED => 5ab54f31ef0cb025ca841c2c033280dc, NAME => 'testMajorCompactionFromAdmin,2,1678103794935.5ab54f31ef0cb025ca841c2c033280dc.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10Pwn\x1D\x01\xA6\x94\x89\xE0\x17\x81\xA0\x9D\xEF\x0B\xA5"\x10\xC3^z\xB0O\x87\x04\xE2\xE8\xBF\x19W\x00o9\x86*\x1077\xDD\xD7?\xAEN\x13\xA0\x06R\xF8\xE7:\xDC\xC52\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp 2023-03-06 11:56:34,987 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(7675): creating {ENCODED => ef9ef54c7efbc7abe164d4b72ed65cde, NAME => 'testMajorCompactionFromAdmin,,1678103794935.ef9ef54c7efbc7abe164d4b72ed65cde.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10Pwn\x1D\x01\xA6\x94\x89\xE0\x17\x81\xA0\x9D\xEF\x0B\xA5"\x10\xC3^z\xB0O\x87\x04\xE2\xE8\xBF\x19W\x00o9\x86*\x1077\xDD\xD7?\xAEN\x13\xA0\x06R\xF8\xE7:\xDC\xC52\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp 2023-03-06 11:56:34,987 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(7675): creating {ENCODED => 3ebcc443c84012d3eaff66f83852d128, NAME => 'testMajorCompactionFromAdmin,1,1678103794935.3ebcc443c84012d3eaff66f83852d128.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10Pwn\x1D\x01\xA6\x94\x89\xE0\x17\x81\xA0\x9D\xEF\x0B\xA5"\x10\xC3^z\xB0O\x87\x04\xE2\xE8\xBF\x19W\x00o9\x86*\x1077\xDD\xD7?\xAEN\x13\xA0\x06R\xF8\xE7:\xDC\xC52\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/.tmp 2023-03-06 11:56:35,002 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1678103794935.5ab54f31ef0cb025ca841c2c033280dc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-06 11:56:35,002 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1604): Closing 5ab54f31ef0cb025ca841c2c033280dc, disabling compactions & flushes 2023-03-06 11:56:35,002 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1678103794935.5ab54f31ef0cb025ca841c2c033280dc. 2023-03-06 11:56:35,002 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1678103794935.5ab54f31ef0cb025ca841c2c033280dc. 2023-03-06 11:56:35,002 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1678103794935.5ab54f31ef0cb025ca841c2c033280dc. after waiting 0 ms 2023-03-06 11:56:35,002 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1678103794935.5ab54f31ef0cb025ca841c2c033280dc. 2023-03-06 11:56:35,002 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1678103794935.5ab54f31ef0cb025ca841c2c033280dc. 2023-03-06 11:56:35,002 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1558): Region close journal for 5ab54f31ef0cb025ca841c2c033280dc: 2023-03-06 11:56:35,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-03-06 11:56:35,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-03-06 11:56:35,400 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1678103794935.ef9ef54c7efbc7abe164d4b72ed65cde.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-06 11:56:35,400 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1678103794935.3ebcc443c84012d3eaff66f83852d128.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-06 11:56:35,400 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1604): Closing ef9ef54c7efbc7abe164d4b72ed65cde, disabling compactions & flushes 2023-03-06 11:56:35,400 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1604): Closing 3ebcc443c84012d3eaff66f83852d128, disabling compactions & flushes 2023-03-06 11:56:35,400 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1678103794935.ef9ef54c7efbc7abe164d4b72ed65cde. 2023-03-06 11:56:35,400 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1678103794935.ef9ef54c7efbc7abe164d4b72ed65cde. 2023-03-06 11:56:35,400 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1678103794935.3ebcc443c84012d3eaff66f83852d128. 2023-03-06 11:56:35,400 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1678103794935.ef9ef54c7efbc7abe164d4b72ed65cde. after waiting 0 ms 2023-03-06 11:56:35,400 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1678103794935.ef9ef54c7efbc7abe164d4b72ed65cde. 2023-03-06 11:56:35,400 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1678103794935.3ebcc443c84012d3eaff66f83852d128. 2023-03-06 11:56:35,400 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1678103794935.ef9ef54c7efbc7abe164d4b72ed65cde. 2023-03-06 11:56:35,401 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1558): Region close journal for ef9ef54c7efbc7abe164d4b72ed65cde: 2023-03-06 11:56:35,400 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1678103794935.3ebcc443c84012d3eaff66f83852d128. after waiting 0 ms 2023-03-06 11:56:35,401 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1678103794935.3ebcc443c84012d3eaff66f83852d128. 2023-03-06 11:56:35,401 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1678103794935.3ebcc443c84012d3eaff66f83852d128. 2023-03-06 11:56:35,401 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1558): Region close journal for 3ebcc443c84012d3eaff66f83852d128: 2023-03-06 11:56:35,403 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ADD_TO_META 2023-03-06 11:56:35,403 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,2,1678103794935.5ab54f31ef0cb025ca841c2c033280dc.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678103795403"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678103795403"}]},"ts":"1678103795403"} 2023-03-06 11:56:35,403 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,,1678103794935.ef9ef54c7efbc7abe164d4b72ed65cde.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678103795403"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678103795403"}]},"ts":"1678103795403"} 2023-03-06 11:56:35,404 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,1,1678103794935.3ebcc443c84012d3eaff66f83852d128.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1678103795403"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678103795403"}]},"ts":"1678103795403"} 2023-03-06 11:56:35,406 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-03-06 11:56:35,406 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-06 11:56:35,406 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678103795406"}]},"ts":"1678103795406"} 2023-03-06 11:56:35,407 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLING in hbase:meta 2023-03-06 11:56:35,410 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=ef9ef54c7efbc7abe164d4b72ed65cde, ASSIGN}, {pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=3ebcc443c84012d3eaff66f83852d128, ASSIGN}, {pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=5ab54f31ef0cb025ca841c2c033280dc, ASSIGN}] 2023-03-06 11:56:35,412 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=5ab54f31ef0cb025ca841c2c033280dc, ASSIGN 2023-03-06 11:56:35,412 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=3ebcc443c84012d3eaff66f83852d128, ASSIGN 2023-03-06 11:56:35,412 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=ef9ef54c7efbc7abe164d4b72ed65cde, ASSIGN 2023-03-06 11:56:35,412 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=3ebcc443c84012d3eaff66f83852d128, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,42547,1678103642479; forceNewPlan=false, retain=false 2023-03-06 11:56:35,412 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=5ab54f31ef0cb025ca841c2c033280dc, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,42547,1678103642479; forceNewPlan=false, retain=false 2023-03-06 11:56:35,412 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=ef9ef54c7efbc7abe164d4b72ed65cde, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,42547,1678103642479; forceNewPlan=false, retain=false 2023-03-06 11:56:35,477 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/.tmp/family1/5b94470a2090434985f764c5bb6b471c as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/5b94470a2090434985f764c5bb6b471c 2023-03-06 11:56:35,480 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1 of 37fd6ec3f6ee6e4f1f1f2a7f528dfd61 into 5b94470a2090434985f764c5bb6b471c(size=167.4 K), total size for store is 167.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-06 11:56:35,480 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 37fd6ec3f6ee6e4f1f1f2a7f528dfd61: 2023-03-06 11:56:35,480 INFO [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1678103782626.37fd6ec3f6ee6e4f1f1f2a7f528dfd61., storeName=family1, fileCount=4, fileSize=344.3 K (166.0 K, 6.6 K, 5.5 K, 166.2 K), priority=2, time=1678103794637; duration=0sec 2023-03-06 11:56:35,481 DEBUG [RS:0;jenkins-hbase5:42547-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-06 11:56:35,499 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/fc97ac99a6f540f78b9747e8c0bf56e1, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/e770fffdb0634de396b55e79293e1f56, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/56d37dd17fb24a4293c0729ef800c7be_SeqId_46_, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/fa633304868746d3973a3d7fe18fffd5_SeqId_49_] to archive 2023-03-06 11:56:35,499 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:56:35,501 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/fc97ac99a6f540f78b9747e8c0bf56e1 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/fc97ac99a6f540f78b9747e8c0bf56e1 2023-03-06 11:56:35,502 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/e770fffdb0634de396b55e79293e1f56 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/e770fffdb0634de396b55e79293e1f56 2023-03-06 11:56:35,502 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/56d37dd17fb24a4293c0729ef800c7be_SeqId_46_ to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/56d37dd17fb24a4293c0729ef800c7be_SeqId_46_ 2023-03-06 11:56:35,503 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/fa633304868746d3973a3d7fe18fffd5_SeqId_49_ to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/family1/fa633304868746d3973a3d7fe18fffd5_SeqId_49_ 2023-03-06 11:56:35,564 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=ef9ef54c7efbc7abe164d4b72ed65cde, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:35,564 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=3ebcc443c84012d3eaff66f83852d128, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:35,564 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,,1678103794935.ef9ef54c7efbc7abe164d4b72ed65cde.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678103795564"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678103795564"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678103795564"}]},"ts":"1678103795564"} 2023-03-06 11:56:35,564 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=5ab54f31ef0cb025ca841c2c033280dc, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:35,564 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,1,1678103794935.3ebcc443c84012d3eaff66f83852d128.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1678103795564"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678103795564"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678103795564"}]},"ts":"1678103795564"} 2023-03-06 11:56:35,564 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,2,1678103794935.5ab54f31ef0cb025ca841c2c033280dc.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678103795564"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678103795564"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678103795564"}]},"ts":"1678103795564"} 2023-03-06 11:56:35,565 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=120, ppid=117, state=RUNNABLE; OpenRegionProcedure ef9ef54c7efbc7abe164d4b72ed65cde, server=jenkins-hbase5.apache.org,42547,1678103642479}] 2023-03-06 11:56:35,566 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=121, ppid=119, state=RUNNABLE; OpenRegionProcedure 5ab54f31ef0cb025ca841c2c033280dc, server=jenkins-hbase5.apache.org,42547,1678103642479}] 2023-03-06 11:56:35,566 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=122, ppid=118, state=RUNNABLE; OpenRegionProcedure 3ebcc443c84012d3eaff66f83852d128, server=jenkins-hbase5.apache.org,42547,1678103642479}] 2023-03-06 11:56:35,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-03-06 11:56:35,719 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,,1678103794935.ef9ef54c7efbc7abe164d4b72ed65cde. 2023-03-06 11:56:35,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ef9ef54c7efbc7abe164d4b72ed65cde, NAME => 'testMajorCompactionFromAdmin,,1678103794935.ef9ef54c7efbc7abe164d4b72ed65cde.', STARTKEY => '', ENDKEY => '1'} 2023-03-06 11:56:35,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin ef9ef54c7efbc7abe164d4b72ed65cde 2023-03-06 11:56:35,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1678103794935.ef9ef54c7efbc7abe164d4b72ed65cde.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-06 11:56:35,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for ef9ef54c7efbc7abe164d4b72ed65cde 2023-03-06 11:56:35,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for ef9ef54c7efbc7abe164d4b72ed65cde 2023-03-06 11:56:35,743 INFO [StoreOpener-ef9ef54c7efbc7abe164d4b72ed65cde-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region ef9ef54c7efbc7abe164d4b72ed65cde 2023-03-06 11:56:35,745 DEBUG [StoreOpener-ef9ef54c7efbc7abe164d4b72ed65cde-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/family1 2023-03-06 11:56:35,745 DEBUG [StoreOpener-ef9ef54c7efbc7abe164d4b72ed65cde-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/family1 2023-03-06 11:56:35,745 INFO [StoreOpener-ef9ef54c7efbc7abe164d4b72ed65cde-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ef9ef54c7efbc7abe164d4b72ed65cde columnFamilyName family1 2023-03-06 11:56:35,746 INFO [StoreOpener-ef9ef54c7efbc7abe164d4b72ed65cde-1] regionserver.HStore(310): Store=ef9ef54c7efbc7abe164d4b72ed65cde/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-06 11:56:35,746 INFO [StoreOpener-ef9ef54c7efbc7abe164d4b72ed65cde-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region ef9ef54c7efbc7abe164d4b72ed65cde 2023-03-06 11:56:35,747 DEBUG [StoreOpener-ef9ef54c7efbc7abe164d4b72ed65cde-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/family2 2023-03-06 11:56:35,747 DEBUG [StoreOpener-ef9ef54c7efbc7abe164d4b72ed65cde-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/family2 2023-03-06 11:56:35,747 INFO [StoreOpener-ef9ef54c7efbc7abe164d4b72ed65cde-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ef9ef54c7efbc7abe164d4b72ed65cde columnFamilyName family2 2023-03-06 11:56:35,748 INFO [StoreOpener-ef9ef54c7efbc7abe164d4b72ed65cde-1] regionserver.HStore(310): Store=ef9ef54c7efbc7abe164d4b72ed65cde/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-06 11:56:35,749 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde 2023-03-06 11:56:35,749 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde 2023-03-06 11:56:35,750 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-06 11:56:35,751 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for ef9ef54c7efbc7abe164d4b72ed65cde 2023-03-06 11:56:35,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-06 11:56:35,753 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened ef9ef54c7efbc7abe164d4b72ed65cde; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74129971, jitterRate=0.10462264716625214}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-06 11:56:35,753 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for ef9ef54c7efbc7abe164d4b72ed65cde: 2023-03-06 11:56:35,753 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,,1678103794935.ef9ef54c7efbc7abe164d4b72ed65cde., pid=120, masterSystemTime=1678103795717 2023-03-06 11:56:35,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,,1678103794935.ef9ef54c7efbc7abe164d4b72ed65cde. 2023-03-06 11:56:35,755 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,,1678103794935.ef9ef54c7efbc7abe164d4b72ed65cde. 2023-03-06 11:56:35,755 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,2,1678103794935.5ab54f31ef0cb025ca841c2c033280dc. 2023-03-06 11:56:35,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5ab54f31ef0cb025ca841c2c033280dc, NAME => 'testMajorCompactionFromAdmin,2,1678103794935.5ab54f31ef0cb025ca841c2c033280dc.', STARTKEY => '2', ENDKEY => ''} 2023-03-06 11:56:35,755 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=ef9ef54c7efbc7abe164d4b72ed65cde, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:35,755 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,,1678103794935.ef9ef54c7efbc7abe164d4b72ed65cde.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678103795755"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678103795755"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678103795755"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678103795755"}]},"ts":"1678103795755"} 2023-03-06 11:56:35,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 5ab54f31ef0cb025ca841c2c033280dc 2023-03-06 11:56:35,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1678103794935.5ab54f31ef0cb025ca841c2c033280dc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-06 11:56:35,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 5ab54f31ef0cb025ca841c2c033280dc 2023-03-06 11:56:35,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 5ab54f31ef0cb025ca841c2c033280dc 2023-03-06 11:56:35,757 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=120, resume processing ppid=117 2023-03-06 11:56:35,757 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=120, ppid=117, state=SUCCESS; OpenRegionProcedure ef9ef54c7efbc7abe164d4b72ed65cde, server=jenkins-hbase5.apache.org,42547,1678103642479 in 191 msec 2023-03-06 11:56:35,758 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=ef9ef54c7efbc7abe164d4b72ed65cde, ASSIGN in 347 msec 2023-03-06 11:56:35,775 INFO [StoreOpener-5ab54f31ef0cb025ca841c2c033280dc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 5ab54f31ef0cb025ca841c2c033280dc 2023-03-06 11:56:35,776 DEBUG [StoreOpener-5ab54f31ef0cb025ca841c2c033280dc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/family1 2023-03-06 11:56:35,776 DEBUG [StoreOpener-5ab54f31ef0cb025ca841c2c033280dc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/family1 2023-03-06 11:56:35,776 INFO [StoreOpener-5ab54f31ef0cb025ca841c2c033280dc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5ab54f31ef0cb025ca841c2c033280dc columnFamilyName family1 2023-03-06 11:56:35,777 INFO [StoreOpener-5ab54f31ef0cb025ca841c2c033280dc-1] regionserver.HStore(310): Store=5ab54f31ef0cb025ca841c2c033280dc/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-06 11:56:35,777 INFO [StoreOpener-5ab54f31ef0cb025ca841c2c033280dc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 5ab54f31ef0cb025ca841c2c033280dc 2023-03-06 11:56:35,778 DEBUG [StoreOpener-5ab54f31ef0cb025ca841c2c033280dc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/family2 2023-03-06 11:56:35,778 DEBUG [StoreOpener-5ab54f31ef0cb025ca841c2c033280dc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/family2 2023-03-06 11:56:35,779 INFO [StoreOpener-5ab54f31ef0cb025ca841c2c033280dc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5ab54f31ef0cb025ca841c2c033280dc columnFamilyName family2 2023-03-06 11:56:35,779 INFO [StoreOpener-5ab54f31ef0cb025ca841c2c033280dc-1] regionserver.HStore(310): Store=5ab54f31ef0cb025ca841c2c033280dc/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-06 11:56:35,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc 2023-03-06 11:56:35,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc 2023-03-06 11:56:35,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-06 11:56:35,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 5ab54f31ef0cb025ca841c2c033280dc 2023-03-06 11:56:35,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-06 11:56:35,784 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 5ab54f31ef0cb025ca841c2c033280dc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68178419, jitterRate=0.01593761146068573}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-06 11:56:35,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 5ab54f31ef0cb025ca841c2c033280dc: 2023-03-06 11:56:35,785 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,2,1678103794935.5ab54f31ef0cb025ca841c2c033280dc., pid=121, masterSystemTime=1678103795717 2023-03-06 11:56:35,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,2,1678103794935.5ab54f31ef0cb025ca841c2c033280dc. 2023-03-06 11:56:35,786 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,2,1678103794935.5ab54f31ef0cb025ca841c2c033280dc. 2023-03-06 11:56:35,786 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,1,1678103794935.3ebcc443c84012d3eaff66f83852d128. 2023-03-06 11:56:35,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3ebcc443c84012d3eaff66f83852d128, NAME => 'testMajorCompactionFromAdmin,1,1678103794935.3ebcc443c84012d3eaff66f83852d128.', STARTKEY => '1', ENDKEY => '2'} 2023-03-06 11:56:35,786 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=5ab54f31ef0cb025ca841c2c033280dc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:35,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 3ebcc443c84012d3eaff66f83852d128 2023-03-06 11:56:35,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1678103794935.3ebcc443c84012d3eaff66f83852d128.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-06 11:56:35,786 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,2,1678103794935.5ab54f31ef0cb025ca841c2c033280dc.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678103795786"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678103795786"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678103795786"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678103795786"}]},"ts":"1678103795786"} 2023-03-06 11:56:35,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 3ebcc443c84012d3eaff66f83852d128 2023-03-06 11:56:35,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 3ebcc443c84012d3eaff66f83852d128 2023-03-06 11:56:35,789 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=121, resume processing ppid=119 2023-03-06 11:56:35,789 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=121, ppid=119, state=SUCCESS; OpenRegionProcedure 5ab54f31ef0cb025ca841c2c033280dc, server=jenkins-hbase5.apache.org,42547,1678103642479 in 221 msec 2023-03-06 11:56:35,790 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=119, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=5ab54f31ef0cb025ca841c2c033280dc, ASSIGN in 379 msec 2023-03-06 11:56:35,807 INFO [StoreOpener-3ebcc443c84012d3eaff66f83852d128-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 3ebcc443c84012d3eaff66f83852d128 2023-03-06 11:56:35,808 DEBUG [StoreOpener-3ebcc443c84012d3eaff66f83852d128-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/family1 2023-03-06 11:56:35,808 DEBUG [StoreOpener-3ebcc443c84012d3eaff66f83852d128-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/family1 2023-03-06 11:56:35,808 INFO [StoreOpener-3ebcc443c84012d3eaff66f83852d128-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3ebcc443c84012d3eaff66f83852d128 columnFamilyName family1 2023-03-06 11:56:35,809 INFO [StoreOpener-3ebcc443c84012d3eaff66f83852d128-1] regionserver.HStore(310): Store=3ebcc443c84012d3eaff66f83852d128/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-06 11:56:35,809 INFO [StoreOpener-3ebcc443c84012d3eaff66f83852d128-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 3ebcc443c84012d3eaff66f83852d128 2023-03-06 11:56:35,810 DEBUG [StoreOpener-3ebcc443c84012d3eaff66f83852d128-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/family2 2023-03-06 11:56:35,810 DEBUG [StoreOpener-3ebcc443c84012d3eaff66f83852d128-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/family2 2023-03-06 11:56:35,811 INFO [StoreOpener-3ebcc443c84012d3eaff66f83852d128-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3ebcc443c84012d3eaff66f83852d128 columnFamilyName family2 2023-03-06 11:56:35,811 INFO [StoreOpener-3ebcc443c84012d3eaff66f83852d128-1] regionserver.HStore(310): Store=3ebcc443c84012d3eaff66f83852d128/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-06 11:56:35,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128 2023-03-06 11:56:35,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128 2023-03-06 11:56:35,813 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-06 11:56:35,814 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 3ebcc443c84012d3eaff66f83852d128 2023-03-06 11:56:35,815 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-06 11:56:35,816 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 3ebcc443c84012d3eaff66f83852d128; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72057957, jitterRate=0.07374723255634308}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-06 11:56:35,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 3ebcc443c84012d3eaff66f83852d128: 2023-03-06 11:56:35,816 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,1,1678103794935.3ebcc443c84012d3eaff66f83852d128., pid=122, masterSystemTime=1678103795717 2023-03-06 11:56:35,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,1,1678103794935.3ebcc443c84012d3eaff66f83852d128. 2023-03-06 11:56:35,818 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,1,1678103794935.3ebcc443c84012d3eaff66f83852d128. 2023-03-06 11:56:35,818 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=3ebcc443c84012d3eaff66f83852d128, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:35,818 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,1,1678103794935.3ebcc443c84012d3eaff66f83852d128.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1678103795818"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678103795818"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678103795818"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678103795818"}]},"ts":"1678103795818"} 2023-03-06 11:56:35,820 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=122, resume processing ppid=118 2023-03-06 11:56:35,820 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=122, ppid=118, state=SUCCESS; OpenRegionProcedure 3ebcc443c84012d3eaff66f83852d128, server=jenkins-hbase5.apache.org,42547,1678103642479 in 253 msec 2023-03-06 11:56:35,821 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-03-06 11:56:35,821 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=3ebcc443c84012d3eaff66f83852d128, ASSIGN in 410 msec 2023-03-06 11:56:35,822 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-06 11:56:35,822 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678103795822"}]},"ts":"1678103795822"} 2023-03-06 11:56:35,823 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLED in hbase:meta 2023-03-06 11:56:35,826 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_POST_OPERATION 2023-03-06 11:56:35,827 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=116, state=SUCCESS; CreateTableProcedure table=testMajorCompactionFromAdmin in 854 msec 2023-03-06 11:56:36,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-03-06 11:56:36,079 INFO [Listener at localhost/46717] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionFromAdmin, procId: 116 completed 2023-03-06 11:56:36,089 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1678103794935.ef9ef54c7efbc7abe164d4b72ed65cde. with WAL disabled. Data may be lost in the event of a crash. 2023-03-06 11:56:36,090 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1678103794935.3ebcc443c84012d3eaff66f83852d128. with WAL disabled. Data may be lost in the event of a crash. 2023-03-06 11:56:36,090 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1678103794935.5ab54f31ef0cb025ca841c2c033280dc. with WAL disabled. Data may be lost in the event of a crash. 2023-03-06 11:56:36,092 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:56:36,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-03-06 11:56:36,094 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-03-06 11:56:36,094 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:56:36,094 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-03-06 11:56:36,094 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-03-06 11:56:36,094 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-06 11:56:36,094 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-06 11:56:36,095 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:56:36,095 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:36,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:56:36,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:56:36,096 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:36,096 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:56:36,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-06 11:56:36,096 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-06 11:56:36,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:56:36,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-06 11:56:36,096 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-03-06 11:56:36,097 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-03-06 11:56:36,097 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-03-06 11:56:36,097 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:56:36,097 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-03-06 11:56:36,097 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1678103794935.ef9ef54c7efbc7abe164d4b72ed65cde. 2023-03-06 11:56:36,097 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1678103794935.3ebcc443c84012d3eaff66f83852d128. 2023-03-06 11:56:36,097 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1678103794935.5ab54f31ef0cb025ca841c2c033280dc. 2023-03-06 11:56:36,097 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-06 11:56:36,097 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:56:36,097 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1678103794935.ef9ef54c7efbc7abe164d4b72ed65cde. started... 2023-03-06 11:56:36,097 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1678103794935.5ab54f31ef0cb025ca841c2c033280dc. started... 2023-03-06 11:56:36,097 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1678103794935.3ebcc443c84012d3eaff66f83852d128. started... 2023-03-06 11:56:36,098 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ef9ef54c7efbc7abe164d4b72ed65cde 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-06 11:56:36,099 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 5ab54f31ef0cb025ca841c2c033280dc 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-06 11:56:36,099 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 3ebcc443c84012d3eaff66f83852d128 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-06 11:56:36,576 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303067abdb91ab9934c61b293b1cfab84fc4a to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202303067abdb91ab9934c61b293b1cfab84fc4a 2023-03-06 11:56:36,576 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230306cb90f30096924d78aefad3459c3cb0bf to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230306cb90f30096924d78aefad3459c3cb0bf 2023-03-06 11:56:36,585 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230306be93a56ef8414e8da1c42e531d196a6c to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230306be93a56ef8414e8da1c42e531d196a6c 2023-03-06 11:56:36,603 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/.tmp/family1/7ea358e875704829a51c766093de73f6 2023-03-06 11:56:36,607 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/.tmp/family1/65ad548a1bf64f77941288fc6e7725e6 2023-03-06 11:56:37,019 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/.tmp/family1/154e0ca0690e407580f979a6cd8d6157 2023-03-06 11:56:37,058 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230306e42f79085d57491d90193d8c6d9ac9b7 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230306e42f79085d57491d90193d8c6d9ac9b7 2023-03-06 11:56:37,058 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230306dab961d3d039418ba769d110709337bc to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230306dab961d3d039418ba769d110709337bc 2023-03-06 11:56:37,452 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023030646d463438eae41d9b9aff90d913e0406 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e2023030646d463438eae41d9b9aff90d913e0406 2023-03-06 11:56:37,462 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/.tmp/family2/1ba9efff42dd4e5b9e09db8cbd618aaa 2023-03-06 11:56:37,462 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/.tmp/family2/d0c5e0c28e774a799bbca96ab976e99e 2023-03-06 11:56:37,465 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/.tmp/family1/7ea358e875704829a51c766093de73f6 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/family1/7ea358e875704829a51c766093de73f6 2023-03-06 11:56:37,465 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/.tmp/family1/65ad548a1bf64f77941288fc6e7725e6 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/family1/65ad548a1bf64f77941288fc6e7725e6 2023-03-06 11:56:37,489 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/family1/7ea358e875704829a51c766093de73f6, entries=4, sequenceid=5, filesize=5.5 K 2023-03-06 11:56:37,489 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/family1/65ad548a1bf64f77941288fc6e7725e6, entries=4, sequenceid=5, filesize=5.5 K 2023-03-06 11:56:37,490 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/.tmp/family2/1ba9efff42dd4e5b9e09db8cbd618aaa as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/family2/1ba9efff42dd4e5b9e09db8cbd618aaa 2023-03-06 11:56:37,490 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/.tmp/family2/d0c5e0c28e774a799bbca96ab976e99e as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/family2/d0c5e0c28e774a799bbca96ab976e99e 2023-03-06 11:56:37,493 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/family2/1ba9efff42dd4e5b9e09db8cbd618aaa, entries=2, sequenceid=5, filesize=5.1 K 2023-03-06 11:56:37,493 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/family2/d0c5e0c28e774a799bbca96ab976e99e, entries=2, sequenceid=5, filesize=5.1 K 2023-03-06 11:56:37,494 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 3ebcc443c84012d3eaff66f83852d128 in 1395ms, sequenceid=5, compaction requested=false 2023-03-06 11:56:37,494 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 5ab54f31ef0cb025ca841c2c033280dc in 1395ms, sequenceid=5, compaction requested=false 2023-03-06 11:56:37,494 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionFromAdmin' 2023-03-06 11:56:37,494 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionFromAdmin' 2023-03-06 11:56:37,495 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 3ebcc443c84012d3eaff66f83852d128: 2023-03-06 11:56:37,495 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 5ab54f31ef0cb025ca841c2c033280dc: 2023-03-06 11:56:37,495 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1678103794935.3ebcc443c84012d3eaff66f83852d128. 2023-03-06 11:56:37,495 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1678103794935.5ab54f31ef0cb025ca841c2c033280dc. 2023-03-06 11:56:37,496 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-06 11:56:37,496 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-06 11:56:37,857 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/.tmp/family2/3c015c157bdf4153b5a08873316d428a 2023-03-06 11:56:37,860 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/.tmp/family1/154e0ca0690e407580f979a6cd8d6157 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/family1/154e0ca0690e407580f979a6cd8d6157 2023-03-06 11:56:37,883 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/family1/154e0ca0690e407580f979a6cd8d6157, entries=4, sequenceid=5, filesize=5.5 K 2023-03-06 11:56:37,884 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/.tmp/family2/3c015c157bdf4153b5a08873316d428a as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/family2/3c015c157bdf4153b5a08873316d428a 2023-03-06 11:56:37,887 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/family2/3c015c157bdf4153b5a08873316d428a, entries=2, sequenceid=5, filesize=5.1 K 2023-03-06 11:56:37,888 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for ef9ef54c7efbc7abe164d4b72ed65cde in 1790ms, sequenceid=5, compaction requested=false 2023-03-06 11:56:37,888 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ef9ef54c7efbc7abe164d4b72ed65cde: 2023-03-06 11:56:37,888 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1678103794935.ef9ef54c7efbc7abe164d4b72ed65cde. 2023-03-06 11:56:37,888 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-06 11:56:37,888 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-06 11:56:37,888 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:37,888 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-03-06 11:56:37,888 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-03-06 11:56:37,895 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-06 11:56:37,895 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:37,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:37,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:56:37,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:56:37,896 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-06 11:56:37,896 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:56:37,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:56:37,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:56:37,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-06 11:56:37,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:37,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:56:37,897 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-03-06 11:56:37,897 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5e4179d6[Count = 0] remaining members to acquire global barrier 2023-03-06 11:56:37,897 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-03-06 11:56:37,897 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-06 11:56:37,898 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-06 11:56:37,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-06 11:56:37,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-06 11:56:37,898 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-03-06 11:56:37,898 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-03-06 11:56:37,898 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:56:37,898 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:37,898 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:56:37,899 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:37,899 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-03-06 11:56:37,899 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:56:37,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:37,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:56:37,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:56:37,899 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-03-06 11:56:37,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:56:37,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:56:37,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-06 11:56:37,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:37,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:56:37,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-06 11:56:37,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:37,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:56:37,901 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-03-06 11:56:37,901 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-03-06 11:56:37,901 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:56:37,901 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:56:37,901 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-03-06 11:56:37,902 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:56:37,903 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-06 11:56:37,903 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-06 11:56:37,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-06 11:56:37,903 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:56:37,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-06 11:56:37,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-06 11:56:37,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:56:37,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:56:37,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:56:37,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:56:37,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:56:37,903 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:37,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-06 11:56:37,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-06 11:56:37,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:56:37,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-06 11:56:37,904 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:37,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:37,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:56:37,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-06 11:56:37,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:37,908 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:37,908 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-06 11:56:37,908 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:56:37,908 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-06 11:56:37,908 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:56:37,908 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:37,908 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-03-06 11:56:37,908 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:56:37,908 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-06 11:56:37,908 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:56:37,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:56:37,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:56:37,908 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-06 11:56:37,908 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-06 11:56:37,908 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-03-06 11:56:37,908 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:56:37,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:56:37,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:56:38,008 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:56:38,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:56:38,010 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1678103794935.ef9ef54c7efbc7abe164d4b72ed65cde. with WAL disabled. Data may be lost in the event of a crash. 2023-03-06 11:56:38,010 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1678103794935.3ebcc443c84012d3eaff66f83852d128. with WAL disabled. Data may be lost in the event of a crash. 2023-03-06 11:56:38,011 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1678103794935.5ab54f31ef0cb025ca841c2c033280dc. with WAL disabled. Data may be lost in the event of a crash. 2023-03-06 11:56:38,013 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:56:38,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-03-06 11:56:38,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-03-06 11:56:38,015 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-03-06 11:56:38,015 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:56:38,015 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-03-06 11:56:38,015 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-03-06 11:56:38,015 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-06 11:56:38,015 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-06 11:56:38,017 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:38,017 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:56:38,017 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:56:38,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:56:38,017 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:38,017 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:56:38,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-06 11:56:38,017 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-06 11:56:38,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:56:38,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-06 11:56:38,018 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-03-06 11:56:38,018 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-03-06 11:56:38,018 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-03-06 11:56:38,018 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-03-06 11:56:38,018 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:56:38,018 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-03-06 11:56:38,018 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1678103794935.ef9ef54c7efbc7abe164d4b72ed65cde. 2023-03-06 11:56:38,018 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1678103794935.3ebcc443c84012d3eaff66f83852d128. 2023-03-06 11:56:38,018 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1678103794935.ef9ef54c7efbc7abe164d4b72ed65cde. started... 2023-03-06 11:56:38,019 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1678103794935.3ebcc443c84012d3eaff66f83852d128. started... 2023-03-06 11:56:38,019 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ef9ef54c7efbc7abe164d4b72ed65cde 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-06 11:56:38,019 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 3ebcc443c84012d3eaff66f83852d128 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-06 11:56:38,019 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-06 11:56:38,019 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:56:38,020 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1678103794935.5ab54f31ef0cb025ca841c2c033280dc. 2023-03-06 11:56:38,020 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1678103794935.5ab54f31ef0cb025ca841c2c033280dc. started... 2023-03-06 11:56:38,020 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 5ab54f31ef0cb025ca841c2c033280dc 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-06 11:56:38,065 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230306baabacdfe0354a3d95d3bdb3b2c004af to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230306baabacdfe0354a3d95d3bdb3b2c004af 2023-03-06 11:56:38,469 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303062ffe1588a2da4d4ab6c1e3c5d53b92e9 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202303062ffe1588a2da4d4ab6c1e3c5d53b92e9 2023-03-06 11:56:38,475 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023030627e6a4e5da094f13972f5d4912f9efcf to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023030627e6a4e5da094f13972f5d4912f9efcf 2023-03-06 11:56:38,479 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/.tmp/family1/2f3caf064d3649fa83e4f5fdd0346710 2023-03-06 11:56:38,887 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/.tmp/family1/cb53833240b34b63865eef94a3aa6194 2023-03-06 11:56:38,894 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/.tmp/family1/6fe3a35b99c84c55ad3aee32057891c8 2023-03-06 11:56:38,918 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230306ce20de7ddef540ed941e16421edabad6 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230306ce20de7ddef540ed941e16421edabad6 2023-03-06 11:56:38,935 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230306745bb1d3325e420bbf3597636abc2264 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230306745bb1d3325e420bbf3597636abc2264 2023-03-06 11:56:39,326 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230306b102c373d2fe4dc5bcd7bcb66e336294 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230306b102c373d2fe4dc5bcd7bcb66e336294 2023-03-06 11:56:39,331 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/.tmp/family2/1e8c2c661f59474cafbb672ccba67c2f 2023-03-06 11:56:39,335 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/.tmp/family1/2f3caf064d3649fa83e4f5fdd0346710 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/family1/2f3caf064d3649fa83e4f5fdd0346710 2023-03-06 11:56:39,339 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/.tmp/family2/b5507e72f4b24f2a8adb2bf0db9046af 2023-03-06 11:56:39,342 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/.tmp/family1/6fe3a35b99c84c55ad3aee32057891c8 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/family1/6fe3a35b99c84c55ad3aee32057891c8 2023-03-06 11:56:39,358 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/family1/2f3caf064d3649fa83e4f5fdd0346710, entries=4, sequenceid=9, filesize=5.5 K 2023-03-06 11:56:39,358 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/.tmp/family2/1e8c2c661f59474cafbb672ccba67c2f as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/family2/1e8c2c661f59474cafbb672ccba67c2f 2023-03-06 11:56:39,362 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/family2/1e8c2c661f59474cafbb672ccba67c2f, entries=2, sequenceid=9, filesize=5.1 K 2023-03-06 11:56:39,362 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 3ebcc443c84012d3eaff66f83852d128 in 1343ms, sequenceid=9, compaction requested=false 2023-03-06 11:56:39,363 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 3ebcc443c84012d3eaff66f83852d128: 2023-03-06 11:56:39,363 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1678103794935.3ebcc443c84012d3eaff66f83852d128. 2023-03-06 11:56:39,363 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-06 11:56:39,365 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/family1/6fe3a35b99c84c55ad3aee32057891c8, entries=4, sequenceid=9, filesize=5.5 K 2023-03-06 11:56:39,365 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/.tmp/family2/b5507e72f4b24f2a8adb2bf0db9046af as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/family2/b5507e72f4b24f2a8adb2bf0db9046af 2023-03-06 11:56:39,368 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/family2/b5507e72f4b24f2a8adb2bf0db9046af, entries=2, sequenceid=9, filesize=5.1 K 2023-03-06 11:56:39,369 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 5ab54f31ef0cb025ca841c2c033280dc in 1349ms, sequenceid=9, compaction requested=false 2023-03-06 11:56:39,369 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 5ab54f31ef0cb025ca841c2c033280dc: 2023-03-06 11:56:39,369 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1678103794935.5ab54f31ef0cb025ca841c2c033280dc. 2023-03-06 11:56:39,369 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-06 11:56:39,730 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/.tmp/family2/e6bc13037127490c8ebe0a756355f62f 2023-03-06 11:56:39,734 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/.tmp/family1/cb53833240b34b63865eef94a3aa6194 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/family1/cb53833240b34b63865eef94a3aa6194 2023-03-06 11:56:39,756 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/family1/cb53833240b34b63865eef94a3aa6194, entries=4, sequenceid=9, filesize=5.5 K 2023-03-06 11:56:39,757 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/.tmp/family2/e6bc13037127490c8ebe0a756355f62f as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/family2/e6bc13037127490c8ebe0a756355f62f 2023-03-06 11:56:39,761 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/family2/e6bc13037127490c8ebe0a756355f62f, entries=2, sequenceid=9, filesize=5.1 K 2023-03-06 11:56:39,762 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for ef9ef54c7efbc7abe164d4b72ed65cde in 1743ms, sequenceid=9, compaction requested=false 2023-03-06 11:56:39,762 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ef9ef54c7efbc7abe164d4b72ed65cde: 2023-03-06 11:56:39,762 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1678103794935.ef9ef54c7efbc7abe164d4b72ed65cde. 2023-03-06 11:56:39,762 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-06 11:56:39,762 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-06 11:56:39,762 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:39,762 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-03-06 11:56:39,762 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-03-06 11:56:39,764 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-06 11:56:39,764 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:39,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:39,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:56:39,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:56:39,765 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-06 11:56:39,765 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:56:39,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:56:39,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:56:39,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-06 11:56:39,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:39,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:56:39,766 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-03-06 11:56:39,766 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@34009271[Count = 0] remaining members to acquire global barrier 2023-03-06 11:56:39,766 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-03-06 11:56:39,766 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-06 11:56:39,767 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-06 11:56:39,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-06 11:56:39,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-06 11:56:39,767 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-03-06 11:56:39,767 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-03-06 11:56:39,767 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:56:39,767 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:39,767 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:56:39,768 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-03-06 11:56:39,768 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:56:39,768 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:39,768 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-03-06 11:56:39,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:39,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:56:39,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:56:39,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:56:39,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:56:39,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-06 11:56:39,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:39,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:56:39,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-06 11:56:39,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:39,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:56:39,771 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-03-06 11:56:39,771 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-03-06 11:56:39,771 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:56:39,771 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:56:39,771 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-03-06 11:56:39,771 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:56:39,772 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-06 11:56:39,772 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-06 11:56:39,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-06 11:56:39,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-06 11:56:39,772 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:56:39,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-06 11:56:39,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:56:39,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:56:39,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:56:39,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:56:39,773 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:39,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:56:39,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-06 11:56:39,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-06 11:56:39,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:56:39,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-06 11:56:39,774 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:39,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:39,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:56:39,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-06 11:56:39,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:39,777 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:39,777 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:56:39,777 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-06 11:56:39,777 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:56:39,777 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-03-06 11:56:39,777 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:56:39,777 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-03-06 11:56:39,777 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:56:39,777 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-06 11:56:39,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:56:39,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:56:39,777 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:39,777 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-03-06 11:56:39,777 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:56:39,777 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-06 11:56:39,778 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-06 11:56:39,778 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:56:39,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:56:39,778 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-06 11:56:39,878 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:56:39,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:56:39,879 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1678103794935.ef9ef54c7efbc7abe164d4b72ed65cde. with WAL disabled. Data may be lost in the event of a crash. 2023-03-06 11:56:39,879 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1678103794935.3ebcc443c84012d3eaff66f83852d128. with WAL disabled. Data may be lost in the event of a crash. 2023-03-06 11:56:39,880 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1678103794935.5ab54f31ef0cb025ca841c2c033280dc. with WAL disabled. Data may be lost in the event of a crash. 2023-03-06 11:56:39,881 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:56:39,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-03-06 11:56:39,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-03-06 11:56:39,883 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-03-06 11:56:39,883 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:56:39,883 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-03-06 11:56:39,883 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-03-06 11:56:39,883 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-06 11:56:39,883 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-06 11:56:39,884 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:56:39,884 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:39,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:56:39,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:56:39,885 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:39,885 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:56:39,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-06 11:56:39,885 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-06 11:56:39,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:56:39,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-06 11:56:39,885 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-03-06 11:56:39,886 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-03-06 11:56:39,886 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-03-06 11:56:39,886 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-03-06 11:56:39,886 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:56:39,886 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-03-06 11:56:39,886 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1678103794935.ef9ef54c7efbc7abe164d4b72ed65cde. 2023-03-06 11:56:39,886 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-06 11:56:39,886 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1678103794935.3ebcc443c84012d3eaff66f83852d128. 2023-03-06 11:56:39,886 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1678103794935.5ab54f31ef0cb025ca841c2c033280dc. 2023-03-06 11:56:39,886 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1678103794935.5ab54f31ef0cb025ca841c2c033280dc. started... 2023-03-06 11:56:39,886 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:56:39,886 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1678103794935.ef9ef54c7efbc7abe164d4b72ed65cde. started... 2023-03-06 11:56:39,886 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1678103794935.3ebcc443c84012d3eaff66f83852d128. started... 2023-03-06 11:56:39,886 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 5ab54f31ef0cb025ca841c2c033280dc 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-06 11:56:39,886 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 3ebcc443c84012d3eaff66f83852d128 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-06 11:56:39,886 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ef9ef54c7efbc7abe164d4b72ed65cde 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-06 11:56:40,327 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230306a47aeada1cc54dcb885f656626c29bf8 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230306a47aeada1cc54dcb885f656626c29bf8 2023-03-06 11:56:40,327 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303068641a7ab23f948a9b2cb51deaf4e797c to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303068641a7ab23f948a9b2cb51deaf4e797c 2023-03-06 11:56:40,333 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023030624ecc6b7bdce4fe2b251893d370c4755 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023030624ecc6b7bdce4fe2b251893d370c4755 2023-03-06 11:56:40,349 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/.tmp/family1/f76f9c680ecb4b33a2dd1cd2e8f4b236 2023-03-06 11:56:40,746 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/.tmp/family1/5951a11a8dfa49a3a5b675e3fa8e2584 2023-03-06 11:56:40,749 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/.tmp/family1/bd15825e1f714713bbc55901d57a4739 2023-03-06 11:56:40,781 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230306f853ce8999c748d1a2eef05f164bfd32 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230306f853ce8999c748d1a2eef05f164bfd32 2023-03-06 11:56:40,784 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230306784b175bc389474fadbcaa6f674cde70 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230306784b175bc389474fadbcaa6f674cde70 2023-03-06 11:56:40,785 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/.tmp/family2/02fe6ed4526e4b5985ce763a34066507 2023-03-06 11:56:40,788 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/.tmp/family1/f76f9c680ecb4b33a2dd1cd2e8f4b236 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/family1/f76f9c680ecb4b33a2dd1cd2e8f4b236 2023-03-06 11:56:40,811 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/family1/f76f9c680ecb4b33a2dd1cd2e8f4b236, entries=4, sequenceid=13, filesize=5.5 K 2023-03-06 11:56:40,811 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/.tmp/family2/02fe6ed4526e4b5985ce763a34066507 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/family2/02fe6ed4526e4b5985ce763a34066507 2023-03-06 11:56:40,815 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/family2/02fe6ed4526e4b5985ce763a34066507, entries=2, sequenceid=13, filesize=5.1 K 2023-03-06 11:56:40,815 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for ef9ef54c7efbc7abe164d4b72ed65cde in 929ms, sequenceid=13, compaction requested=true 2023-03-06 11:56:40,815 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ef9ef54c7efbc7abe164d4b72ed65cde: 2023-03-06 11:56:40,815 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1678103794935.ef9ef54c7efbc7abe164d4b72ed65cde. 2023-03-06 11:56:40,815 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-06 11:56:41,182 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230306173bebca98ef44959fc6f8294ae7a518 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230306173bebca98ef44959fc6f8294ae7a518 2023-03-06 11:56:41,189 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/.tmp/family2/6a0d40a60a09481292d173f872f75c33 2023-03-06 11:56:41,192 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/.tmp/family1/bd15825e1f714713bbc55901d57a4739 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/family1/bd15825e1f714713bbc55901d57a4739 2023-03-06 11:56:41,215 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/family1/bd15825e1f714713bbc55901d57a4739, entries=4, sequenceid=13, filesize=5.5 K 2023-03-06 11:56:41,216 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/.tmp/family2/6a0d40a60a09481292d173f872f75c33 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/family2/6a0d40a60a09481292d173f872f75c33 2023-03-06 11:56:41,220 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/family2/6a0d40a60a09481292d173f872f75c33, entries=2, sequenceid=13, filesize=5.1 K 2023-03-06 11:56:41,220 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 5ab54f31ef0cb025ca841c2c033280dc in 1334ms, sequenceid=13, compaction requested=true 2023-03-06 11:56:41,220 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 5ab54f31ef0cb025ca841c2c033280dc: 2023-03-06 11:56:41,221 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1678103794935.5ab54f31ef0cb025ca841c2c033280dc. 2023-03-06 11:56:41,221 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-06 11:56:41,258 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-06 11:56:41,310 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-06 11:56:41,310 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2c3f2136 to 127.0.0.1:62659 2023-03-06 11:56:41,310 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-06 11:56:41,311 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-06 11:56:41,311 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1b0d336b to 127.0.0.1:62659 2023-03-06 11:56:41,311 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-06 11:56:41,587 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/.tmp/family2/981e2bca95624f67af84b80ac4c7690b 2023-03-06 11:56:41,591 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/.tmp/family1/5951a11a8dfa49a3a5b675e3fa8e2584 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/family1/5951a11a8dfa49a3a5b675e3fa8e2584 2023-03-06 11:56:41,612 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/family1/5951a11a8dfa49a3a5b675e3fa8e2584, entries=4, sequenceid=13, filesize=5.5 K 2023-03-06 11:56:41,613 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/.tmp/family2/981e2bca95624f67af84b80ac4c7690b as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/family2/981e2bca95624f67af84b80ac4c7690b 2023-03-06 11:56:41,616 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/family2/981e2bca95624f67af84b80ac4c7690b, entries=2, sequenceid=13, filesize=5.1 K 2023-03-06 11:56:41,617 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 3ebcc443c84012d3eaff66f83852d128 in 1731ms, sequenceid=13, compaction requested=true 2023-03-06 11:56:41,617 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 3ebcc443c84012d3eaff66f83852d128: 2023-03-06 11:56:41,617 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1678103794935.3ebcc443c84012d3eaff66f83852d128. 2023-03-06 11:56:41,617 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-06 11:56:41,617 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-06 11:56:41,617 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:41,617 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-03-06 11:56:41,617 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-03-06 11:56:41,619 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:41,619 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-06 11:56:41,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:41,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:56:41,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:56:41,619 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-06 11:56:41,619 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:56:41,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:56:41,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:56:41,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-06 11:56:41,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:41,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:56:41,620 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-03-06 11:56:41,620 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@48be318f[Count = 0] remaining members to acquire global barrier 2023-03-06 11:56:41,620 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-03-06 11:56:41,620 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-06 11:56:41,621 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-06 11:56:41,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-06 11:56:41,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-06 11:56:41,621 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-03-06 11:56:41,621 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-03-06 11:56:41,621 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:56:41,621 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:41,621 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:56:41,623 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-03-06 11:56:41,623 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:56:41,623 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:41,623 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-03-06 11:56:41,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:41,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:56:41,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:56:41,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:56:41,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:56:41,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-06 11:56:41,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:41,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:56:41,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-06 11:56:41,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:41,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:56:41,625 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-03-06 11:56:41,625 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-03-06 11:56:41,625 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:56:41,625 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:56:41,625 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-03-06 11:56:41,625 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:56:41,626 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-06 11:56:41,626 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-06 11:56:41,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-06 11:56:41,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:56:41,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:56:41,626 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-06 11:56:41,626 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:56:41,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-06 11:56:41,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:56:41,627 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:56:41,627 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:41,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:56:41,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-06 11:56:41,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-06 11:56:41,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:56:41,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-06 11:56:41,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:41,628 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:41,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:56:41,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-06 11:56:41,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:41,629 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:41,629 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:56:41,629 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-06 11:56:41,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:56:41,630 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-06 11:56:41,630 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-03-06 11:56:41,630 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:56:41,630 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:56:41,630 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:56:41,630 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:41,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:56:41,630 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-06 11:56:41,630 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-03-06 11:56:41,630 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:56:41,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:56:41,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:56:41,630 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-06 11:56:41,630 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-06 11:56:41,730 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:56:41,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:56:41,732 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1678103794935.ef9ef54c7efbc7abe164d4b72ed65cde. with WAL disabled. Data may be lost in the event of a crash. 2023-03-06 11:56:41,732 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1678103794935.3ebcc443c84012d3eaff66f83852d128. with WAL disabled. Data may be lost in the event of a crash. 2023-03-06 11:56:41,732 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1678103794935.5ab54f31ef0cb025ca841c2c033280dc. with WAL disabled. Data may be lost in the event of a crash. 2023-03-06 11:56:41,734 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:56:41,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-03-06 11:56:41,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-03-06 11:56:41,735 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-03-06 11:56:41,736 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:56:41,736 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-03-06 11:56:41,736 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-03-06 11:56:41,736 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-06 11:56:41,736 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-06 11:56:41,742 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:56:41,742 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:41,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:56:41,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:56:41,743 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:41,743 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:56:41,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-06 11:56:41,743 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-06 11:56:41,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:56:41,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-06 11:56:41,743 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-03-06 11:56:41,743 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-03-06 11:56:41,743 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-03-06 11:56:41,744 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-03-06 11:56:41,744 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:56:41,744 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-03-06 11:56:41,744 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1678103794935.ef9ef54c7efbc7abe164d4b72ed65cde. 2023-03-06 11:56:41,744 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-06 11:56:41,744 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1678103794935.ef9ef54c7efbc7abe164d4b72ed65cde. started... 2023-03-06 11:56:41,744 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:56:41,744 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1678103794935.5ab54f31ef0cb025ca841c2c033280dc. 2023-03-06 11:56:41,744 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1678103794935.3ebcc443c84012d3eaff66f83852d128. 2023-03-06 11:56:41,744 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ef9ef54c7efbc7abe164d4b72ed65cde 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-06 11:56:41,744 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1678103794935.5ab54f31ef0cb025ca841c2c033280dc. started... 2023-03-06 11:56:41,744 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1678103794935.3ebcc443c84012d3eaff66f83852d128. started... 2023-03-06 11:56:41,744 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 5ab54f31ef0cb025ca841c2c033280dc 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-06 11:56:41,744 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 3ebcc443c84012d3eaff66f83852d128 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-06 11:56:41,785 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023030681d6da7a24c543fca9e0ba6a4fcd660f to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023030681d6da7a24c543fca9e0ba6a4fcd660f 2023-03-06 11:56:42,188 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230306910b59ec05e34d5a985f1e32acfdda17 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230306910b59ec05e34d5a985f1e32acfdda17 2023-03-06 11:56:42,189 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303068980e1603d284bb19ce4624cc7f3e880 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202303068980e1603d284bb19ce4624cc7f3e880 2023-03-06 11:56:42,199 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/.tmp/family1/a8e02573ca824e8dbf01b9f3079f4e77 2023-03-06 11:56:42,212 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/.tmp/family1/11f2cb27a80f47f9a90c112958a07fce 2023-03-06 11:56:42,231 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/.tmp/family1/1d1df69aad8947c2848b455bf32a1a3f 2023-03-06 11:56:42,289 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230306d06c93d11cb441339bfc4a6a379cc076 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230306d06c93d11cb441339bfc4a6a379cc076 2023-03-06 11:56:42,687 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230306edac69362c1d41efa5fafee8e62d7a2e to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230306edac69362c1d41efa5fafee8e62d7a2e 2023-03-06 11:56:42,687 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230306374d29310ea6492eb98d11a7d3d8186c to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230306374d29310ea6492eb98d11a7d3d8186c 2023-03-06 11:56:42,698 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/.tmp/family2/57ed9a73a22640f6a9dffb338eb99f1f 2023-03-06 11:56:42,701 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/.tmp/family1/1d1df69aad8947c2848b455bf32a1a3f as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/family1/1d1df69aad8947c2848b455bf32a1a3f 2023-03-06 11:56:42,724 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/family1/1d1df69aad8947c2848b455bf32a1a3f, entries=4, sequenceid=17, filesize=5.5 K 2023-03-06 11:56:42,725 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/.tmp/family2/57ed9a73a22640f6a9dffb338eb99f1f as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/family2/57ed9a73a22640f6a9dffb338eb99f1f 2023-03-06 11:56:42,728 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/family2/57ed9a73a22640f6a9dffb338eb99f1f, entries=2, sequenceid=17, filesize=5.1 K 2023-03-06 11:56:42,729 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 5ab54f31ef0cb025ca841c2c033280dc in 985ms, sequenceid=17, compaction requested=true 2023-03-06 11:56:42,729 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 5ab54f31ef0cb025ca841c2c033280dc: 2023-03-06 11:56:42,729 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1678103794935.5ab54f31ef0cb025ca841c2c033280dc. 2023-03-06 11:56:42,729 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-06 11:56:43,091 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/.tmp/family2/8e1855f43ca1415c98bd948bddf9402a 2023-03-06 11:56:43,092 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/.tmp/family2/5f7a0d85731d4cf09143ae40ce645266 2023-03-06 11:56:43,097 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/.tmp/family1/11f2cb27a80f47f9a90c112958a07fce as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/family1/11f2cb27a80f47f9a90c112958a07fce 2023-03-06 11:56:43,097 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/.tmp/family1/a8e02573ca824e8dbf01b9f3079f4e77 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/family1/a8e02573ca824e8dbf01b9f3079f4e77 2023-03-06 11:56:43,130 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/family1/11f2cb27a80f47f9a90c112958a07fce, entries=4, sequenceid=17, filesize=5.5 K 2023-03-06 11:56:43,130 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/family1/a8e02573ca824e8dbf01b9f3079f4e77, entries=4, sequenceid=17, filesize=5.5 K 2023-03-06 11:56:43,130 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/.tmp/family2/8e1855f43ca1415c98bd948bddf9402a as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/family2/8e1855f43ca1415c98bd948bddf9402a 2023-03-06 11:56:43,131 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/.tmp/family2/5f7a0d85731d4cf09143ae40ce645266 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/family2/5f7a0d85731d4cf09143ae40ce645266 2023-03-06 11:56:43,134 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/family2/5f7a0d85731d4cf09143ae40ce645266, entries=2, sequenceid=17, filesize=5.1 K 2023-03-06 11:56:43,135 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/family2/8e1855f43ca1415c98bd948bddf9402a, entries=2, sequenceid=17, filesize=5.1 K 2023-03-06 11:56:43,135 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 3ebcc443c84012d3eaff66f83852d128 in 1391ms, sequenceid=17, compaction requested=true 2023-03-06 11:56:43,135 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for ef9ef54c7efbc7abe164d4b72ed65cde in 1391ms, sequenceid=17, compaction requested=true 2023-03-06 11:56:43,135 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 3ebcc443c84012d3eaff66f83852d128: 2023-03-06 11:56:43,135 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ef9ef54c7efbc7abe164d4b72ed65cde: 2023-03-06 11:56:43,135 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1678103794935.3ebcc443c84012d3eaff66f83852d128. 2023-03-06 11:56:43,135 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1678103794935.ef9ef54c7efbc7abe164d4b72ed65cde. 2023-03-06 11:56:43,135 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-06 11:56:43,136 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-06 11:56:43,136 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-06 11:56:43,136 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:43,136 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-03-06 11:56:43,136 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-03-06 11:56:43,137 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-06 11:56:43,137 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:43,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:43,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:56:43,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:56:43,138 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-06 11:56:43,138 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:56:43,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:56:43,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:56:43,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-06 11:56:43,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:43,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:56:43,139 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-03-06 11:56:43,139 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5a737894[Count = 0] remaining members to acquire global barrier 2023-03-06 11:56:43,139 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-03-06 11:56:43,139 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-06 11:56:43,140 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-06 11:56:43,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-06 11:56:43,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-06 11:56:43,141 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:43,141 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:56:43,141 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-03-06 11:56:43,141 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-03-06 11:56:43,141 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:56:43,143 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-03-06 11:56:43,143 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:56:43,143 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-03-06 11:56:43,143 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:43,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:43,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:56:43,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:56:43,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:56:43,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:56:43,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-06 11:56:43,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:43,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:56:43,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-06 11:56:43,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:43,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:56:43,146 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-03-06 11:56:43,146 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-03-06 11:56:43,146 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:56:43,146 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:56:43,146 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-03-06 11:56:43,146 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:56:43,148 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-06 11:56:43,148 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:56:43,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-06 11:56:43,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-06 11:56:43,148 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-06 11:56:43,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-06 11:56:43,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:56:43,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:56:43,148 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:43,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:56:43,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:56:43,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:56:43,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-06 11:56:43,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-06 11:56:43,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:56:43,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-06 11:56:43,150 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:43,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:43,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:56:43,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-06 11:56:43,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:43,152 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:56:43,152 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:56:43,152 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:56:43,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:56:43,152 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:56:43,152 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-03-06 11:56:43,152 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:56:43,153 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-03-06 11:56:43,153 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:56:43,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:56:43,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:56:43,153 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-03-06 11:56:43,159 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:43,160 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-06 11:56:43,160 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-06 11:56:43,160 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:43,160 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-06 11:56:43,160 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-06 11:56:43,160 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-06 11:56:43,253 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:56:43,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:56:43,263 DEBUG [Listener at localhost/46717] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-06 11:56:43,275 DEBUG [Listener at localhost/46717] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-06 11:56:43,283 DEBUG [Listener at localhost/46717] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-06 11:56:43,284 DEBUG [Listener at localhost/46717] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-06 11:56:43,418 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(933): Client=jenkins//172.31.10.131 procedure request for: flush-table-proc 2023-03-06 11:56:43,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-03-06 11:56:43,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-03-06 11:56:43,420 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-03-06 11:56:43,420 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:56:43,421 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-03-06 11:56:43,421 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-03-06 11:56:43,421 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-06 11:56:43,421 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-06 11:56:43,422 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:56:43,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:56:43,422 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:43,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:56:43,423 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:43,423 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-06 11:56:43,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-06 11:56:43,423 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-06 11:56:43,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-06 11:56:43,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-06 11:56:43,423 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-03-06 11:56:43,429 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-03-06 11:56:43,429 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-03-06 11:56:43,429 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-03-06 11:56:43,429 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-06 11:56:43,429 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-03-06 11:56:43,430 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1678103794935.ef9ef54c7efbc7abe164d4b72ed65cde. 2023-03-06 11:56:43,430 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1678103794935.ef9ef54c7efbc7abe164d4b72ed65cde. started... 2023-03-06 11:56:43,430 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1678103794935.3ebcc443c84012d3eaff66f83852d128. 2023-03-06 11:56:43,430 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ef9ef54c7efbc7abe164d4b72ed65cde 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-06 11:56:43,430 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-06 11:56:43,430 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-06 11:56:43,430 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1678103794935.3ebcc443c84012d3eaff66f83852d128. started... 2023-03-06 11:56:43,430 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 3ebcc443c84012d3eaff66f83852d128 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-06 11:56:43,430 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1678103794935.5ab54f31ef0cb025ca841c2c033280dc. 2023-03-06 11:56:43,431 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1678103794935.5ab54f31ef0cb025ca841c2c033280dc. started... 2023-03-06 11:56:43,431 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 5ab54f31ef0cb025ca841c2c033280dc 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-06 11:56:43,494 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/.tmp/family1/b7b8172193504ab09d30635fb628a814 2023-03-06 11:56:43,505 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/.tmp/family1/7a2a56d9715245be86e74e0e6e691b8b 2023-03-06 11:56:43,529 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b7b8172193504ab09d30635fb628a814 2023-03-06 11:56:43,541 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7a2a56d9715245be86e74e0e6e691b8b 2023-03-06 11:56:43,557 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/.tmp/family2/f4c489270b1a4fc88264490cee2f2fd5 2023-03-06 11:56:43,561 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f4c489270b1a4fc88264490cee2f2fd5 2023-03-06 11:56:43,561 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/.tmp/family1/b7b8172193504ab09d30635fb628a814 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/family1/b7b8172193504ab09d30635fb628a814 2023-03-06 11:56:43,574 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/.tmp/family2/d641704cd4304c4d85130d8237b160c4 2023-03-06 11:56:43,578 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d641704cd4304c4d85130d8237b160c4 2023-03-06 11:56:43,578 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/.tmp/family1/7a2a56d9715245be86e74e0e6e691b8b as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/family1/7a2a56d9715245be86e74e0e6e691b8b 2023-03-06 11:56:43,600 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b7b8172193504ab09d30635fb628a814 2023-03-06 11:56:43,600 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/family1/b7b8172193504ab09d30635fb628a814, entries=3, sequenceid=23, filesize=5.2 K 2023-03-06 11:56:43,601 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/.tmp/family2/f4c489270b1a4fc88264490cee2f2fd5 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/family2/f4c489270b1a4fc88264490cee2f2fd5 2023-03-06 11:56:43,605 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f4c489270b1a4fc88264490cee2f2fd5 2023-03-06 11:56:43,605 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/family2/f4c489270b1a4fc88264490cee2f2fd5, entries=1, sequenceid=23, filesize=5.0 K 2023-03-06 11:56:43,606 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 3ebcc443c84012d3eaff66f83852d128 in 176ms, sequenceid=23, compaction requested=true 2023-03-06 11:56:43,606 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 3ebcc443c84012d3eaff66f83852d128: 2023-03-06 11:56:43,606 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1678103794935.3ebcc443c84012d3eaff66f83852d128. 2023-03-06 11:56:43,606 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-06 11:56:43,611 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7a2a56d9715245be86e74e0e6e691b8b 2023-03-06 11:56:43,612 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/family1/7a2a56d9715245be86e74e0e6e691b8b, entries=3, sequenceid=23, filesize=5.2 K 2023-03-06 11:56:43,612 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/.tmp/family2/d641704cd4304c4d85130d8237b160c4 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/family2/d641704cd4304c4d85130d8237b160c4 2023-03-06 11:56:43,616 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d641704cd4304c4d85130d8237b160c4 2023-03-06 11:56:43,616 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/family2/d641704cd4304c4d85130d8237b160c4, entries=1, sequenceid=23, filesize=5.0 K 2023-03-06 11:56:43,617 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 5ab54f31ef0cb025ca841c2c033280dc in 186ms, sequenceid=23, compaction requested=true 2023-03-06 11:56:43,617 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 5ab54f31ef0cb025ca841c2c033280dc: 2023-03-06 11:56:43,617 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1678103794935.5ab54f31ef0cb025ca841c2c033280dc. 2023-03-06 11:56:43,617 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-06 11:56:43,891 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/.tmp/family1/0319d79f260d46c3b362df0dbbc5941b 2023-03-06 11:56:43,922 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0319d79f260d46c3b362df0dbbc5941b 2023-03-06 11:56:44,743 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/.tmp/family2/5cb4bc2eb3574c42bb7b52b9452357c2 2023-03-06 11:56:44,749 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5cb4bc2eb3574c42bb7b52b9452357c2 2023-03-06 11:56:44,750 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/.tmp/family1/0319d79f260d46c3b362df0dbbc5941b as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/family1/0319d79f260d46c3b362df0dbbc5941b 2023-03-06 11:56:44,781 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0319d79f260d46c3b362df0dbbc5941b 2023-03-06 11:56:44,781 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/family1/0319d79f260d46c3b362df0dbbc5941b, entries=3, sequenceid=23, filesize=5.2 K 2023-03-06 11:56:44,782 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/.tmp/family2/5cb4bc2eb3574c42bb7b52b9452357c2 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/family2/5cb4bc2eb3574c42bb7b52b9452357c2 2023-03-06 11:56:44,786 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5cb4bc2eb3574c42bb7b52b9452357c2 2023-03-06 11:56:44,787 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/family2/5cb4bc2eb3574c42bb7b52b9452357c2, entries=1, sequenceid=23, filesize=5.0 K 2023-03-06 11:56:44,787 INFO [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for ef9ef54c7efbc7abe164d4b72ed65cde in 1357ms, sequenceid=23, compaction requested=true 2023-03-06 11:56:44,788 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ef9ef54c7efbc7abe164d4b72ed65cde: 2023-03-06 11:56:44,788 DEBUG [rs(jenkins-hbase5.apache.org,42547,1678103642479)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1678103794935.ef9ef54c7efbc7abe164d4b72ed65cde. 2023-03-06 11:56:44,788 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-06 11:56:44,788 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-06 11:56:44,788 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:44,788 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-03-06 11:56:44,788 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-03-06 11:56:44,790 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:44,790 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-06 11:56:44,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:44,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:56:44,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:56:44,790 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-06 11:56:44,790 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-06 11:56:44,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:56:44,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:56:44,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-06 11:56:44,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:44,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:56:44,792 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,42547,1678103642479' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-03-06 11:56:44,792 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@f2925c5[Count = 0] remaining members to acquire global barrier 2023-03-06 11:56:44,792 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-03-06 11:56:44,792 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-06 11:56:44,802 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-06 11:56:44,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-06 11:56:44,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-06 11:56:44,802 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-03-06 11:56:44,802 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-03-06 11:56:44,802 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase5.apache.org,42547,1678103642479' in zk 2023-03-06 11:56:44,802 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:44,802 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-06 11:56:44,804 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-03-06 11:56:44,804 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:44,804 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:56:44,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:44,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:56:44,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:56:44,804 DEBUG [member: 'jenkins-hbase5.apache.org,42547,1678103642479' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-03-06 11:56:44,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:56:44,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:56:44,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-06 11:56:44,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:44,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:56:44,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-06 11:56:44,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:44,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase5.apache.org,42547,1678103642479': 2023-03-06 11:56:44,807 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,42547,1678103642479' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-03-06 11:56:44,807 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-03-06 11:56:44,807 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-06 11:56:44,807 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-06 11:56:44,807 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-03-06 11:56:44,807 INFO [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-06 11:56:44,808 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-06 11:56:44,808 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-06 11:56:44,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-06 11:56:44,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-06 11:56:44,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-06 11:56:44,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-06 11:56:44,808 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:56:44,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-06 11:56:44,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-06 11:56:44,809 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:44,809 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:56:44,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:56:44,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-06 11:56:44,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-06 11:56:44,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-06 11:56:44,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-06 11:56:44,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:44,810 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:44,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-06 11:56:44,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-06 11:56:44,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:44,812 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:44,812 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-06 11:56:44,812 DEBUG [(jenkins-hbase5.apache.org,36301,1678103641259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-06 11:56:44,812 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-06 11:56:44,812 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-03-06 11:56:44,812 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-03-06 11:56:44,812 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-06 11:56:44,812 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-06 11:56:44,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-06 11:56:44,812 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-06 11:56:44,812 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-06 11:56:44,813 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:44,813 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-06 11:56:44,813 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-03-06 11:56:44,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-06 11:56:44,813 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-06 11:56:44,813 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-06 11:56:44,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-06 11:56:44,813 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-06 11:56:44,913 DEBUG [Listener at localhost/46717] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-06 11:56:44,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36301] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-06 11:56:44,914 DEBUG [Listener at localhost/46717] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-06 11:56:44,915 DEBUG [Listener at localhost/46717] regionserver.HStore(1912): ef9ef54c7efbc7abe164d4b72ed65cde/family1 is initiating major compaction (all files) 2023-03-06 11:56:44,915 INFO [Listener at localhost/46717] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-06 11:56:44,915 INFO [Listener at localhost/46717] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-06 11:56:44,917 INFO [Listener at localhost/46717] regionserver.HRegion(2259): Starting compaction of ef9ef54c7efbc7abe164d4b72ed65cde/family1 in testMajorCompactionFromAdmin,,1678103794935.ef9ef54c7efbc7abe164d4b72ed65cde. 2023-03-06 11:56:44,917 INFO [Listener at localhost/46717] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/family1/154e0ca0690e407580f979a6cd8d6157, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/family1/cb53833240b34b63865eef94a3aa6194, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/family1/f76f9c680ecb4b33a2dd1cd2e8f4b236, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/family1/11f2cb27a80f47f9a90c112958a07fce, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/family1/0319d79f260d46c3b362df0dbbc5941b] into tmpdir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/.tmp, totalSize=27.1 K 2023-03-06 11:56:44,918 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting 154e0ca0690e407580f979a6cd8d6157, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678103796089 2023-03-06 11:56:44,918 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting cb53833240b34b63865eef94a3aa6194, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678103798010 2023-03-06 11:56:44,919 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting f76f9c680ecb4b33a2dd1cd2e8f4b236, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678103799879 2023-03-06 11:56:44,919 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting 11f2cb27a80f47f9a90c112958a07fce, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678103801732 2023-03-06 11:56:44,919 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting 0319d79f260d46c3b362df0dbbc5941b, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-06 11:56:44,928 INFO [Listener at localhost/46717] throttle.PressureAwareThroughputController(145): ef9ef54c7efbc7abe164d4b72ed65cde#family1#compaction#197 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-06 11:56:44,982 INFO [Listener at localhost/46717] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202303063a66cc9afe644bd4b975ee60739c341e_del 2023-03-06 11:56:44,982 INFO [Listener at localhost/46717] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303063a66cc9afe644bd4b975ee60739c341e_del to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202303063a66cc9afe644bd4b975ee60739c341e_del 2023-03-06 11:56:45,452 INFO [Listener at localhost/46717] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 369cc8c421414caf9965864803b3fea4 2023-03-06 11:56:45,453 DEBUG [Listener at localhost/46717] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/.tmp/family1/369cc8c421414caf9965864803b3fea4 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/family1/369cc8c421414caf9965864803b3fea4 2023-03-06 11:56:45,476 INFO [Listener at localhost/46717] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 369cc8c421414caf9965864803b3fea4 2023-03-06 11:56:45,477 INFO [Listener at localhost/46717] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in ef9ef54c7efbc7abe164d4b72ed65cde/family1 of ef9ef54c7efbc7abe164d4b72ed65cde into 369cc8c421414caf9965864803b3fea4(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-06 11:56:45,477 DEBUG [Listener at localhost/46717] regionserver.HRegion(2289): Compaction status journal for ef9ef54c7efbc7abe164d4b72ed65cde: 2023-03-06 11:56:45,478 DEBUG [Listener at localhost/46717] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-06 11:56:45,478 DEBUG [Listener at localhost/46717] regionserver.HStore(1912): ef9ef54c7efbc7abe164d4b72ed65cde/family2 is initiating major compaction (all files) 2023-03-06 11:56:45,478 INFO [Listener at localhost/46717] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-06 11:56:45,478 INFO [Listener at localhost/46717] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-06 11:56:45,479 INFO [Listener at localhost/46717] regionserver.HRegion(2259): Starting compaction of ef9ef54c7efbc7abe164d4b72ed65cde/family2 in testMajorCompactionFromAdmin,,1678103794935.ef9ef54c7efbc7abe164d4b72ed65cde. 2023-03-06 11:56:45,479 INFO [Listener at localhost/46717] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/family2/3c015c157bdf4153b5a08873316d428a, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/family2/e6bc13037127490c8ebe0a756355f62f, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/family2/02fe6ed4526e4b5985ce763a34066507, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/family2/8e1855f43ca1415c98bd948bddf9402a, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/family2/5cb4bc2eb3574c42bb7b52b9452357c2] into tmpdir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/.tmp, totalSize=25.4 K 2023-03-06 11:56:45,479 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting 3c015c157bdf4153b5a08873316d428a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678103796089 2023-03-06 11:56:45,480 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting e6bc13037127490c8ebe0a756355f62f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678103798010 2023-03-06 11:56:45,480 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting 02fe6ed4526e4b5985ce763a34066507, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678103799879 2023-03-06 11:56:45,480 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting 8e1855f43ca1415c98bd948bddf9402a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678103801732 2023-03-06 11:56:45,481 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting 5cb4bc2eb3574c42bb7b52b9452357c2, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-06 11:56:45,488 INFO [Listener at localhost/46717] throttle.PressureAwareThroughputController(145): ef9ef54c7efbc7abe164d4b72ed65cde#family2#compaction#198 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-06 11:56:45,499 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/family1/154e0ca0690e407580f979a6cd8d6157, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/family1/cb53833240b34b63865eef94a3aa6194, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/family1/f76f9c680ecb4b33a2dd1cd2e8f4b236, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/family1/11f2cb27a80f47f9a90c112958a07fce, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/family1/0319d79f260d46c3b362df0dbbc5941b] to archive 2023-03-06 11:56:45,500 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:56:45,502 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/family1/154e0ca0690e407580f979a6cd8d6157 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/family1/154e0ca0690e407580f979a6cd8d6157 2023-03-06 11:56:45,503 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/family1/cb53833240b34b63865eef94a3aa6194 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/family1/cb53833240b34b63865eef94a3aa6194 2023-03-06 11:56:45,504 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/family1/f76f9c680ecb4b33a2dd1cd2e8f4b236 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/family1/f76f9c680ecb4b33a2dd1cd2e8f4b236 2023-03-06 11:56:45,505 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/family1/11f2cb27a80f47f9a90c112958a07fce to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/family1/11f2cb27a80f47f9a90c112958a07fce 2023-03-06 11:56:45,506 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/family1/0319d79f260d46c3b362df0dbbc5941b to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/family1/0319d79f260d46c3b362df0dbbc5941b 2023-03-06 11:56:45,899 INFO [Listener at localhost/46717] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023030630b0c2f1026c4085ab70447d64cb0395_del 2023-03-06 11:56:45,899 INFO [Listener at localhost/46717] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023030630b0c2f1026c4085ab70447d64cb0395_del to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e2023030630b0c2f1026c4085ab70447d64cb0395_del 2023-03-06 11:56:46,316 INFO [Listener at localhost/46717] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7c5ce067d710419a97f08ceb14b8b1ef 2023-03-06 11:56:46,316 DEBUG [Listener at localhost/46717] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/.tmp/family2/7c5ce067d710419a97f08ceb14b8b1ef as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/family2/7c5ce067d710419a97f08ceb14b8b1ef 2023-03-06 11:56:46,320 INFO [Listener at localhost/46717] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7c5ce067d710419a97f08ceb14b8b1ef 2023-03-06 11:56:46,320 INFO [Listener at localhost/46717] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in ef9ef54c7efbc7abe164d4b72ed65cde/family2 of ef9ef54c7efbc7abe164d4b72ed65cde into 7c5ce067d710419a97f08ceb14b8b1ef(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-06 11:56:46,321 DEBUG [Listener at localhost/46717] regionserver.HRegion(2289): Compaction status journal for ef9ef54c7efbc7abe164d4b72ed65cde: 2023-03-06 11:56:46,321 DEBUG [Listener at localhost/46717] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-06 11:56:46,321 DEBUG [Listener at localhost/46717] regionserver.HStore(1912): 3ebcc443c84012d3eaff66f83852d128/family1 is initiating major compaction (all files) 2023-03-06 11:56:46,321 INFO [Listener at localhost/46717] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-06 11:56:46,321 INFO [Listener at localhost/46717] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-06 11:56:46,321 INFO [Listener at localhost/46717] regionserver.HRegion(2259): Starting compaction of 3ebcc443c84012d3eaff66f83852d128/family1 in testMajorCompactionFromAdmin,1,1678103794935.3ebcc443c84012d3eaff66f83852d128. 2023-03-06 11:56:46,321 INFO [Listener at localhost/46717] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/family1/7ea358e875704829a51c766093de73f6, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/family1/2f3caf064d3649fa83e4f5fdd0346710, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/family1/5951a11a8dfa49a3a5b675e3fa8e2584, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/family1/a8e02573ca824e8dbf01b9f3079f4e77, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/family1/b7b8172193504ab09d30635fb628a814] into tmpdir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/.tmp, totalSize=27.1 K 2023-03-06 11:56:46,322 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting 7ea358e875704829a51c766093de73f6, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678103796090 2023-03-06 11:56:46,322 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting 2f3caf064d3649fa83e4f5fdd0346710, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678103798010 2023-03-06 11:56:46,322 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting 5951a11a8dfa49a3a5b675e3fa8e2584, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678103799879 2023-03-06 11:56:46,323 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting a8e02573ca824e8dbf01b9f3079f4e77, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678103801732 2023-03-06 11:56:46,323 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting b7b8172193504ab09d30635fb628a814, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-06 11:56:46,330 INFO [Listener at localhost/46717] throttle.PressureAwareThroughputController(145): 3ebcc443c84012d3eaff66f83852d128#family1#compaction#199 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-06 11:56:46,367 INFO [Listener at localhost/46717] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230306233505960b3346da82de3e7504a38ebc_del 2023-03-06 11:56:46,367 INFO [Listener at localhost/46717] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230306233505960b3346da82de3e7504a38ebc_del to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230306233505960b3346da82de3e7504a38ebc_del 2023-03-06 11:56:46,399 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/family2/3c015c157bdf4153b5a08873316d428a, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/family2/e6bc13037127490c8ebe0a756355f62f, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/family2/02fe6ed4526e4b5985ce763a34066507, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/family2/8e1855f43ca1415c98bd948bddf9402a, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/family2/5cb4bc2eb3574c42bb7b52b9452357c2] to archive 2023-03-06 11:56:46,400 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:56:46,401 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/family2/3c015c157bdf4153b5a08873316d428a to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/family2/3c015c157bdf4153b5a08873316d428a 2023-03-06 11:56:46,402 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/family2/e6bc13037127490c8ebe0a756355f62f to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/family2/e6bc13037127490c8ebe0a756355f62f 2023-03-06 11:56:46,403 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/family2/02fe6ed4526e4b5985ce763a34066507 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/family2/02fe6ed4526e4b5985ce763a34066507 2023-03-06 11:56:46,404 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/family2/8e1855f43ca1415c98bd948bddf9402a to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/family2/8e1855f43ca1415c98bd948bddf9402a 2023-03-06 11:56:46,405 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/family2/5cb4bc2eb3574c42bb7b52b9452357c2 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/family2/5cb4bc2eb3574c42bb7b52b9452357c2 2023-03-06 11:56:47,220 INFO [Listener at localhost/46717] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bc6c3c6a6c7c4595b3605ac917ace03b 2023-03-06 11:56:47,220 DEBUG [Listener at localhost/46717] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/.tmp/family1/bc6c3c6a6c7c4595b3605ac917ace03b as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/family1/bc6c3c6a6c7c4595b3605ac917ace03b 2023-03-06 11:56:47,244 INFO [Listener at localhost/46717] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bc6c3c6a6c7c4595b3605ac917ace03b 2023-03-06 11:56:47,245 INFO [Listener at localhost/46717] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 3ebcc443c84012d3eaff66f83852d128/family1 of 3ebcc443c84012d3eaff66f83852d128 into bc6c3c6a6c7c4595b3605ac917ace03b(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-06 11:56:47,245 DEBUG [Listener at localhost/46717] regionserver.HRegion(2289): Compaction status journal for 3ebcc443c84012d3eaff66f83852d128: 2023-03-06 11:56:47,245 DEBUG [Listener at localhost/46717] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-06 11:56:47,245 DEBUG [Listener at localhost/46717] regionserver.HStore(1912): 3ebcc443c84012d3eaff66f83852d128/family2 is initiating major compaction (all files) 2023-03-06 11:56:47,245 INFO [Listener at localhost/46717] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-06 11:56:47,246 INFO [Listener at localhost/46717] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-06 11:56:47,246 INFO [Listener at localhost/46717] regionserver.HRegion(2259): Starting compaction of 3ebcc443c84012d3eaff66f83852d128/family2 in testMajorCompactionFromAdmin,1,1678103794935.3ebcc443c84012d3eaff66f83852d128. 2023-03-06 11:56:47,246 INFO [Listener at localhost/46717] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/family2/1ba9efff42dd4e5b9e09db8cbd618aaa, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/family2/1e8c2c661f59474cafbb672ccba67c2f, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/family2/981e2bca95624f67af84b80ac4c7690b, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/family2/5f7a0d85731d4cf09143ae40ce645266, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/family2/f4c489270b1a4fc88264490cee2f2fd5] into tmpdir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/.tmp, totalSize=25.4 K 2023-03-06 11:56:47,246 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting 1ba9efff42dd4e5b9e09db8cbd618aaa, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678103796090 2023-03-06 11:56:47,246 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting 1e8c2c661f59474cafbb672ccba67c2f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678103798010 2023-03-06 11:56:47,247 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting 981e2bca95624f67af84b80ac4c7690b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678103799879 2023-03-06 11:56:47,247 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting 5f7a0d85731d4cf09143ae40ce645266, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678103801732 2023-03-06 11:56:47,247 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting f4c489270b1a4fc88264490cee2f2fd5, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-06 11:56:47,254 INFO [Listener at localhost/46717] throttle.PressureAwareThroughputController(145): 3ebcc443c84012d3eaff66f83852d128#family2#compaction#200 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-06 11:56:47,301 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/family1/7ea358e875704829a51c766093de73f6, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/family1/2f3caf064d3649fa83e4f5fdd0346710, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/family1/5951a11a8dfa49a3a5b675e3fa8e2584, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/family1/a8e02573ca824e8dbf01b9f3079f4e77, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/family1/b7b8172193504ab09d30635fb628a814] to archive 2023-03-06 11:56:47,302 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:56:47,303 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/family1/7ea358e875704829a51c766093de73f6 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/family1/7ea358e875704829a51c766093de73f6 2023-03-06 11:56:47,304 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/family1/2f3caf064d3649fa83e4f5fdd0346710 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/family1/2f3caf064d3649fa83e4f5fdd0346710 2023-03-06 11:56:47,305 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/family1/5951a11a8dfa49a3a5b675e3fa8e2584 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/family1/5951a11a8dfa49a3a5b675e3fa8e2584 2023-03-06 11:56:47,306 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/family1/a8e02573ca824e8dbf01b9f3079f4e77 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/family1/a8e02573ca824e8dbf01b9f3079f4e77 2023-03-06 11:56:47,307 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/family1/b7b8172193504ab09d30635fb628a814 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/family1/b7b8172193504ab09d30635fb628a814 2023-03-06 11:56:47,661 INFO [Listener at localhost/46717] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230306c030211c920f45d6be9548cd79f67c40_del 2023-03-06 11:56:47,661 INFO [Listener at localhost/46717] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230306c030211c920f45d6be9548cd79f67c40_del to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230306c030211c920f45d6be9548cd79f67c40_del 2023-03-06 11:56:48,474 INFO [Listener at localhost/46717] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for beb998878be9416e8d77e6eee4656794 2023-03-06 11:56:48,475 DEBUG [Listener at localhost/46717] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/.tmp/family2/beb998878be9416e8d77e6eee4656794 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/family2/beb998878be9416e8d77e6eee4656794 2023-03-06 11:56:48,478 INFO [Listener at localhost/46717] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for beb998878be9416e8d77e6eee4656794 2023-03-06 11:56:48,479 INFO [Listener at localhost/46717] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 3ebcc443c84012d3eaff66f83852d128/family2 of 3ebcc443c84012d3eaff66f83852d128 into beb998878be9416e8d77e6eee4656794(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-06 11:56:48,479 DEBUG [Listener at localhost/46717] regionserver.HRegion(2289): Compaction status journal for 3ebcc443c84012d3eaff66f83852d128: 2023-03-06 11:56:48,479 DEBUG [Listener at localhost/46717] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-06 11:56:48,479 DEBUG [Listener at localhost/46717] regionserver.HStore(1912): 5ab54f31ef0cb025ca841c2c033280dc/family1 is initiating major compaction (all files) 2023-03-06 11:56:48,479 INFO [Listener at localhost/46717] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-06 11:56:48,479 INFO [Listener at localhost/46717] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-06 11:56:48,480 INFO [Listener at localhost/46717] regionserver.HRegion(2259): Starting compaction of 5ab54f31ef0cb025ca841c2c033280dc/family1 in testMajorCompactionFromAdmin,2,1678103794935.5ab54f31ef0cb025ca841c2c033280dc. 2023-03-06 11:56:48,480 INFO [Listener at localhost/46717] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/family1/65ad548a1bf64f77941288fc6e7725e6, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/family1/6fe3a35b99c84c55ad3aee32057891c8, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/family1/bd15825e1f714713bbc55901d57a4739, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/family1/1d1df69aad8947c2848b455bf32a1a3f, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/family1/7a2a56d9715245be86e74e0e6e691b8b] into tmpdir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/.tmp, totalSize=27.1 K 2023-03-06 11:56:48,480 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting 65ad548a1bf64f77941288fc6e7725e6, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678103796090 2023-03-06 11:56:48,481 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting 6fe3a35b99c84c55ad3aee32057891c8, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678103798011 2023-03-06 11:56:48,481 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting bd15825e1f714713bbc55901d57a4739, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678103799880 2023-03-06 11:56:48,481 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting 1d1df69aad8947c2848b455bf32a1a3f, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678103801732 2023-03-06 11:56:48,482 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting 7a2a56d9715245be86e74e0e6e691b8b, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-06 11:56:48,490 INFO [Listener at localhost/46717] throttle.PressureAwareThroughputController(145): 5ab54f31ef0cb025ca841c2c033280dc#family1#compaction#201 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-06 11:56:48,500 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/family2/1ba9efff42dd4e5b9e09db8cbd618aaa, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/family2/1e8c2c661f59474cafbb672ccba67c2f, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/family2/981e2bca95624f67af84b80ac4c7690b, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/family2/5f7a0d85731d4cf09143ae40ce645266, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/family2/f4c489270b1a4fc88264490cee2f2fd5] to archive 2023-03-06 11:56:48,500 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:56:48,502 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/family2/1ba9efff42dd4e5b9e09db8cbd618aaa to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/family2/1ba9efff42dd4e5b9e09db8cbd618aaa 2023-03-06 11:56:48,503 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/family2/1e8c2c661f59474cafbb672ccba67c2f to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/family2/1e8c2c661f59474cafbb672ccba67c2f 2023-03-06 11:56:48,504 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/family2/981e2bca95624f67af84b80ac4c7690b to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/family2/981e2bca95624f67af84b80ac4c7690b 2023-03-06 11:56:48,505 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/family2/5f7a0d85731d4cf09143ae40ce645266 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/family2/5f7a0d85731d4cf09143ae40ce645266 2023-03-06 11:56:48,506 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/family2/f4c489270b1a4fc88264490cee2f2fd5 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/family2/f4c489270b1a4fc88264490cee2f2fd5 2023-03-06 11:56:48,926 INFO [Listener at localhost/46717] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202303064901236298e14eb19fc8e259d5f3828d_del 2023-03-06 11:56:48,926 INFO [Listener at localhost/46717] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303064901236298e14eb19fc8e259d5f3828d_del to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303064901236298e14eb19fc8e259d5f3828d_del 2023-03-06 11:56:49,779 INFO [Listener at localhost/46717] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ffe0168ca5f24823833e352021360f9d 2023-03-06 11:56:49,780 DEBUG [Listener at localhost/46717] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/.tmp/family1/ffe0168ca5f24823833e352021360f9d as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/family1/ffe0168ca5f24823833e352021360f9d 2023-03-06 11:56:49,802 INFO [Listener at localhost/46717] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ffe0168ca5f24823833e352021360f9d 2023-03-06 11:56:49,803 INFO [Listener at localhost/46717] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 5ab54f31ef0cb025ca841c2c033280dc/family1 of 5ab54f31ef0cb025ca841c2c033280dc into ffe0168ca5f24823833e352021360f9d(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-06 11:56:49,803 DEBUG [Listener at localhost/46717] regionserver.HRegion(2289): Compaction status journal for 5ab54f31ef0cb025ca841c2c033280dc: 2023-03-06 11:56:49,803 DEBUG [Listener at localhost/46717] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-06 11:56:49,804 DEBUG [Listener at localhost/46717] regionserver.HStore(1912): 5ab54f31ef0cb025ca841c2c033280dc/family2 is initiating major compaction (all files) 2023-03-06 11:56:49,804 INFO [Listener at localhost/46717] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-06 11:56:49,804 INFO [Listener at localhost/46717] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-06 11:56:49,804 INFO [Listener at localhost/46717] regionserver.HRegion(2259): Starting compaction of 5ab54f31ef0cb025ca841c2c033280dc/family2 in testMajorCompactionFromAdmin,2,1678103794935.5ab54f31ef0cb025ca841c2c033280dc. 2023-03-06 11:56:49,804 INFO [Listener at localhost/46717] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/family2/d0c5e0c28e774a799bbca96ab976e99e, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/family2/b5507e72f4b24f2a8adb2bf0db9046af, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/family2/6a0d40a60a09481292d173f872f75c33, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/family2/57ed9a73a22640f6a9dffb338eb99f1f, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/family2/d641704cd4304c4d85130d8237b160c4] into tmpdir=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/.tmp, totalSize=25.4 K 2023-03-06 11:56:49,804 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting d0c5e0c28e774a799bbca96ab976e99e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678103796090 2023-03-06 11:56:49,805 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting b5507e72f4b24f2a8adb2bf0db9046af, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678103798011 2023-03-06 11:56:49,805 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting 6a0d40a60a09481292d173f872f75c33, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678103799880 2023-03-06 11:56:49,805 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting 57ed9a73a22640f6a9dffb338eb99f1f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678103801732 2023-03-06 11:56:49,806 DEBUG [Listener at localhost/46717] compactions.Compactor(207): Compacting d641704cd4304c4d85130d8237b160c4, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-06 11:56:49,806 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/family1/65ad548a1bf64f77941288fc6e7725e6, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/family1/6fe3a35b99c84c55ad3aee32057891c8, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/family1/bd15825e1f714713bbc55901d57a4739, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/family1/1d1df69aad8947c2848b455bf32a1a3f, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/family1/7a2a56d9715245be86e74e0e6e691b8b] to archive 2023-03-06 11:56:49,807 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:56:49,808 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/family1/65ad548a1bf64f77941288fc6e7725e6 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/family1/65ad548a1bf64f77941288fc6e7725e6 2023-03-06 11:56:49,809 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/family1/6fe3a35b99c84c55ad3aee32057891c8 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/family1/6fe3a35b99c84c55ad3aee32057891c8 2023-03-06 11:56:49,810 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/family1/bd15825e1f714713bbc55901d57a4739 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/family1/bd15825e1f714713bbc55901d57a4739 2023-03-06 11:56:49,811 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/family1/1d1df69aad8947c2848b455bf32a1a3f to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/family1/1d1df69aad8947c2848b455bf32a1a3f 2023-03-06 11:56:49,812 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/family1/7a2a56d9715245be86e74e0e6e691b8b to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/family1/7a2a56d9715245be86e74e0e6e691b8b 2023-03-06 11:56:49,814 INFO [Listener at localhost/46717] throttle.PressureAwareThroughputController(145): 5ab54f31ef0cb025ca841c2c033280dc#family2#compaction#202 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-06 11:56:50,221 INFO [Listener at localhost/46717] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202303068fa317a837a24cd7b2360c9d543940e0_del 2023-03-06 11:56:50,221 INFO [Listener at localhost/46717] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303068fa317a837a24cd7b2360c9d543940e0_del to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202303068fa317a837a24cd7b2360c9d543940e0_del 2023-03-06 11:56:51,033 INFO [Listener at localhost/46717] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 38c0f8cc99ee4ae3afc0b69bc9a86e59 2023-03-06 11:56:51,034 DEBUG [Listener at localhost/46717] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/.tmp/family2/38c0f8cc99ee4ae3afc0b69bc9a86e59 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/family2/38c0f8cc99ee4ae3afc0b69bc9a86e59 2023-03-06 11:56:51,037 INFO [Listener at localhost/46717] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 38c0f8cc99ee4ae3afc0b69bc9a86e59 2023-03-06 11:56:51,038 INFO [Listener at localhost/46717] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 5ab54f31ef0cb025ca841c2c033280dc/family2 of 5ab54f31ef0cb025ca841c2c033280dc into 38c0f8cc99ee4ae3afc0b69bc9a86e59(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-06 11:56:51,038 DEBUG [Listener at localhost/46717] regionserver.HRegion(2289): Compaction status journal for 5ab54f31ef0cb025ca841c2c033280dc: 2023-03-06 11:56:51,041 DEBUG [Listener at localhost/46717] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-06 11:56:51,043 DEBUG [Listener at localhost/46717] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-06 11:56:51,047 DEBUG [Listener at localhost/46717] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-06 11:56:51,048 DEBUG [Listener at localhost/46717] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-06 11:56:51,052 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=36301] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10Pwn\x1D\x01\xA6\x94\x89\xE0\x17\x81\xA0\x9D\xEF\x0B\xA5"\x10\xC3^z\xB0O\x87\x04\xE2\xE8\xBF\x19W\x00o9\x86*\x1077\xDD\xD7?\xAEN\x13\xA0\x06R\xF8\xE7:\xDC\xC52\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testMajorCompactionFromAdmin 2023-03-06 11:56:51,077 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] procedure2.ProcedureExecutor(1029): Stored pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-03-06 11:56:51,077 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-03-06 11:56:51,078 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-06 11:56:51,078 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=123, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678104411078 2023-03-06 11:56:51,079 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-06 11:56:51,104 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/family2/d0c5e0c28e774a799bbca96ab976e99e, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/family2/b5507e72f4b24f2a8adb2bf0db9046af, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/family2/6a0d40a60a09481292d173f872f75c33, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/family2/57ed9a73a22640f6a9dffb338eb99f1f, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/family2/d641704cd4304c4d85130d8237b160c4] to archive 2023-03-06 11:56:51,105 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:56:51,107 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/family2/d0c5e0c28e774a799bbca96ab976e99e to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/family2/d0c5e0c28e774a799bbca96ab976e99e 2023-03-06 11:56:51,108 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/family2/b5507e72f4b24f2a8adb2bf0db9046af to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/family2/b5507e72f4b24f2a8adb2bf0db9046af 2023-03-06 11:56:51,109 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/family2/6a0d40a60a09481292d173f872f75c33 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/family2/6a0d40a60a09481292d173f872f75c33 2023-03-06 11:56:51,110 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/family2/57ed9a73a22640f6a9dffb338eb99f1f to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/family2/57ed9a73a22640f6a9dffb338eb99f1f 2023-03-06 11:56:51,111 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/family2/d641704cd4304c4d85130d8237b160c4 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/family2/d641704cd4304c4d85130d8237b160c4 2023-03-06 11:56:51,424 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testMajorCompactionFromAdmin' and column 'family1' 2023-03-06 11:56:51,446 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202303063a66cc9afe644bd4b975ee60739c341e_del 2023-03-06 11:56:51,468 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230306233505960b3346da82de3e7504a38ebc_del 2023-03-06 11:56:51,490 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202303064901236298e14eb19fc8e259d5f3828d_del 2023-03-06 11:56:51,490 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testMajorCompactionFromAdmin' column='family1' 2023-03-06 11:56:51,490 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] zookeeper.ReadOnlyZKClient(139): Connect 0x2e501c9f to 127.0.0.1:62659 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-06 11:56:51,494 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@59591afa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-06 11:56:51,494 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230306 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-06 11:56:51,905 DEBUG [regionserver/jenkins-hbase5:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-03-06 11:56:52,441 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230306245eae411f674e97aa079403aeb0b0f1 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230306245eae411f674e97aa079403aeb0b0f1 2023-03-06 11:56:52,442 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230306 table='testMajorCompactionFromAdmin' column='family1' 2023-03-06 11:56:52,455 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-06 11:56:52,457 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:34590, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-06 11:56:52,465 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-06 11:56:52,467 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:37540, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-06 11:56:52,497 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230306/family1/272ed320868144d0a01f3de9a28ed2af first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-03-06 11:56:52,498 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionFromAdmin,,1678103794935.ef9ef54c7efbc7abe164d4b72ed65cde., hostname=jenkins-hbase5.apache.org,42547,1678103642479, seqNum=2 for row with hfile group [{family1,hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230306/family1/272ed320868144d0a01f3de9a28ed2af}] 2023-03-06 11:56:52,503 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(763): Validating hfile at hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230306/family1/272ed320868144d0a01f3de9a28ed2af for inclusion in ef9ef54c7efbc7abe164d4b72ed65cde/family1 2023-03-06 11:56:52,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-03-06 11:56:52,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(777): Region bounds: first= last=1 2023-03-06 11:56:52,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegion(2446): Flush status journal for ef9ef54c7efbc7abe164d4b72ed65cde: 2023-03-06 11:56:52,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230306/family1/272ed320868144d0a01f3de9a28ed2af to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionFromAdmin__isosk99mk6hkp2aoaj1p1a7beojlt8pgq2nkdqf484limlq8fc9ci32a9o0t8d3l/family1/272ed320868144d0a01f3de9a28ed2af 2023-03-06 11:56:52,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionFromAdmin__isosk99mk6hkp2aoaj1p1a7beojlt8pgq2nkdqf484limlq8fc9ci32a9o0t8d3l/family1/272ed320868144d0a01f3de9a28ed2af as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/family1/6f38759394414c10bf95454ea6bd2829_SeqId_28_ 2023-03-06 11:56:52,538 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(849): Loaded HFile hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionFromAdmin__isosk99mk6hkp2aoaj1p1a7beojlt8pgq2nkdqf484limlq8fc9ci32a9o0t8d3l/family1/272ed320868144d0a01f3de9a28ed2af into ef9ef54c7efbc7abe164d4b72ed65cde/family1 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/family1/6f38759394414c10bf95454ea6bd2829_SeqId_28_ - updating store file list. 2023-03-06 11:56:52,560 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(882): Loaded HFile hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/family1/6f38759394414c10bf95454ea6bd2829_SeqId_28_ into ef9ef54c7efbc7abe164d4b72ed65cde/family1 2023-03-06 11:56:52,561 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(855): Successfully loaded hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionFromAdmin__isosk99mk6hkp2aoaj1p1a7beojlt8pgq2nkdqf484limlq8fc9ci32a9o0t8d3l/family1/272ed320868144d0a01f3de9a28ed2af into ef9ef54c7efbc7abe164d4b72ed65cde/family1 (new location: hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/family1/6f38759394414c10bf95454ea6bd2829_SeqId_28_) 2023-03-06 11:56:52,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionFromAdmin__isosk99mk6hkp2aoaj1p1a7beojlt8pgq2nkdqf484limlq8fc9ci32a9o0t8d3l/family1/272ed320868144d0a01f3de9a28ed2af 2023-03-06 11:56:52,564 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230306 table='testMajorCompactionFromAdmin' column='family1' 2023-03-06 11:56:52,565 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:56:52,566 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023030624ecc6b7bdce4fe2b251893d370c4755 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023030624ecc6b7bdce4fe2b251893d370c4755 2023-03-06 11:56:52,567 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202303062ffe1588a2da4d4ab6c1e3c5d53b92e9 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202303062ffe1588a2da4d4ab6c1e3c5d53b92e9 2023-03-06 11:56:52,568 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202303068980e1603d284bb19ce4624cc7f3e880 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202303068980e1603d284bb19ce4624cc7f3e880 2023-03-06 11:56:52,569 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230306be93a56ef8414e8da1c42e531d196a6c to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230306be93a56ef8414e8da1c42e531d196a6c 2023-03-06 11:56:52,569 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-03-06 11:56:52,569 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230306' 2023-03-06 11:56:52,569 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230306 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-06 11:56:52,569 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230306 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-06 11:56:53,140 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230306a2a713f792d2413298fe7de73087c4c8 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230306a2a713f792d2413298fe7de73087c4c8 2023-03-06 11:56:53,140 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230306 table='testMajorCompactionFromAdmin' column='family1' 2023-03-06 11:56:53,144 DEBUG [regionserver/jenkins-hbase5:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-03-06 11:56:53,179 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230306/family1/e86cc6929145404694f185ad659f6a84 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-03-06 11:56:53,180 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionFromAdmin,1,1678103794935.3ebcc443c84012d3eaff66f83852d128., hostname=jenkins-hbase5.apache.org,42547,1678103642479, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230306/family1/e86cc6929145404694f185ad659f6a84}] 2023-03-06 11:56:53,182 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(763): Validating hfile at hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230306/family1/e86cc6929145404694f185ad659f6a84 for inclusion in 3ebcc443c84012d3eaff66f83852d128/family1 2023-03-06 11:56:53,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-03-06 11:56:53,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(777): Region bounds: first=1 last=2 2023-03-06 11:56:53,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegion(2446): Flush status journal for 3ebcc443c84012d3eaff66f83852d128: 2023-03-06 11:56:53,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230306/family1/e86cc6929145404694f185ad659f6a84 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionFromAdmin__8i4vid17hr2r7sk29l7cj2rmsfhiahut628t8ai9et45duagq580hmj6r8ildmfq/family1/e86cc6929145404694f185ad659f6a84 2023-03-06 11:56:53,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionFromAdmin__8i4vid17hr2r7sk29l7cj2rmsfhiahut628t8ai9et45duagq580hmj6r8ildmfq/family1/e86cc6929145404694f185ad659f6a84 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/family1/1e8976ca2c2049a18444a73df8603f88_SeqId_28_ 2023-03-06 11:56:53,211 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(849): Loaded HFile hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionFromAdmin__8i4vid17hr2r7sk29l7cj2rmsfhiahut628t8ai9et45duagq580hmj6r8ildmfq/family1/e86cc6929145404694f185ad659f6a84 into 3ebcc443c84012d3eaff66f83852d128/family1 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/family1/1e8976ca2c2049a18444a73df8603f88_SeqId_28_ - updating store file list. 2023-03-06 11:56:53,233 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(882): Loaded HFile hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/family1/1e8976ca2c2049a18444a73df8603f88_SeqId_28_ into 3ebcc443c84012d3eaff66f83852d128/family1 2023-03-06 11:56:53,233 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(855): Successfully loaded hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionFromAdmin__8i4vid17hr2r7sk29l7cj2rmsfhiahut628t8ai9et45duagq580hmj6r8ildmfq/family1/e86cc6929145404694f185ad659f6a84 into 3ebcc443c84012d3eaff66f83852d128/family1 (new location: hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/family1/1e8976ca2c2049a18444a73df8603f88_SeqId_28_) 2023-03-06 11:56:53,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionFromAdmin__8i4vid17hr2r7sk29l7cj2rmsfhiahut628t8ai9et45duagq580hmj6r8ildmfq/family1/e86cc6929145404694f185ad659f6a84 2023-03-06 11:56:53,235 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230306 table='testMajorCompactionFromAdmin' column='family1' 2023-03-06 11:56:53,235 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:56:53,237 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202303067abdb91ab9934c61b293b1cfab84fc4a to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202303067abdb91ab9934c61b293b1cfab84fc4a 2023-03-06 11:56:53,238 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023030681d6da7a24c543fca9e0ba6a4fcd660f to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023030681d6da7a24c543fca9e0ba6a4fcd660f 2023-03-06 11:56:53,239 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230306a47aeada1cc54dcb885f656626c29bf8 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230306a47aeada1cc54dcb885f656626c29bf8 2023-03-06 11:56:53,240 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230306baabacdfe0354a3d95d3bdb3b2c004af to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230306baabacdfe0354a3d95d3bdb3b2c004af 2023-03-06 11:56:53,240 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-03-06 11:56:53,240 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230306' 2023-03-06 11:56:53,241 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230306 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-06 11:56:53,241 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230306 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-06 11:56:53,984 DEBUG [regionserver/jenkins-hbase5:0.Chore.2] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-03-06 11:56:54,227 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303068d507290d4c4452184c1c03b3962449e to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303068d507290d4c4452184c1c03b3962449e 2023-03-06 11:56:54,227 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230306 table='testMajorCompactionFromAdmin' column='family1' 2023-03-06 11:56:54,265 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230306/family1/6f717cc9f2e34f4690bbf3cba218f25b first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-03-06 11:56:54,266 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionFromAdmin,2,1678103794935.5ab54f31ef0cb025ca841c2c033280dc., hostname=jenkins-hbase5.apache.org,42547,1678103642479, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230306/family1/6f717cc9f2e34f4690bbf3cba218f25b}] 2023-03-06 11:56:54,268 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(763): Validating hfile at hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230306/family1/6f717cc9f2e34f4690bbf3cba218f25b for inclusion in 5ab54f31ef0cb025ca841c2c033280dc/family1 2023-03-06 11:56:54,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-03-06 11:56:54,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(777): Region bounds: first=2 last= 2023-03-06 11:56:54,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegion(2446): Flush status journal for 5ab54f31ef0cb025ca841c2c033280dc: 2023-03-06 11:56:54,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230306/family1/6f717cc9f2e34f4690bbf3cba218f25b to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionFromAdmin__dh68ddb73ba18lgm9bqe5888m2ntsbrvkl24p0m0eau003lhhvmti1drng88ug75/family1/6f717cc9f2e34f4690bbf3cba218f25b 2023-03-06 11:56:54,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionFromAdmin__dh68ddb73ba18lgm9bqe5888m2ntsbrvkl24p0m0eau003lhhvmti1drng88ug75/family1/6f717cc9f2e34f4690bbf3cba218f25b as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/family1/206441ccef5c4426955681e258479ea1_SeqId_28_ 2023-03-06 11:56:54,294 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(849): Loaded HFile hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionFromAdmin__dh68ddb73ba18lgm9bqe5888m2ntsbrvkl24p0m0eau003lhhvmti1drng88ug75/family1/6f717cc9f2e34f4690bbf3cba218f25b into 5ab54f31ef0cb025ca841c2c033280dc/family1 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/family1/206441ccef5c4426955681e258479ea1_SeqId_28_ - updating store file list. 2023-03-06 11:56:54,316 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(882): Loaded HFile hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/family1/206441ccef5c4426955681e258479ea1_SeqId_28_ into 5ab54f31ef0cb025ca841c2c033280dc/family1 2023-03-06 11:56:54,316 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.HStore(855): Successfully loaded hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionFromAdmin__dh68ddb73ba18lgm9bqe5888m2ntsbrvkl24p0m0eau003lhhvmti1drng88ug75/family1/6f717cc9f2e34f4690bbf3cba218f25b into 5ab54f31ef0cb025ca841c2c033280dc/family1 (new location: hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/family1/206441ccef5c4426955681e258479ea1_SeqId_28_) 2023-03-06 11:56:54,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42547] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/staging/jenkins__testMajorCompactionFromAdmin__dh68ddb73ba18lgm9bqe5888m2ntsbrvkl24p0m0eau003lhhvmti1drng88ug75/family1/6f717cc9f2e34f4690bbf3cba218f25b 2023-03-06 11:56:54,318 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230306 table='testMajorCompactionFromAdmin' column='family1' 2023-03-06 11:56:54,318 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:56:54,319 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023030627e6a4e5da094f13972f5d4912f9efcf to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023030627e6a4e5da094f13972f5d4912f9efcf 2023-03-06 11:56:54,320 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303068641a7ab23f948a9b2cb51deaf4e797c to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303068641a7ab23f948a9b2cb51deaf4e797c 2023-03-06 11:56:54,321 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230306910b59ec05e34d5a985f1e32acfdda17 to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230306910b59ec05e34d5a985f1e32acfdda17 2023-03-06 11:56:54,322 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230306cb90f30096924d78aefad3459c3cb0bf to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230306cb90f30096924d78aefad3459c3cb0bf 2023-03-06 11:56:54,322 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-03-06 11:56:54,322 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230306' 2023-03-06 11:56:54,322 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230306 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-06 11:56:54,322 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testMajorCompactionFromAdmin' column='family1' 2023-03-06 11:56:54,322 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-06 11:56:54,322 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] compactions.PartitionedMobCompactor(367): [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202303063a66cc9afe644bd4b975ee60739c341e_del] 2023-03-06 11:56:54,323 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:56:54,324 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202303063a66cc9afe644bd4b975ee60739c341e_del to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202303063a66cc9afe644bd4b975ee60739c341e_del 2023-03-06 11:56:54,324 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-03-06 11:56:54,324 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] compactions.PartitionedMobCompactor(367): [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230306233505960b3346da82de3e7504a38ebc_del] 2023-03-06 11:56:54,324 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:56:54,325 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230306233505960b3346da82de3e7504a38ebc_del to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230306233505960b3346da82de3e7504a38ebc_del 2023-03-06 11:56:54,325 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-03-06 11:56:54,325 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] compactions.PartitionedMobCompactor(367): [hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303064901236298e14eb19fc8e259d5f3828d_del] 2023-03-06 11:56:54,325 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] backup.HFileArchiver(360): Archiving compacted files. 2023-03-06 11:56:54,326 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303064901236298e14eb19fc8e259d5f3828d_del to hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303064901236298e14eb19fc8e259d5f3828d_del 2023-03-06 11:56:54,326 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-03-06 11:56:54,327 INFO [master/jenkins-hbase5:0:becomeActiveMaster-MasterMobCompaction-1678103646301] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-06 11:56:54,328 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=123, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-03-06 11:56:54,329 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=123, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE in 3.2520 sec 2023-03-06 11:56:54,342 DEBUG [Listener at localhost/46717] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-06 11:56:54,343 DEBUG [Listener at localhost/46717] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-06 11:56:54,346 DEBUG [Listener at localhost/46717] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-06 11:56:54,346 DEBUG [Listener at localhost/46717] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-06 11:56:54,350 INFO [Listener at localhost/46717] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-06 11:56:54,384 INFO [Listener at localhost/46717] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=246 (was 260), OpenFileDescriptor=637 (was 653), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=206 (was 133) - SystemLoadAverage LEAK? -, ProcessCount=162 (was 160) - ProcessCount LEAK? -, AvailableMemoryMB=9762 (was 9478) - AvailableMemoryMB LEAK? - 2023-03-06 11:56:54,384 DEBUG [Listener at localhost/46717] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x47652242 to 127.0.0.1:62659 2023-03-06 11:56:54,384 DEBUG [Listener at localhost/46717] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-06 11:56:54,385 INFO [Listener at localhost/46717] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-03-06 11:56:54,385 INFO [Listener at localhost/46717] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-06 11:56:54,385 DEBUG [Listener at localhost/46717] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5759ba4d to 127.0.0.1:62659 2023-03-06 11:56:54,385 DEBUG [Listener at localhost/46717] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-06 11:56:54,385 DEBUG [Listener at localhost/46717] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-03-06 11:56:54,385 DEBUG [Listener at localhost/46717] util.JVMClusterUtil(257): Found active master hash=1210721977, stopped=false 2023-03-06 11:56:54,385 INFO [Listener at localhost/46717] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase5.apache.org,36301,1678103641259 2023-03-06 11:56:54,387 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-03-06 11:56:54,387 INFO [Listener at localhost/46717] procedure2.ProcedureExecutor(629): Stopping 2023-03-06 11:56:54,387 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-06 11:56:54,387 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-03-06 11:56:54,387 DEBUG [Listener at localhost/46717] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1730ab8c to 127.0.0.1:62659 2023-03-06 11:56:54,388 DEBUG [Listener at localhost/46717] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-06 11:56:54,388 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-03-06 11:56:54,388 INFO [Listener at localhost/46717] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase5.apache.org,42547,1678103642479' ***** 2023-03-06 11:56:54,388 INFO [Listener at localhost/46717] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-03-06 11:56:54,388 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-03-06 11:56:54,388 INFO [RS:0;jenkins-hbase5:42547] regionserver.HeapMemoryManager(220): Stopping 2023-03-06 11:56:54,388 INFO [RS:0;jenkins-hbase5:42547] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-03-06 11:56:54,388 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-03-06 11:56:54,388 INFO [RS:0;jenkins-hbase5:42547] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-03-06 11:56:54,388 INFO [RS:0;jenkins-hbase5:42547] regionserver.HRegionServer(3304): Received CLOSE for 481a06c29321823efe5a4e1277a22968 2023-03-06 11:56:54,389 INFO [RS:0;jenkins-hbase5:42547] regionserver.HRegionServer(3304): Received CLOSE for 1ea5b692133196fdda0700a7028a36a1 2023-03-06 11:56:54,389 INFO [RS:0;jenkins-hbase5:42547] regionserver.HRegionServer(3304): Received CLOSE for 19a0eec34378d881af15151889d2e890 2023-03-06 11:56:54,389 INFO [RS:0;jenkins-hbase5:42547] regionserver.HRegionServer(3304): Received CLOSE for 2716db1eb01ab77f5e97af8e87170f80 2023-03-06 11:56:54,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 481a06c29321823efe5a4e1277a22968, disabling compactions & flushes 2023-03-06 11:56:54,389 INFO [RS:0;jenkins-hbase5:42547] regionserver.HRegionServer(3304): Received CLOSE for 2f269067b173a7b6fd05253fc30eb70c 2023-03-06 11:56:54,389 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1678103683637.481a06c29321823efe5a4e1277a22968. 2023-03-06 11:56:54,389 INFO [RS:0;jenkins-hbase5:42547] regionserver.HRegionServer(3304): Received CLOSE for 53b32d3064df8c51ca0fd7bd317a96a4 2023-03-06 11:56:54,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1678103683637.481a06c29321823efe5a4e1277a22968. 2023-03-06 11:56:54,389 INFO [RS:0;jenkins-hbase5:42547] regionserver.HRegionServer(3304): Received CLOSE for c2cfe3f574de2acbbfc1556c57115d2d 2023-03-06 11:56:54,389 INFO [RS:0;jenkins-hbase5:42547] regionserver.HRegionServer(3304): Received CLOSE for 37fd6ec3f6ee6e4f1f1f2a7f528dfd61 2023-03-06 11:56:54,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1678103683637.481a06c29321823efe5a4e1277a22968. after waiting 0 ms 2023-03-06 11:56:54,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1678103683637.481a06c29321823efe5a4e1277a22968. 2023-03-06 11:56:54,389 INFO [RS:0;jenkins-hbase5:42547] regionserver.HRegionServer(3304): Received CLOSE for 6dad7421b77af3fd70e66df0531fef4f 2023-03-06 11:56:54,389 INFO [RS:0;jenkins-hbase5:42547] regionserver.HRegionServer(3304): Received CLOSE for b28bd01ac58b51da722995493250192e 2023-03-06 11:56:54,389 INFO [RS:0;jenkins-hbase5:42547] regionserver.HRegionServer(3304): Received CLOSE for ef9ef54c7efbc7abe164d4b72ed65cde 2023-03-06 11:56:54,389 INFO [RS:0;jenkins-hbase5:42547] regionserver.HRegionServer(3304): Received CLOSE for f8635a0b679e1e26cb0200488a8ce436 2023-03-06 11:56:54,389 INFO [RS:0;jenkins-hbase5:42547] regionserver.HRegionServer(3304): Received CLOSE for 3ebcc443c84012d3eaff66f83852d128 2023-03-06 11:56:54,389 INFO [RS:0;jenkins-hbase5:42547] regionserver.HRegionServer(3304): Received CLOSE for 9423a74245608132f818a8fcb1dc4ed6 2023-03-06 11:56:54,389 INFO [RS:0;jenkins-hbase5:42547] regionserver.HRegionServer(3304): Received CLOSE for 5ab54f31ef0cb025ca841c2c033280dc 2023-03-06 11:56:54,389 INFO [RS:0;jenkins-hbase5:42547] regionserver.HRegionServer(3304): Received CLOSE for fcd435df5abbf6c1041ee699a8544449 2023-03-06 11:56:54,389 INFO [RS:0;jenkins-hbase5:42547] regionserver.HRegionServer(3304): Received CLOSE for 1bf4d18e651e20acc78c321164b94cc2 2023-03-06 11:56:54,389 INFO [RS:0;jenkins-hbase5:42547] regionserver.HRegionServer(3304): Received CLOSE for c4fb3434a20d7810ad775cbbe802313a 2023-03-06 11:56:54,389 INFO [RS:0;jenkins-hbase5:42547] regionserver.HRegionServer(3304): Received CLOSE for 2921237176876ba2f9c28123b4f2743d 2023-03-06 11:56:54,389 INFO [RS:0;jenkins-hbase5:42547] regionserver.HRegionServer(3304): Received CLOSE for 6bbeca1f31f3e780fe3cccddcf90df08 2023-03-06 11:56:54,389 INFO [RS:0;jenkins-hbase5:42547] regionserver.HRegionServer(1145): stopping server jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:54,390 DEBUG [RS:0;jenkins-hbase5:42547] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6c8db8b8 to 127.0.0.1:62659 2023-03-06 11:56:54,390 DEBUG [RS:0;jenkins-hbase5:42547] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-06 11:56:54,390 INFO [RS:0;jenkins-hbase5:42547] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-03-06 11:56:54,390 INFO [RS:0;jenkins-hbase5:42547] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-03-06 11:56:54,390 INFO [RS:0;jenkins-hbase5:42547] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-03-06 11:56:54,390 INFO [RS:0;jenkins-hbase5:42547] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-03-06 11:56:54,390 INFO [RS:0;jenkins-hbase5:42547] regionserver.HRegionServer(1475): Waiting on 21 regions to close 2023-03-06 11:56:54,391 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-03-06 11:56:54,391 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-03-06 11:56:54,391 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-03-06 11:56:54,391 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-03-06 11:56:54,391 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-03-06 11:56:54,391 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=50.56 KB heapSize=78.23 KB 2023-03-06 11:56:54,391 DEBUG [RS:0;jenkins-hbase5:42547] regionserver.HRegionServer(1505): Waiting on 1588230740, 19a0eec34378d881af15151889d2e890, 1bf4d18e651e20acc78c321164b94cc2, 1ea5b692133196fdda0700a7028a36a1, 2716db1eb01ab77f5e97af8e87170f80, 2921237176876ba2f9c28123b4f2743d, 2f269067b173a7b6fd05253fc30eb70c, 37fd6ec3f6ee6e4f1f1f2a7f528dfd61, 3ebcc443c84012d3eaff66f83852d128, 481a06c29321823efe5a4e1277a22968, 53b32d3064df8c51ca0fd7bd317a96a4, 5ab54f31ef0cb025ca841c2c033280dc, 6bbeca1f31f3e780fe3cccddcf90df08, 6dad7421b77af3fd70e66df0531fef4f, 9423a74245608132f818a8fcb1dc4ed6, b28bd01ac58b51da722995493250192e, c2cfe3f574de2acbbfc1556c57115d2d, c4fb3434a20d7810ad775cbbe802313a, ef9ef54c7efbc7abe164d4b72ed65cde, f8635a0b679e1e26cb0200488a8ce436, fcd435df5abbf6c1041ee699a8544449 2023-03-06 11:56:54,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testScannerOnBulkLoadRefHFiles/481a06c29321823efe5a4e1277a22968/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-03-06 11:56:54,393 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1678103683637.481a06c29321823efe5a4e1277a22968. 2023-03-06 11:56:54,393 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 481a06c29321823efe5a4e1277a22968: 2023-03-06 11:56:54,393 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,,1678103683637.481a06c29321823efe5a4e1277a22968. 2023-03-06 11:56:54,394 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 1ea5b692133196fdda0700a7028a36a1, disabling compactions & flushes 2023-03-06 11:56:54,394 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1. 2023-03-06 11:56:54,394 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1. 2023-03-06 11:56:54,394 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1. after waiting 0 ms 2023-03-06 11:56:54,394 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1. 2023-03-06 11:56:54,397 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ea5b692133196fdda0700a7028a36a1/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-03-06 11:56:54,398 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1. 2023-03-06 11:56:54,398 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 1ea5b692133196fdda0700a7028a36a1: 2023-03-06 11:56:54,398 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678103714465.1ea5b692133196fdda0700a7028a36a1. 2023-03-06 11:56:54,399 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 19a0eec34378d881af15151889d2e890, disabling compactions & flushes 2023-03-06 11:56:54,399 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1678103763522.19a0eec34378d881af15151889d2e890. 2023-03-06 11:56:54,399 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1678103763522.19a0eec34378d881af15151889d2e890. 2023-03-06 11:56:54,399 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1678103763522.19a0eec34378d881af15151889d2e890. after waiting 0 ms 2023-03-06 11:56:54,399 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1678103763522.19a0eec34378d881af15151889d2e890. 2023-03-06 11:56:54,399 INFO [regionserver/jenkins-hbase5:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactedHFilesCleaner was stopped 2023-03-06 11:56:54,404 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/19a0eec34378d881af15151889d2e890/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-06 11:56:54,405 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1678103763522.19a0eec34378d881af15151889d2e890. 2023-03-06 11:56:54,405 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 19a0eec34378d881af15151889d2e890: 2023-03-06 11:56:54,405 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,,1678103763522.19a0eec34378d881af15151889d2e890. 2023-03-06 11:56:54,405 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 2716db1eb01ab77f5e97af8e87170f80, disabling compactions & flushes 2023-03-06 11:56:54,406 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1678103683637.2716db1eb01ab77f5e97af8e87170f80. 2023-03-06 11:56:54,406 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1678103683637.2716db1eb01ab77f5e97af8e87170f80. 2023-03-06 11:56:54,406 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1678103683637.2716db1eb01ab77f5e97af8e87170f80. after waiting 0 ms 2023-03-06 11:56:54,406 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1678103683637.2716db1eb01ab77f5e97af8e87170f80. 2023-03-06 11:56:54,408 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testScannerOnBulkLoadRefHFiles/2716db1eb01ab77f5e97af8e87170f80/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-03-06 11:56:54,409 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1678103683637.2716db1eb01ab77f5e97af8e87170f80. 2023-03-06 11:56:54,409 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 2716db1eb01ab77f5e97af8e87170f80: 2023-03-06 11:56:54,409 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,2,1678103683637.2716db1eb01ab77f5e97af8e87170f80. 2023-03-06 11:56:54,409 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 2f269067b173a7b6fd05253fc30eb70c, disabling compactions & flushes 2023-03-06 11:56:54,409 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c. 2023-03-06 11:56:54,409 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c. 2023-03-06 11:56:54,409 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c. after waiting 0 ms 2023-03-06 11:56:54,409 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c. 2023-03-06 11:56:54,412 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/2f269067b173a7b6fd05253fc30eb70c/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-03-06 11:56:54,413 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c. 2023-03-06 11:56:54,413 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 2f269067b173a7b6fd05253fc30eb70c: 2023-03-06 11:56:54,413 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,1,1678103735822.2f269067b173a7b6fd05253fc30eb70c. 2023-03-06 11:56:54,413 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 53b32d3064df8c51ca0fd7bd317a96a4, disabling compactions & flushes 2023-03-06 11:56:54,413 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4. 2023-03-06 11:56:54,413 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4. 2023-03-06 11:56:54,413 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4. after waiting 0 ms 2023-03-06 11:56:54,413 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4. 2023-03-06 11:56:54,416 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/53b32d3064df8c51ca0fd7bd317a96a4/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-03-06 11:56:54,417 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4. 2023-03-06 11:56:54,417 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 53b32d3064df8c51ca0fd7bd317a96a4: 2023-03-06 11:56:54,417 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1678103646415.53b32d3064df8c51ca0fd7bd317a96a4. 2023-03-06 11:56:54,417 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing c2cfe3f574de2acbbfc1556c57115d2d, disabling compactions & flushes 2023-03-06 11:56:54,417 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d. 2023-03-06 11:56:54,417 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d. 2023-03-06 11:56:54,417 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d. after waiting 0 ms 2023-03-06 11:56:54,417 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d. 2023-03-06 11:56:54,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/c2cfe3f574de2acbbfc1556c57115d2d/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-03-06 11:56:54,421 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d. 2023-03-06 11:56:54,421 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for c2cfe3f574de2acbbfc1556c57115d2d: 2023-03-06 11:56:54,421 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,,1678103735822.c2cfe3f574de2acbbfc1556c57115d2d. 2023-03-06 11:56:54,421 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 37fd6ec3f6ee6e4f1f1f2a7f528dfd61, disabling compactions & flushes 2023-03-06 11:56:54,421 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1678103782626.37fd6ec3f6ee6e4f1f1f2a7f528dfd61. 2023-03-06 11:56:54,421 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1678103782626.37fd6ec3f6ee6e4f1f1f2a7f528dfd61. 2023-03-06 11:56:54,421 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1678103782626.37fd6ec3f6ee6e4f1f1f2a7f528dfd61. after waiting 0 ms 2023-03-06 11:56:54,421 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1678103782626.37fd6ec3f6ee6e4f1f1f2a7f528dfd61. 2023-03-06 11:56:54,424 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithMonthlyPolicy/37fd6ec3f6ee6e4f1f1f2a7f528dfd61/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-03-06 11:56:54,425 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1678103782626.37fd6ec3f6ee6e4f1f1f2a7f528dfd61. 2023-03-06 11:56:54,425 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 37fd6ec3f6ee6e4f1f1f2a7f528dfd61: 2023-03-06 11:56:54,425 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithMonthlyPolicy,,1678103782626.37fd6ec3f6ee6e4f1f1f2a7f528dfd61. 2023-03-06 11:56:54,425 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 6dad7421b77af3fd70e66df0531fef4f, disabling compactions & flushes 2023-03-06 11:56:54,425 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f. 2023-03-06 11:56:54,425 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f. 2023-03-06 11:56:54,425 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f. after waiting 0 ms 2023-03-06 11:56:54,425 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f. 2023-03-06 11:56:54,428 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6dad7421b77af3fd70e66df0531fef4f/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-03-06 11:56:54,428 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f. 2023-03-06 11:56:54,429 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 6dad7421b77af3fd70e66df0531fef4f: 2023-03-06 11:56:54,429 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678103699442.6dad7421b77af3fd70e66df0531fef4f. 2023-03-06 11:56:54,429 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing b28bd01ac58b51da722995493250192e, disabling compactions & flushes 2023-03-06 11:56:54,429 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e. 2023-03-06 11:56:54,429 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e. 2023-03-06 11:56:54,429 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e. after waiting 0 ms 2023-03-06 11:56:54,429 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e. 2023-03-06 11:56:54,433 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testCompactionWithHFileLink/b28bd01ac58b51da722995493250192e/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-03-06 11:56:54,434 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e. 2023-03-06 11:56:54,434 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for b28bd01ac58b51da722995493250192e: 2023-03-06 11:56:54,434 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,2,1678103735822.b28bd01ac58b51da722995493250192e. 2023-03-06 11:56:54,434 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing ef9ef54c7efbc7abe164d4b72ed65cde, disabling compactions & flushes 2023-03-06 11:56:54,434 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1678103794935.ef9ef54c7efbc7abe164d4b72ed65cde. 2023-03-06 11:56:54,434 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1678103794935.ef9ef54c7efbc7abe164d4b72ed65cde. 2023-03-06 11:56:54,434 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1678103794935.ef9ef54c7efbc7abe164d4b72ed65cde. after waiting 0 ms 2023-03-06 11:56:54,434 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1678103794935.ef9ef54c7efbc7abe164d4b72ed65cde. 2023-03-06 11:56:54,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/ef9ef54c7efbc7abe164d4b72ed65cde/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-06 11:56:54,440 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1678103794935.ef9ef54c7efbc7abe164d4b72ed65cde. 2023-03-06 11:56:54,440 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for ef9ef54c7efbc7abe164d4b72ed65cde: 2023-03-06 11:56:54,440 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,,1678103794935.ef9ef54c7efbc7abe164d4b72ed65cde. 2023-03-06 11:56:54,440 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing f8635a0b679e1e26cb0200488a8ce436, disabling compactions & flushes 2023-03-06 11:56:54,440 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1678103688296.f8635a0b679e1e26cb0200488a8ce436. 2023-03-06 11:56:54,440 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1678103688296.f8635a0b679e1e26cb0200488a8ce436. 2023-03-06 11:56:54,440 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1678103688296.f8635a0b679e1e26cb0200488a8ce436. after waiting 0 ms 2023-03-06 11:56:54,440 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1678103688296.f8635a0b679e1e26cb0200488a8ce436. 2023-03-06 11:56:54,443 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithWeeklyPolicy/f8635a0b679e1e26cb0200488a8ce436/recovered.edits/49.seqid, newMaxSeqId=49, maxSeqId=1 2023-03-06 11:56:54,444 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1678103688296.f8635a0b679e1e26cb0200488a8ce436. 2023-03-06 11:56:54,444 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for f8635a0b679e1e26cb0200488a8ce436: 2023-03-06 11:56:54,444 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyPolicy,,1678103688296.f8635a0b679e1e26cb0200488a8ce436. 2023-03-06 11:56:54,444 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 3ebcc443c84012d3eaff66f83852d128, disabling compactions & flushes 2023-03-06 11:56:54,444 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1678103794935.3ebcc443c84012d3eaff66f83852d128. 2023-03-06 11:56:54,444 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1678103794935.3ebcc443c84012d3eaff66f83852d128. 2023-03-06 11:56:54,444 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1678103794935.3ebcc443c84012d3eaff66f83852d128. after waiting 0 ms 2023-03-06 11:56:54,444 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1678103794935.3ebcc443c84012d3eaff66f83852d128. 2023-03-06 11:56:54,447 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/3ebcc443c84012d3eaff66f83852d128/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-06 11:56:54,448 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1678103794935.3ebcc443c84012d3eaff66f83852d128. 2023-03-06 11:56:54,448 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 3ebcc443c84012d3eaff66f83852d128: 2023-03-06 11:56:54,448 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,1,1678103794935.3ebcc443c84012d3eaff66f83852d128. 2023-03-06 11:56:54,448 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 9423a74245608132f818a8fcb1dc4ed6, disabling compactions & flushes 2023-03-06 11:56:54,449 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1678103763522.9423a74245608132f818a8fcb1dc4ed6. 2023-03-06 11:56:54,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1678103763522.9423a74245608132f818a8fcb1dc4ed6. 2023-03-06 11:56:54,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1678103763522.9423a74245608132f818a8fcb1dc4ed6. after waiting 0 ms 2023-03-06 11:56:54,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1678103763522.9423a74245608132f818a8fcb1dc4ed6. 2023-03-06 11:56:54,450 INFO [regionserver/jenkins-hbase5:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-03-06 11:56:54,451 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/9423a74245608132f818a8fcb1dc4ed6/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-06 11:56:54,452 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1678103763522.9423a74245608132f818a8fcb1dc4ed6. 2023-03-06 11:56:54,452 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 9423a74245608132f818a8fcb1dc4ed6: 2023-03-06 11:56:54,452 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,2,1678103763522.9423a74245608132f818a8fcb1dc4ed6. 2023-03-06 11:56:54,452 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 5ab54f31ef0cb025ca841c2c033280dc, disabling compactions & flushes 2023-03-06 11:56:54,452 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1678103794935.5ab54f31ef0cb025ca841c2c033280dc. 2023-03-06 11:56:54,452 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1678103794935.5ab54f31ef0cb025ca841c2c033280dc. 2023-03-06 11:56:54,452 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1678103794935.5ab54f31ef0cb025ca841c2c033280dc. after waiting 0 ms 2023-03-06 11:56:54,452 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1678103794935.5ab54f31ef0cb025ca841c2c033280dc. 2023-03-06 11:56:54,455 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionFromAdmin/5ab54f31ef0cb025ca841c2c033280dc/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-06 11:56:54,455 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1678103794935.5ab54f31ef0cb025ca841c2c033280dc. 2023-03-06 11:56:54,455 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 5ab54f31ef0cb025ca841c2c033280dc: 2023-03-06 11:56:54,455 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,2,1678103794935.5ab54f31ef0cb025ca841c2c033280dc. 2023-03-06 11:56:54,455 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing fcd435df5abbf6c1041ee699a8544449, disabling compactions & flushes 2023-03-06 11:56:54,455 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1678103670639.fcd435df5abbf6c1041ee699a8544449. 2023-03-06 11:56:54,455 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1678103670639.fcd435df5abbf6c1041ee699a8544449. 2023-03-06 11:56:54,455 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1678103670639.fcd435df5abbf6c1041ee699a8544449. after waiting 0 ms 2023-03-06 11:56:54,456 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1678103670639.fcd435df5abbf6c1041ee699a8544449. 2023-03-06 11:56:54,458 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMinorCompactionWithWeeklyPolicy/fcd435df5abbf6c1041ee699a8544449/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-03-06 11:56:54,458 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1678103670639.fcd435df5abbf6c1041ee699a8544449. 2023-03-06 11:56:54,458 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for fcd435df5abbf6c1041ee699a8544449: 2023-03-06 11:56:54,458 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithWeeklyPolicy,,1678103670639.fcd435df5abbf6c1041ee699a8544449. 2023-03-06 11:56:54,458 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 1bf4d18e651e20acc78c321164b94cc2, disabling compactions & flushes 2023-03-06 11:56:54,458 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1678103763522.1bf4d18e651e20acc78c321164b94cc2. 2023-03-06 11:56:54,458 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1678103763522.1bf4d18e651e20acc78c321164b94cc2. 2023-03-06 11:56:54,458 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1678103763522.1bf4d18e651e20acc78c321164b94cc2. after waiting 0 ms 2023-03-06 11:56:54,459 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1678103763522.1bf4d18e651e20acc78c321164b94cc2. 2023-03-06 11:56:54,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/ns/testMinorCompaction/1bf4d18e651e20acc78c321164b94cc2/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-06 11:56:54,462 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1678103763522.1bf4d18e651e20acc78c321164b94cc2. 2023-03-06 11:56:54,462 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 1bf4d18e651e20acc78c321164b94cc2: 2023-03-06 11:56:54,462 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,1,1678103763522.1bf4d18e651e20acc78c321164b94cc2. 2023-03-06 11:56:54,462 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing c4fb3434a20d7810ad775cbbe802313a, disabling compactions & flushes 2023-03-06 11:56:54,462 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1678103644771.c4fb3434a20d7810ad775cbbe802313a. 2023-03-06 11:56:54,462 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1678103644771.c4fb3434a20d7810ad775cbbe802313a. 2023-03-06 11:56:54,462 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1678103644771.c4fb3434a20d7810ad775cbbe802313a. after waiting 0 ms 2023-03-06 11:56:54,462 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1678103644771.c4fb3434a20d7810ad775cbbe802313a. 2023-03-06 11:56:54,462 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2745): Flushing c4fb3434a20d7810ad775cbbe802313a 1/1 column families, dataSize=109 B heapSize=592 B 2023-03-06 11:56:54,591 DEBUG [RS:0;jenkins-hbase5:42547] regionserver.HRegionServer(1505): Waiting on 1588230740, 2921237176876ba2f9c28123b4f2743d, 6bbeca1f31f3e780fe3cccddcf90df08, c4fb3434a20d7810ad775cbbe802313a 2023-03-06 11:56:54,792 DEBUG [RS:0;jenkins-hbase5:42547] regionserver.HRegionServer(1505): Waiting on 1588230740, 2921237176876ba2f9c28123b4f2743d, 6bbeca1f31f3e780fe3cccddcf90df08, c4fb3434a20d7810ad775cbbe802313a 2023-03-06 11:56:54,805 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=48.28 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/hbase/meta/1588230740/.tmp/info/a4542987a15542eb910e02e7acebdb46 2023-03-06 11:56:54,810 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a4542987a15542eb910e02e7acebdb46 2023-03-06 11:56:54,811 INFO [regionserver/jenkins-hbase5:0.Chore.2] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-03-06 11:56:54,811 INFO [regionserver/jenkins-hbase5:0.Chore.2] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-03-06 11:56:54,868 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=109 B at sequenceid=7 (bloomFilter=true), to=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/hbase/namespace/c4fb3434a20d7810ad775cbbe802313a/.tmp/info/a63dadf85d244c9a96ed98b3583eee3c 2023-03-06 11:56:54,873 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/hbase/namespace/c4fb3434a20d7810ad775cbbe802313a/.tmp/info/a63dadf85d244c9a96ed98b3583eee3c as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/hbase/namespace/c4fb3434a20d7810ad775cbbe802313a/info/a63dadf85d244c9a96ed98b3583eee3c 2023-03-06 11:56:54,876 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/hbase/namespace/c4fb3434a20d7810ad775cbbe802313a/info/a63dadf85d244c9a96ed98b3583eee3c, entries=3, sequenceid=7, filesize=4.8 K 2023-03-06 11:56:54,877 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for c4fb3434a20d7810ad775cbbe802313a in 415ms, sequenceid=7, compaction requested=false 2023-03-06 11:56:54,880 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/hbase/namespace/c4fb3434a20d7810ad775cbbe802313a/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=1 2023-03-06 11:56:54,880 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1678103644771.c4fb3434a20d7810ad775cbbe802313a. 2023-03-06 11:56:54,880 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for c4fb3434a20d7810ad775cbbe802313a: 2023-03-06 11:56:54,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1678103644771.c4fb3434a20d7810ad775cbbe802313a. 2023-03-06 11:56:54,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 2921237176876ba2f9c28123b4f2743d, disabling compactions & flushes 2023-03-06 11:56:54,881 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1678103683637.2921237176876ba2f9c28123b4f2743d. 2023-03-06 11:56:54,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1678103683637.2921237176876ba2f9c28123b4f2743d. 2023-03-06 11:56:54,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1678103683637.2921237176876ba2f9c28123b4f2743d. after waiting 0 ms 2023-03-06 11:56:54,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1678103683637.2921237176876ba2f9c28123b4f2743d. 2023-03-06 11:56:54,885 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testScannerOnBulkLoadRefHFiles/2921237176876ba2f9c28123b4f2743d/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-03-06 11:56:54,886 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1678103683637.2921237176876ba2f9c28123b4f2743d. 2023-03-06 11:56:54,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 2921237176876ba2f9c28123b4f2743d: 2023-03-06 11:56:54,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,1,1678103683637.2921237176876ba2f9c28123b4f2743d. 2023-03-06 11:56:54,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 6bbeca1f31f3e780fe3cccddcf90df08, disabling compactions & flushes 2023-03-06 11:56:54,886 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1678103659482.6bbeca1f31f3e780fe3cccddcf90df08. 2023-03-06 11:56:54,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1678103659482.6bbeca1f31f3e780fe3cccddcf90df08. 2023-03-06 11:56:54,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1678103659482.6bbeca1f31f3e780fe3cccddcf90df08. after waiting 0 ms 2023-03-06 11:56:54,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1678103659482.6bbeca1f31f3e780fe3cccddcf90df08. 2023-03-06 11:56:54,889 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/default/testMajorCompactionWithMonthlyPolicy/6bbeca1f31f3e780fe3cccddcf90df08/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-03-06 11:56:54,889 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1678103659482.6bbeca1f31f3e780fe3cccddcf90df08. 2023-03-06 11:56:54,889 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 6bbeca1f31f3e780fe3cccddcf90df08: 2023-03-06 11:56:54,889 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithMonthlyPolicy,,1678103659482.6bbeca1f31f3e780fe3cccddcf90df08. 2023-03-06 11:56:54,992 DEBUG [RS:0;jenkins-hbase5:42547] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-03-06 11:56:55,192 DEBUG [RS:0;jenkins-hbase5:42547] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-03-06 11:56:55,216 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=102 B at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/hbase/meta/1588230740/.tmp/rep_barrier/d65de2d003204d36add389d9002fed02 2023-03-06 11:56:55,219 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d65de2d003204d36add389d9002fed02 2023-03-06 11:56:55,243 DEBUG [regionserver/jenkins-hbase5:0.Chore.2] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-03-06 11:56:55,393 INFO [RS:0;jenkins-hbase5:42547] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-03-06 11:56:55,393 DEBUG [RS:0;jenkins-hbase5:42547] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-03-06 11:56:55,393 DEBUG [RS:0;jenkins-hbase5:42547] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-03-06 11:56:55,593 DEBUG [RS:0;jenkins-hbase5:42547] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-03-06 11:56:55,626 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.18 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/hbase/meta/1588230740/.tmp/table/7382d1cb78174b44ab667804dd49716a 2023-03-06 11:56:55,629 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7382d1cb78174b44ab667804dd49716a 2023-03-06 11:56:55,630 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/hbase/meta/1588230740/.tmp/info/a4542987a15542eb910e02e7acebdb46 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/hbase/meta/1588230740/info/a4542987a15542eb910e02e7acebdb46 2023-03-06 11:56:55,633 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a4542987a15542eb910e02e7acebdb46 2023-03-06 11:56:55,634 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/hbase/meta/1588230740/info/a4542987a15542eb910e02e7acebdb46, entries=226, sequenceid=130, filesize=37.9 K 2023-03-06 11:56:55,634 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/hbase/meta/1588230740/.tmp/rep_barrier/d65de2d003204d36add389d9002fed02 as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/hbase/meta/1588230740/rep_barrier/d65de2d003204d36add389d9002fed02 2023-03-06 11:56:55,637 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d65de2d003204d36add389d9002fed02 2023-03-06 11:56:55,637 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/hbase/meta/1588230740/rep_barrier/d65de2d003204d36add389d9002fed02, entries=1, sequenceid=130, filesize=5.0 K 2023-03-06 11:56:55,638 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/hbase/meta/1588230740/.tmp/table/7382d1cb78174b44ab667804dd49716a as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/hbase/meta/1588230740/table/7382d1cb78174b44ab667804dd49716a 2023-03-06 11:56:55,640 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7382d1cb78174b44ab667804dd49716a 2023-03-06 11:56:55,640 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/hbase/meta/1588230740/table/7382d1cb78174b44ab667804dd49716a, entries=27, sequenceid=130, filesize=6.6 K 2023-03-06 11:56:55,642 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~50.56 KB/51772, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 1251ms, sequenceid=130, compaction requested=false 2023-03-06 11:56:55,646 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/data/hbase/meta/1588230740/recovered.edits/133.seqid, newMaxSeqId=133, maxSeqId=1 2023-03-06 11:56:55,646 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-03-06 11:56:55,646 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-03-06 11:56:55,646 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-03-06 11:56:55,646 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-03-06 11:56:55,793 INFO [RS:0;jenkins-hbase5:42547] regionserver.HRegionServer(1171): stopping server jenkins-hbase5.apache.org,42547,1678103642479; all regions closed. 2023-03-06 11:56:55,800 DEBUG [RS:0;jenkins-hbase5:42547] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/oldWALs 2023-03-06 11:56:55,800 INFO [RS:0;jenkins-hbase5:42547] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase5.apache.org%2C42547%2C1678103642479.meta:.meta(num 1678103644497) 2023-03-06 11:56:55,804 DEBUG [RS:0;jenkins-hbase5:42547] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/oldWALs 2023-03-06 11:56:55,804 INFO [RS:0;jenkins-hbase5:42547] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase5.apache.org%2C42547%2C1678103642479:(num 1678103643957) 2023-03-06 11:56:55,804 DEBUG [RS:0;jenkins-hbase5:42547] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-06 11:56:55,804 INFO [RS:0;jenkins-hbase5:42547] regionserver.LeaseManager(133): Closed leases 2023-03-06 11:56:55,805 INFO [RS:0;jenkins-hbase5:42547] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase5:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-03-06 11:56:55,805 INFO [regionserver/jenkins-hbase5:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-03-06 11:56:55,806 INFO [RS:0;jenkins-hbase5:42547] ipc.NettyRpcServer(158): Stopping server on /172.31.10.131:42547 2023-03-06 11:56:55,813 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase5.apache.org,42547,1678103642479 2023-03-06 11:56:55,813 ERROR [Listener at localhost/46717-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3f268a6f rejected from java.util.concurrent.ThreadPoolExecutor@3b190953[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 532] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-03-06 11:56:55,813 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-03-06 11:56:55,813 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-03-06 11:56:55,814 ERROR [Listener at localhost/46717-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@445105ce rejected from java.util.concurrent.ThreadPoolExecutor@3b190953[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 532] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-03-06 11:56:55,815 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase5.apache.org,42547,1678103642479] 2023-03-06 11:56:55,816 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase5.apache.org,42547,1678103642479; numProcessing=1 2023-03-06 11:56:55,817 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase5.apache.org,42547,1678103642479 already deleted, retry=false 2023-03-06 11:56:55,817 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase5.apache.org,42547,1678103642479 expired; onlineServers=0 2023-03-06 11:56:55,817 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase5.apache.org,36301,1678103641259' ***** 2023-03-06 11:56:55,817 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-03-06 11:56:55,817 DEBUG [M:0;jenkins-hbase5:36301] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@9172c82, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase5.apache.org/172.31.10.131:0 2023-03-06 11:56:55,817 INFO [M:0;jenkins-hbase5:36301] regionserver.HRegionServer(1145): stopping server jenkins-hbase5.apache.org,36301,1678103641259 2023-03-06 11:56:55,817 INFO [M:0;jenkins-hbase5:36301] regionserver.HRegionServer(1171): stopping server jenkins-hbase5.apache.org,36301,1678103641259; all regions closed. 2023-03-06 11:56:55,817 DEBUG [M:0;jenkins-hbase5:36301] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-06 11:56:55,817 DEBUG [M:0;jenkins-hbase5:36301] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-03-06 11:56:55,817 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-03-06 11:56:55,818 DEBUG [M:0;jenkins-hbase5:36301] cleaner.HFileCleaner(317): Stopping file delete threads 2023-03-06 11:56:55,818 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.small.0-1678103643611] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.small.0-1678103643611,5,FailOnTimeoutGroup] 2023-03-06 11:56:55,818 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.large.0-1678103643609] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.large.0-1678103643609,5,FailOnTimeoutGroup] 2023-03-06 11:56:55,818 INFO [M:0;jenkins-hbase5:36301] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-03-06 11:56:55,818 INFO [M:0;jenkins-hbase5:36301] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-03-06 11:56:55,818 INFO [M:0;jenkins-hbase5:36301] hbase.ChoreService(369): Chore service for: master/jenkins-hbase5:0 had [] on shutdown 2023-03-06 11:56:55,818 DEBUG [M:0;jenkins-hbase5:36301] master.HMaster(1512): Stopping service threads 2023-03-06 11:56:55,819 INFO [M:0;jenkins-hbase5:36301] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-03-06 11:56:55,819 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-03-06 11:56:55,819 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-06 11:56:55,819 ERROR [M:0;jenkins-hbase5:36301] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-20,5,PEWorkerGroup] Thread[HFileArchiver-21,5,PEWorkerGroup] Thread[HFileArchiver-22,5,PEWorkerGroup] 2023-03-06 11:56:55,819 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-03-06 11:56:55,819 INFO [M:0;jenkins-hbase5:36301] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-03-06 11:56:55,820 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-03-06 11:56:55,820 DEBUG [M:0;jenkins-hbase5:36301] zookeeper.ZKUtil(398): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-03-06 11:56:55,820 WARN [M:0;jenkins-hbase5:36301] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-03-06 11:56:55,820 INFO [M:0;jenkins-hbase5:36301] assignment.AssignmentManager(315): Stopping assignment manager 2023-03-06 11:56:55,820 INFO [M:0;jenkins-hbase5:36301] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-03-06 11:56:55,820 DEBUG [M:0;jenkins-hbase5:36301] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-03-06 11:56:55,820 INFO [M:0;jenkins-hbase5:36301] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-06 11:56:55,820 DEBUG [M:0;jenkins-hbase5:36301] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-06 11:56:55,820 DEBUG [M:0;jenkins-hbase5:36301] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-03-06 11:56:55,820 DEBUG [M:0;jenkins-hbase5:36301] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-06 11:56:55,820 INFO [M:0;jenkins-hbase5:36301] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=512.51 KB heapSize=598.34 KB 2023-03-06 11:56:55,828 INFO [M:0;jenkins-hbase5:36301] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=512.51 KB at sequenceid=1006 (bloomFilter=true), to=hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/c17c0d75a51a41dfbd2590c3857cb40c 2023-03-06 11:56:55,831 INFO [M:0;jenkins-hbase5:36301] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c17c0d75a51a41dfbd2590c3857cb40c 2023-03-06 11:56:55,831 DEBUG [M:0;jenkins-hbase5:36301] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/c17c0d75a51a41dfbd2590c3857cb40c as hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/c17c0d75a51a41dfbd2590c3857cb40c 2023-03-06 11:56:55,834 INFO [M:0;jenkins-hbase5:36301] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c17c0d75a51a41dfbd2590c3857cb40c 2023-03-06 11:56:55,834 INFO [M:0;jenkins-hbase5:36301] regionserver.HStore(1080): Added hdfs://localhost:35391/user/jenkins/test-data/be4c7de2-9919-20d4-6c35-c451331e9dcc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/c17c0d75a51a41dfbd2590c3857cb40c, entries=123, sequenceid=1006, filesize=33.3 K 2023-03-06 11:56:55,835 INFO [M:0;jenkins-hbase5:36301] regionserver.HRegion(2948): Finished flush of dataSize ~512.51 KB/524814, heapSize ~598.32 KB/612680, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 15ms, sequenceid=1006, compaction requested=false 2023-03-06 11:56:55,835 INFO [M:0;jenkins-hbase5:36301] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-06 11:56:55,835 DEBUG [M:0;jenkins-hbase5:36301] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-03-06 11:56:55,838 INFO [M:0;jenkins-hbase5:36301] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-03-06 11:56:55,838 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-03-06 11:56:55,838 INFO [M:0;jenkins-hbase5:36301] ipc.NettyRpcServer(158): Stopping server on /172.31.10.131:36301 2023-03-06 11:56:55,840 DEBUG [M:0;jenkins-hbase5:36301] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase5.apache.org,36301,1678103641259 already deleted, retry=false 2023-03-06 11:56:55,915 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-03-06 11:56:55,915 INFO [RS:0;jenkins-hbase5:42547] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase5.apache.org,42547,1678103642479; zookeeper connection closed. 2023-03-06 11:56:55,916 ERROR [Listener at localhost/46717-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3c8f41fe rejected from java.util.concurrent.ThreadPoolExecutor@3b190953[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 532] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-03-06 11:56:55,916 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): regionserver:42547-0x101162a25110001, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-03-06 11:56:55,916 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3b0232ca] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3b0232ca 2023-03-06 11:56:55,916 ERROR [Listener at localhost/46717-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@52076666 rejected from java.util.concurrent.ThreadPoolExecutor@3b190953[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 532] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-03-06 11:56:55,916 INFO [Listener at localhost/46717] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-03-06 11:56:56,016 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-03-06 11:56:56,016 INFO [M:0;jenkins-hbase5:36301] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase5.apache.org,36301,1678103641259; zookeeper connection closed. 2023-03-06 11:56:56,016 ERROR [Listener at localhost/46717-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@579c3407 rejected from java.util.concurrent.ThreadPoolExecutor@64e0163e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 907] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-03-06 11:56:56,016 DEBUG [Listener at localhost/46717-EventThread] zookeeper.ZKWatcher(600): master:36301-0x101162a25110000, quorum=127.0.0.1:62659, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-03-06 11:56:56,016 ERROR [Listener at localhost/46717-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2d5bac32 rejected from java.util.concurrent.ThreadPoolExecutor@64e0163e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 907] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-03-06 11:56:56,018 WARN [Listener at localhost/46717] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-03-06 11:56:56,021 INFO [Listener at localhost/46717] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-03-06 11:56:56,128 WARN [BP-1623946267-172.31.10.131-1678103637894 heartbeating to localhost/127.0.0.1:35391] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-03-06 11:56:56,128 WARN [BP-1623946267-172.31.10.131-1678103637894 heartbeating to localhost/127.0.0.1:35391] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1623946267-172.31.10.131-1678103637894 (Datanode Uuid e60524ea-e91b-4b2e-946c-e54e40c52f9e) service to localhost/127.0.0.1:35391 2023-03-06 11:56:56,130 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0ddf990b-bc92-2c37-86d7-812d88f764cd/cluster_aae53e47-46ad-d770-1d84-dd40728b0050/dfs/data/data1/current/BP-1623946267-172.31.10.131-1678103637894] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-03-06 11:56:56,131 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0ddf990b-bc92-2c37-86d7-812d88f764cd/cluster_aae53e47-46ad-d770-1d84-dd40728b0050/dfs/data/data2/current/BP-1623946267-172.31.10.131-1678103637894] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-03-06 11:56:56,158 INFO [Listener at localhost/46717] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-03-06 11:56:56,297 INFO [Listener at localhost/46717] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-03-06 11:56:56,382 INFO [Listener at localhost/46717] hbase.HBaseTestingUtility(1293): Minicluster is down